Spiders blocked by cookies

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
User avatar
dstefani
Forum Contributor
Posts: 140
Joined: Sat Jan 11, 2003 9:34 am
Location: Meridian Idaho, USA

Spiders blocked by cookies

Post by dstefani »

After googling this for a while, I've failed to get a "clear" answer, but what I've gleaned so far is...

Bot's like googlebot etc are stopped by cookies being set (and in turn session id's as 'cookies') Can anyone confirm this?

So it would seem that using a condition of "if user agent ! =preg_match array(bot_name) of bot names don't start_session();
else start_session();"

I've done some testing using the lynx browser which I've heard is a good place to test your site for spider-bot compatability.
When using session_start() lynx stopped and asked me if I wanted the cookie, so I guess a spider would stop to?

Thanks for any input you may have.

- dstefani
Post Reply