Hi,
i'm looking for the best way to detect a searchengine-bot, for example if google or yahoo passes to crawl my site.
Anyone has some experience with this?
greetings, tom
detect searchengine-bot
Moderator: General Moderators
- aaronhall
- DevNet Resident
- Posts: 1040
- Joined: Tue Aug 13, 2002 5:10 pm
- Location: Back in Phoenix, missing the microbrews
- Contact:
The user agent is available with $_SERVER['HTTP_USER_AGENT']. A list of web spider user agents is available at http://www.psychedelix.com/agents/index.shtml or http://www.psychedelix.com/agents/index.shtml
- feyd
- Neighborhood Spidermoddy
- Posts: 31559
- Joined: Mon Mar 29, 2004 3:24 pm
- Location: Bothell, Washington, USA
get_browser() can often be a simple and fast way to determine if the requesting agent suggests further digging.