Page 1 of 1

Detecting search engines

Posted: Tue Oct 23, 2007 3:25 am
by andym01480
What is the best way of detecting whether a search bot is accessing a script?

I have a free mp3 download page which simply logs downloads - I'd rather not count search engines as I want to know how many people have downloaded an mp3!

Posted: Tue Oct 23, 2007 3:34 am
by aaronhall
A comprehensive list of known search bot user-agents: http://www.user-agents.org/

Posted: Tue Oct 23, 2007 3:58 am
by andym01480
Thanks!

It just occurred to me the simplest way was to disallow the download script in robots.txt!