robots allowed to index only few files

Ye' old general discussion board. Basically, for everything that isn't covered elsewhere. Come here to shoot the breeze, shoot your mouth off, or whatever suits your fancy.
This forum is not for asking programming related questions.

Moderator: General Moderators

Post Reply
AccesInterzis
Forum Newbie
Posts: 4
Joined: Wed Nov 25, 2009 4:00 am

robots allowed to index only few files

Post by AccesInterzis »

I know that if I write in robots.txt file the following lines:

Code: Select all

 
User-agent: *
Disallow: /
 
all robots won`t be allowed to index the files of the site.
My question is: "How do I tell robots not to index the files of site EXCEPT the following three files:first.php, second.php, third.php?". Because, for instance, my site has 100 files and I want only three of them to be indexed by robots. It would be much easier for me to write in robots.txt file 3 lines for each file than to write 97 lines with "Disallow".
User avatar
Christopher
Site Administrator
Posts: 13596
Joined: Wed Aug 25, 2004 7:54 pm
Location: New York, NY, US

Re: robots allowed to index only few files

Post by Christopher »

(#10850)
Post Reply