[SOLVED] how to make a web page invisible to search engine

XML, Perl, Python, and other languages can be discussed here, even if it isn't PHP (We might forgive you).

Moderator: General Moderators

Post Reply
Kingo
Forum Contributor
Posts: 146
Joined: Thu Jun 03, 2004 9:38 am

how to make a web page invisible to search engine

Post by Kingo »

How do i make a web page invisible to a search engine.??
Any help is really appreciated.
Draco_03
Forum Regular
Posts: 577
Joined: Fri Aug 15, 2003 12:25 pm
Location: Montreal, Canada

Post by Draco_03 »

search in google about
-metatag
and
-referencing a site.
User avatar
JAM
DevNet Resident
Posts: 2101
Joined: Fri Aug 08, 2003 6:53 pm
Location: Sweden
Contact:

Post by JAM »

I think you should read up on the usage of the robots.txt file. Google for robots.txt and see where this leads you. Also apache contains rewrite rules to help ignore spiders as alot of those ignore the robots.txt file.

http://www.robotcop.org/config_ap.html
http://evolt.org/article/Using_Apache_t ... /18/15126/
http://www.inch.com/commercial/web/serv ... obots.html
User avatar
twigletmac
Her Royal Site Adminness
Posts: 5371
Joined: Tue Apr 23, 2002 2:21 am
Location: Essex, UK

Post by twigletmac »

Don't link to it anywhere.

Mac
AngusL
Forum Contributor
Posts: 155
Joined: Fri Aug 20, 2004 4:28 am
Location: Falkirk, Scotland

Post by AngusL »

<META NAME="robots" CONTENT="NOINDEX,NOFOLLOW">

If you don't want the page indexed, and don't want them to follow any of the links or

<META NAME="robots" CONTENT="NOINDEX,FOLLOW">

If you don't want the page indexed but do want the links followed.
Denzo
Forum Newbie
Posts: 21
Joined: Sat Jun 21, 2003 4:01 am

Post by Denzo »

Search for robots.txt and how to code it.
Post Reply