story of search engine

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
php12342005
Forum Commoner
Posts: 79
Joined: Mon Mar 21, 2005 3:35 am

story of search engine

Post by php12342005 »

the topic is a little bite away from php.

I update my web-page very often - around once a week.

Sometimes google displys text of my page which is contents of over one month ago, but sometimes it is something I updated yesterday.

In other words, I can say totally different my same page (by searching different keywords) at same time, i am wondering: does search engine keep my page somewhere? why does it keep 2 or more same pages? how often does google update search info?

thanks
User avatar
feyd
Neighborhood Spidermoddy
Posts: 31559
Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA

Post by feyd »

Google caches a huge portion of the web page output of the web it has access to. The search engine is constantly updating it's cache information, but that doesn't mean it'll crawl your site every day, or every week. I would imagine the rank helps prioritize the frequency of crawls along with date and expire headers. The robots.txt data also can tell it how often you'd like the site crawled, I believe.
php12342005
Forum Commoner
Posts: 79
Joined: Mon Mar 21, 2005 3:35 am

Post by php12342005 »

robots.txt? what is that?

8O

Last edited by php12342005 on Fri Mar 25, 2005 11:11 am, edited 1 time in total.
User avatar
feyd
Neighborhood Spidermoddy
Posts: 31559
Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA

Post by feyd »

php12342005
Forum Commoner
Posts: 79
Joined: Mon Mar 21, 2005 3:35 am

Post by php12342005 »

Hi feyd,
wonderful, i know something interesting from you.
i have created a blank robots.txt and added it to my site.
is it right to do that? is the file case sensitive? do u have the file on your web-site? Are you master here?

thx
User avatar
Burrito
Spockulator
Posts: 4715
Joined: Wed Feb 04, 2004 8:15 pm
Location: Eden, Utah

Post by Burrito »

php12342005 wrote: Are you master here?
master Feyd...bow to Feyd...be the Feyd...feel the Feyd, but bow to Feyd, your master!
User avatar
feyd
Neighborhood Spidermoddy
Posts: 31559
Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA

Post by feyd »

feel the Feyd
8O
php12342005
Forum Commoner
Posts: 79
Joined: Mon Mar 21, 2005 3:35 am

Post by php12342005 »

master here = web-master
method_man
Forum Contributor
Posts: 257
Joined: Sat Mar 19, 2005 1:38 am

lol

Post by method_man »

we are not worthy :lol:

matt
User avatar
phpScott
DevNet Resident
Posts: 1206
Joined: Wed Oct 09, 2002 6:51 pm
Location: Keele, U.K.

Post by phpScott »

I tremble every time i'm on to see if I can beat the master to a post, but alas it almost never happens that is why feyd is the master, plus I don't think feyd sleeps,or eats.

Read feyds posts and one day you to young grass-hopper will become a master.

Wait a minute I'm a master because it says so next to my avatar.

wow, mom, I'm a master. all bow to the power of phpSco.... no wait a minute I don't want to get band. Feyd is the master, but Jason is the forums highest being.
Post Reply