Website and Search Engines

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Website and Search Engines

Post by LeJackal »

Hello all,

I have a small problem i can't seem to figure out,
I built a PHP templating engine for my website http://www.dadclan.com
and now it has fallen off the face of search engines. now the only way to find it on a search engine is to type in the address for it.

I can't seem to figure out why this is i have seen plenty of template driven websites listed on search engines so i dont think its that, I have the page registered (we were once the very 1st site) and the page has all the meta tags and so forth. But dosn't show up.

Anyone have any ideas of what may have caused this?
Thanks
User avatar
feyd
Neighborhood Spidermoddy
Posts: 31559
Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA

Post by feyd »

are you sure the search engines even crawl the site? Did you add a robots file?
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Post by LeJackal »

I had meta tags set, I recently added a robots.txt, I do know that google was hitting my forum heavily as i have a IP trackign system in it that does a lookup and sees it as googlebot
User avatar
feyd
Neighborhood Spidermoddy
Posts: 31559
Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA

Post by feyd »

...and the robots file contains....?
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Post by LeJackal »

user-agent:*
Disallow:/inc/
Disallow:/img/

This was added yesterday, So maybe not enough time to take effect, But never used the robot text file before and it was crawling then stopped.
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Post by LeJackal »

Googlebot last crawled my forum 10:42pm 3-09-2005
User avatar
patrikG
DevNet Master
Posts: 4235
Joined: Thu Aug 15, 2002 5:53 am
Location: Sussex, UK

Post by patrikG »

set the meta-tag "revisit-after", e.g.

Code: Select all

<meta name=&quote;revisit-after&quote; content=&quote;1 day&quote;>
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Post by LeJackal »

Got that set in my meta tags =\
as well as <meta name="ROBOTS" Content="Index,Follow">
User avatar
anjanesh
DevNet Resident
Posts: 1679
Joined: Sat Dec 06, 2003 9:52 pm
Location: Mumbai, India

Post by anjanesh »

I submitted my URL to google and for months it did not show up in any search engine.
I came across dmoz.org and I submitted it there and its come up all the search engines (without even submitting to each one) including google directory which depends on dmoz and so do the rest of the search engines it seems.
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Post by LeJackal »

Not including my keywords or description my meta tags are set to

<meta name='ROBOTS' content='INDEX, FOLLOW' />
<meta name='resource-type' content='document' />
<meta name='author' content='[DAD] Clan'/>
<meta name='copyright' content='Copyright (c) 2005' />
<meta name='revist-after' content='1 day' />
<meta name='distribution' content='Global' />
<meta name='rating' content='General' />
LeJackal
Forum Newbie
Posts: 7
Joined: Fri Mar 18, 2005 7:30 am

Post by LeJackal »

Yah am submitted in dmoz, and can find it in there, but only if i do a full domain name search, instead of being able to find it by typing in say [DAD] Clan, i have to acctually type in http://www.dadclan.com and then it lists it =\
Post Reply