Page 1 of 1

Website and Search Engines

Posted: Fri Mar 18, 2005 7:35 am
by LeJackal
Hello all,

I have a small problem i can't seem to figure out,
I built a PHP templating engine for my website http://www.dadclan.com
and now it has fallen off the face of search engines. now the only way to find it on a search engine is to type in the address for it.

I can't seem to figure out why this is i have seen plenty of template driven websites listed on search engines so i dont think its that, I have the page registered (we were once the very 1st site) and the page has all the meta tags and so forth. But dosn't show up.

Anyone have any ideas of what may have caused this?
Thanks

Posted: Fri Mar 18, 2005 8:33 am
by feyd
are you sure the search engines even crawl the site? Did you add a robots file?

Posted: Fri Mar 18, 2005 8:37 am
by LeJackal
I had meta tags set, I recently added a robots.txt, I do know that google was hitting my forum heavily as i have a IP trackign system in it that does a lookup and sees it as googlebot

Posted: Fri Mar 18, 2005 8:41 am
by feyd
...and the robots file contains....?

Posted: Fri Mar 18, 2005 8:50 am
by LeJackal
user-agent:*
Disallow:/inc/
Disallow:/img/

This was added yesterday, So maybe not enough time to take effect, But never used the robot text file before and it was crawling then stopped.

Posted: Fri Mar 18, 2005 8:56 am
by LeJackal
Googlebot last crawled my forum 10:42pm 3-09-2005

Posted: Fri Mar 18, 2005 9:53 am
by patrikG
set the meta-tag "revisit-after", e.g.

Code: Select all

<meta name=&quote;revisit-after&quote; content=&quote;1 day&quote;>

Posted: Fri Mar 18, 2005 10:31 am
by LeJackal
Got that set in my meta tags =\
as well as <meta name="ROBOTS" Content="Index,Follow">

Posted: Fri Mar 18, 2005 10:35 am
by anjanesh
I submitted my URL to google and for months it did not show up in any search engine.
I came across dmoz.org and I submitted it there and its come up all the search engines (without even submitting to each one) including google directory which depends on dmoz and so do the rest of the search engines it seems.

Posted: Fri Mar 18, 2005 10:36 am
by LeJackal
Not including my keywords or description my meta tags are set to

<meta name='ROBOTS' content='INDEX, FOLLOW' />
<meta name='resource-type' content='document' />
<meta name='author' content='[DAD] Clan'/>
<meta name='copyright' content='Copyright (c) 2005' />
<meta name='revist-after' content='1 day' />
<meta name='distribution' content='Global' />
<meta name='rating' content='General' />

Posted: Fri Mar 18, 2005 10:38 am
by LeJackal
Yah am submitted in dmoz, and can find it in there, but only if i do a full domain name search, instead of being able to find it by typing in say [DAD] Clan, i have to acctually type in http://www.dadclan.com and then it lists it =\