Index for Google

Ye' old general discussion board. Basically, for everything that isn't covered elsewhere. Come here to shoot the breeze, shoot your mouth off, or whatever suits your fancy.
This forum is not for asking programming related questions.

Moderator: General Moderators

Post Reply
visionmaster
Forum Contributor
Posts: 139
Joined: Wed Jul 14, 2004 4:06 am

Index for Google

Post by visionmaster »

Hello together,

The wepage http://www.wlw.de (a b2b search machine) has a very large index in google. Using site:www.wlw.de lists the indexed wlw-pages by google. Apparently http://www.wlw.de has a folder /rubriken on the webserver. How did wlw get that much pages be indexed/spidered by google? Entering http://www.wlw.de/rubriken such shows 1 webpage, where is the rest?

How did they do that? I also have the problem with SEO-ing a webpage with a search mask as frontend, the database in the background holds a large list of product terms, which should be spidered by google. I assume wlw.de uses mod_rewriting. What do you think? How would you solve the problem of getting google to index a large tree of terms?


Thanks for your suggestions,
visionmaster
User avatar
feyd
Neighborhood Spidermoddy
Posts: 31559
Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA

Post by feyd »

correct me if I'm wrong, but this is feeling very Enterprise related...
Roja
Tutorials Group
Posts: 2692
Joined: Sun Jan 04, 2004 10:30 pm

Re: Index for Google

Post by Roja »

visionmaster wrote:How would you solve the problem of getting google to index a large tree of terms?
Give them a sitemap.

http://www.google.com/webmasters/sitema ... ation.html
Post Reply