Page 1 of 1

Search Technology

Posted: Tue Jun 28, 2005 12:23 am
by Gallahan
I'm interested in finding a search technology that can handle a fairly large number of pages [1,000,000+] with solid performance. The technology would need to have the capability to limit its searches to a list of pre-specified domains. Any suggestions would be welcome - it doesn't necessarily need to use PHP. It could be either a locally hosted application, 3rd party hosted application or something that interfaces with a major search engine.

Thanks in advance for your suggestions

Posted: Tue Jun 28, 2005 1:33 am
by Syranide
Ever heard of googles hardware?
I would say, serving more than a million pages in acceptable time would most likely require better hardware and software. (If you are using externally to you would most definitely need something like that)

Google has hardware that does this, can keep numerous million pages and serve a great deal of users. However, it costs, but that is something you most likely must live with if you are going to have it serve you.

Posted: Thu Jun 30, 2005 1:29 pm
by AngusL
http://www.google.com/enterprise/

30,000 USD for 500,000 pages.