Could someone get me pointed in the right direction?
I want to build a search engine that will search the "results pages" of the big three (Google, Bing, and Yahoo). What I would like to happen is that when keywords are entered into "this" new search engine -- it would search the big three and come up with the search engine results pages with maybe 10 links per search engine page -- then I would like for the "new" search engine to search the result pages source code with parameters that I specify and create a new "PR/all in one" list combining the big three results. The SERPs would be the database.
Would there be anything against Google's guidelines with this search engine and if there is how does Dogpile do something like this and get away with it?
Could someone point me to a sample script that does this?
Thanks,
Yeto
need a search engine to search the big three's page results
Moderator: General Moderators
Re: need a search engine to search the big three's page resu
Google has an API to get their search results so that's what you would use. However the Terms of Use say that you cannotyeto wrote:Would there be anything against Google's guidelines with this search engine and if there is how does Dogpile do something like this and get away with it?
and if you don't like that and are considering conventional page-scraping then there's alsoincorporate Google Search Results as the primary content on your Property or any page on your Property;
So no, you can't really do it. Not the way I understand what you're describing.use any robot, spider, site search/retrieval application, or other device to retrieve or index any portion of Google Search Results or to collect information about users for any unauthorized purpose;
Dogpile is surely not "getting away with it", but likely is (a) fulfilling other requirements, or even more likely (b) has an agreement with Google.