need a search engine to search the big three's page results

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
yeto
Forum Newbie
Posts: 1
Joined: Tue Sep 14, 2010 5:05 pm

need a search engine to search the big three's page results

Post by yeto »

Could someone get me pointed in the right direction?

I want to build a search engine that will search the "results pages" of the big three (Google, Bing, and Yahoo). What I would like to happen is that when keywords are entered into "this" new search engine -- it would search the big three and come up with the search engine results pages with maybe 10 links per search engine page -- then I would like for the "new" search engine to search the result pages source code with parameters that I specify and create a new "PR/all in one" list combining the big three results. The SERPs would be the database.

Would there be anything against Google's guidelines with this search engine and if there is how does Dogpile do something like this and get away with it?

Could someone point me to a sample script that does this?

Thanks,
Yeto
User avatar
requinix
Spammer :|
Posts: 6617
Joined: Wed Oct 15, 2008 2:35 am
Location: WA, USA

Re: need a search engine to search the big three's page resu

Post by requinix »

yeto wrote:Would there be anything against Google's guidelines with this search engine and if there is how does Dogpile do something like this and get away with it?
Google has an API to get their search results so that's what you would use. However the Terms of Use say that you cannot
incorporate Google Search Results as the primary content on your Property or any page on your Property;
and if you don't like that and are considering conventional page-scraping then there's also
use any robot, spider, site search/retrieval application, or other device to retrieve or index any portion of Google Search Results or to collect information about users for any unauthorized purpose;
So no, you can't really do it. Not the way I understand what you're describing.

Dogpile is surely not "getting away with it", but likely is (a) fulfilling other requirements, or even more likely (b) has an agreement with Google.
Post Reply