Is this legal?
Moderator: General Moderators
Is this legal?
Is it legal to make a website where one part of it involves using curl+regex to scrape stock quotes from google finance?
- feyd
- Neighborhood Spidermoddy
- Posts: 31559
- Joined: Mon Mar 29, 2004 3:24 pm
- Location: Bothell, Washington, USA
Check their terms of service: http://www.google.com/terms_of_service.html
Since I'm not seeing an API on their code pages, I'll guess they may take issue in scraping.
I probably would say it's not illegal per se, but not very nice or cool.
Since I'm not seeing an API on their code pages, I'll guess they may take issue in scraping.
I probably would say it's not illegal per se, but not very nice or cool.
why boter with scraping/regex when you can http://xmethods.net/
- Maugrim_The_Reaper
- DevNet Master
- Posts: 2704
- Joined: Tue Nov 02, 2004 5:43 am
- Location: Ireland
Actually the stock market doesn't necessarily own the data - remember it's an open regulated market so the data *must* be published by the stock exchange. Chances are the restrictions concern access to their underlying systems. Just as Yahoo can license access to their system, but not ownership of the data being served.
In any case, scrapping is not cool. Yes, it would work. Yes, it's probably legal. But try to find a free data source before wasting Yahoo's bandwidth for your own gain.
In any case, scrapping is not cool. Yes, it would work. Yes, it's probably legal. But try to find a free data source before wasting Yahoo's bandwidth for your own gain.
- RobertGonzalez
- Site Administrator
- Posts: 14293
- Joined: Tue Sep 09, 2003 6:04 pm
- Location: Fremont, CA, USA
For those that do not speak AOL (Abbreviated Online Language), this means I Am Not A Lawyer. I know it is a lot to spell out, but hey, I can take one for the team...veridicus wrote:IANAL
As far as illegal... If it is data coming from a source that has a registration or fee charged for the service, you are violating their user agreement. Even if you are not violating a user agreement or breaking the law, it is still being rude to gank someone else's content without their permission. That truly is just wrong.
hmm, well im not expecting much trafic, but what if I made the php randomly choose which site to scrape from (msn, yahoo, google, cnbc, etc...) for every query therby distributing the "load"...
Already have a little mini-test:
http://rwphoto.thepeopleshost.com/gf.php?q=adbe
Already have a little mini-test:
http://rwphoto.thepeopleshost.com/gf.php?q=adbe
I'd say that's just digging you a deeper holewildwobby wrote:hmm, well im not expecting much trafic, but what if I made the php randomly choose which site to scrape from (msn, yahoo, google, cnbc, etc...) for every query therby distributing the "load"...
Already have a little mini-test:
http://rwphoto.thepeopleshost.com/gf.php?q=adbe
Set Search Time - A google chrome extension. When you search only results from the past year (or set time period) are displayed. Helps tremendously when using new technologies to avoid outdated results.