screen scraping a site which uses AJAX
Posted: Fri May 01, 2009 10:28 am
Hi there, I'm new here so I'm not sure if this should be posted here.
I'm building a website which among other things, presents specific sports scores and statistics, taken from some other site.
I am forced to use screen scraping, which is fine for most sites, but one of them is giving me trouble.
The data in this site is presented in AJAX technology, which means the data of the page is changing, but the url is the same.
I need all the data. The html isn't populated with all the nesseary data, but I don't know how to access the entire data.
I did notice a javascript call that is activated in the code when the user is accessing manually the data.
how can I simulate the javascript call in php? is there any other way to access the data - which is available to all - by code?
I'm building a website which among other things, presents specific sports scores and statistics, taken from some other site.
I am forced to use screen scraping, which is fine for most sites, but one of them is giving me trouble.
The data in this site is presented in AJAX technology, which means the data of the page is changing, but the url is the same.
I need all the data. The html isn't populated with all the nesseary data, but I don't know how to access the entire data.
I did notice a javascript call that is activated in the code when the user is accessing manually the data.
how can I simulate the javascript call in php? is there any other way to access the data - which is available to all - by code?