Search found 5 matches
- Thu Oct 28, 2010 4:53 pm
- Forum: PHP - Code
- Topic: Screen scraper connectivity issue?
- Replies: 0
- Views: 387
Screen scraper connectivity issue?
Ok, I am my wits end with this one... I have a simple little web scraper that I'm using to gather some nba boxscores. Very simple stuff it would seem. I have xampp installed on my computer and am simply trying to run this script: <?php include_once('/simple_html_dom.php'); set_time_limit(0); ignore_...
- Wed Sep 01, 2010 2:06 pm
- Forum: PHP - Code
- Topic: PHP/Mysql screen scraper memory issue
- Replies: 4
- Views: 666
Re: PHP/Mysql screen scraper memory issue
Unsetting all of the variables at the end of my while loop did the trick... thanks for your help!
- Tue Aug 31, 2010 11:31 pm
- Forum: PHP - Code
- Topic: PHP/Mysql screen scraper memory issue
- Replies: 4
- Views: 666
Re: PHP/Mysql screen scraper memory issue
Sounds like the memory you have set in PHP (probably 128mb) is being exceeded from the amount of data you are trying to load. The only solution would be to use a terminal application or up the memory limit in the php.ini... Ok, but because I'm only able to scrape approximately 1/20th of the data wo...
- Tue Aug 31, 2010 9:41 pm
- Forum: PHP - Code
- Topic: PHP/Mysql screen scraper memory issue
- Replies: 4
- Views: 666
PHP/Mysql screen scraper memory issue
I have a screen scraper that I've written in php that takes info from a website and puts it into a mysql database. The problem I'm having is memory related... it's a very large site I'm attempting to scrape and after I'm probably 1/20th of the way done I get this error: Fatal error: Allowed memory s...
- Sat Jul 10, 2010 2:02 pm
- Forum: PHP - Code
- Topic: Get part of a child node?
- Replies: 1
- Views: 299
Get part of a child node?
So I'm scraping a table from a website and one of the rows looks like this: <td class="name">text1<em>text2</em></td>. I can't figure out how to get the "text1" into one variable and the "text2" into another. The "text2" is easy enough to extract but the "...