Search found 5 matches

by roasthawg
Thu Oct 28, 2010 4:53 pm
Forum: PHP - Code
Topic: Screen scraper connectivity issue?
Replies: 0
Views: 387

Screen scraper connectivity issue?

Ok, I am my wits end with this one... I have a simple little web scraper that I'm using to gather some nba boxscores. Very simple stuff it would seem. I have xampp installed on my computer and am simply trying to run this script: <?php include_once('/simple_html_dom.php'); set_time_limit(0); ignore_...
by roasthawg
Wed Sep 01, 2010 2:06 pm
Forum: PHP - Code
Topic: PHP/Mysql screen scraper memory issue
Replies: 4
Views: 666

Re: PHP/Mysql screen scraper memory issue

Unsetting all of the variables at the end of my while loop did the trick... thanks for your help!
by roasthawg
Tue Aug 31, 2010 11:31 pm
Forum: PHP - Code
Topic: PHP/Mysql screen scraper memory issue
Replies: 4
Views: 666

Re: PHP/Mysql screen scraper memory issue

Sounds like the memory you have set in PHP (probably 128mb) is being exceeded from the amount of data you are trying to load. The only solution would be to use a terminal application or up the memory limit in the php.ini... Ok, but because I'm only able to scrape approximately 1/20th of the data wo...
by roasthawg
Tue Aug 31, 2010 9:41 pm
Forum: PHP - Code
Topic: PHP/Mysql screen scraper memory issue
Replies: 4
Views: 666

PHP/Mysql screen scraper memory issue

I have a screen scraper that I've written in php that takes info from a website and puts it into a mysql database. The problem I'm having is memory related... it's a very large site I'm attempting to scrape and after I'm probably 1/20th of the way done I get this error: Fatal error: Allowed memory s...
by roasthawg
Sat Jul 10, 2010 2:02 pm
Forum: PHP - Code
Topic: Get part of a child node?
Replies: 1
Views: 299

Get part of a child node?

So I'm scraping a table from a website and one of the rows looks like this: <td class="name">text1<em>text2</em></td>. I can't figure out how to get the "text1" into one variable and the "text2" into another. The "text2" is easy enough to extract but the "...