PHP Developers Network

A community of PHP developers offering assistance, advice, discussion, and friendship.
 
Loading
It is currently Tue Aug 04, 2020 2:25 pm

All times are UTC - 5 hours




Post new topic Reply to topic  [ 15 posts ] 
Author Message
 Post subject: EXTRACTING INFORMATION
PostPosted: Sun May 07, 2006 11:21 am 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13
Hi there,

im currently building a program which scrapes/extracts odds from different online bookmakers and stores the information to a mysql database.

Does anyone know of a fast way of doing this?
Is anyone an expert on web scraping or web mining?

Kind regards

nash


Top
 Profile  
 
 Post subject:
PostPosted: Sun May 07, 2006 11:23 am 
Offline
Neighborhood Spidermoddy
User avatar

Joined: Mon Mar 29, 2004 4:24 pm
Posts: 31559
Location: Bothell, Washington, USA


Top
 Profile  
 
 Post subject:
PostPosted: Sun May 07, 2006 11:28 am 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13


Top
 Profile  
 
 Post subject:
PostPosted: Sun May 07, 2006 12:50 pm 
Offline
Tranquility In Moderation
User avatar

Joined: Sun Feb 06, 2005 8:18 pm
Posts: 5001
Location: Indiana


_________________
- A google chrome extension. When you search only results from the past year (or set time period) are displayed. Helps tremendously when using new technologies to avoid outdated results.


Top
 Profile  
 
 Post subject:
PostPosted: Sun May 07, 2006 2:04 pm 
Offline
Forum Regular
User avatar

Joined: Fri Mar 19, 2004 2:51 pm
Posts: 873


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 1:38 am 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 10:16 am 
Offline
Forum Regular
User avatar

Joined: Fri Mar 19, 2004 2:51 pm
Posts: 873


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 12:47 pm 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 12:49 pm 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 2:35 pm 
Offline
DevNet Master

Joined: Tue Jan 20, 2004 12:11 am
Posts: 4897
Location: Leuven, Belgium
Certainly with a uniprocessor system you're better of to do asynchronous io and select over the sockets... Will perform much better and keeps you away from the deadlock problems that are inevitably attached to multithreading..

anyway, i'f i'm not mistaken curl has (or should get) a feature to perform multiple requests at the same time (multi_client??). And these days php streams can do it too...


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 2:48 pm 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13
Hi Timvw...

Dont laugh but i have absolutly no idea what you just said!!

uniprocessor system ??

asynchronous io and select over the sockets?

curl has (or should get) a feature to perform multiple requests at the same time (multi_client??). ??

php streams??

Dont suppose you can explain these terms and if you have any tutorials for these?

Sorry to sound dumb but ive only been learning php for about a month!

Regards,

Nash


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 2:54 pm 
Offline
DevNet Master

Joined: Tue Jan 20, 2004 12:11 am
Posts: 4897
Location: Leuven, Belgium


Top
 Profile  
 
 Post subject:
PostPosted: Mon May 08, 2006 3:27 pm 
Offline
Forum Regular
User avatar

Joined: Fri Mar 19, 2004 2:51 pm
Posts: 873


Top
 Profile  
 
 Post subject:
PostPosted: Tue May 09, 2006 1:44 am 
Offline
Forum Newbie

Joined: Wed May 03, 2006 1:56 pm
Posts: 13


Top
 Profile  
 
 Post subject:
PostPosted: Tue May 09, 2006 1:51 am 
Offline
DevNet Master

Joined: Tue Jan 20, 2004 12:11 am
Posts: 4897
Location: Leuven, Belgium


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 15 posts ] 

All times are UTC - 5 hours


Who is online

Users browsing this forum: No registered users and 21 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group