problem with atuomatic scraping when links with /.../ comes
Posted: Thu May 14, 2009 6:15 pm
HI
I am scraping top ten links from a search engine to grab their contents.
I got the error
" Warning: file_get_contents(http://www.nlm.nih.gov/.../druginfo/nat ... odine.html) [function.file-get-contents]: failed to open stream: HTTP request failed! HTTP/1.1 404 File not found in C:\wamp\www\websearch\searchdata.php on line 41"
when a url having this /.../ comes in.
( for example in this case http://www.nlm.nih.gov/.../druginfo/nat ... odine.html )
I am using file_get_contents() with preg_match_all() for getting titles. and wamp 2.0 with php 5.2.6
Any solution that would be helpful with these types of urls??
Thanks in advance
Mehnaz
I am scraping top ten links from a search engine to grab their contents.
I got the error
" Warning: file_get_contents(http://www.nlm.nih.gov/.../druginfo/nat ... odine.html) [function.file-get-contents]: failed to open stream: HTTP request failed! HTTP/1.1 404 File not found in C:\wamp\www\websearch\searchdata.php on line 41"
when a url having this /.../ comes in.
I am using file_get_contents() with preg_match_all() for getting titles. and wamp 2.0 with php 5.2.6
Any solution that would be helpful with these types of urls??
Thanks in advance
Mehnaz