Hello all. Thanks in advance for fielding my question.
Is there any known way to gather the content of a webpage that is *NOT* available by viewing the page source?
For instance, when you look at the search results on any search engine, you do not see any of the end user content in the page source. Is there a way to store this code into a database?
Thank you again!!
"Seeing" the words on a page
Moderator: General Moderators
Re: "Seeing" the words on a page
You only have access to what the remote server sends back to you. Most of the time that'll be the same stuff you see in your browser.
If you want more than that you'll have to code the functionality yourself. Like scanning search result links and loading the respective page.
If you want more than that you'll have to code the functionality yourself. Like scanning search result links and loading the respective page.
-
maneetpuri
- Forum Commoner
- Posts: 60
- Joined: Tue Oct 07, 2008 6:32 am
Re: "Seeing" the words on a page
Hi,
Such a thing can be done using crawler scripts, but if the source does not show the content then the crawler script cannot parse it.
Cheers,
~Maneet
Such a thing can be done using crawler scripts, but if the source does not show the content then the crawler script cannot parse it.
Cheers,
~Maneet