"Seeing" the words on a page

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
hello234
Forum Newbie
Posts: 3
Joined: Mon May 18, 2009 6:52 pm

"Seeing" the words on a page

Post by hello234 »

Hello all. Thanks in advance for fielding my question.

Is there any known way to gather the content of a webpage that is *NOT* available by viewing the page source?

For instance, when you look at the search results on any search engine, you do not see any of the end user content in the page source. Is there a way to store this code into a database?

Thank you again!!
User avatar
requinix
Spammer :|
Posts: 6617
Joined: Wed Oct 15, 2008 2:35 am
Location: WA, USA

Re: "Seeing" the words on a page

Post by requinix »

You only have access to what the remote server sends back to you. Most of the time that'll be the same stuff you see in your browser.

If you want more than that you'll have to code the functionality yourself. Like scanning search result links and loading the respective page.
maneetpuri
Forum Commoner
Posts: 60
Joined: Tue Oct 07, 2008 6:32 am

Re: "Seeing" the words on a page

Post by maneetpuri »

Hi,

Such a thing can be done using crawler scripts, but if the source does not show the content then the crawler script cannot parse it.

Cheers,
~Maneet
Post Reply