curl and javascript
Posted: Tue May 03, 2011 2:55 am
I am trying to figure out how to use curl to download all the content that would be loaded on to a web browser that has javascript enabled.
Background: Using Fiddler, I load msn.com for example. Javascript is enabled in my browser so I can get all of the content behind the tabs that way (it loads in the background). When I use my curl script this obviously doesn't work since there's no javascript functionality that allows me to load that additional content.
How do I go about loading the additional content or at least simulating the tab mouseovers (or clicks) necessary to load the content? There are no forms involved in what I need to do.
Any and all help on this matter is appreciated.
**Edit**
I should further clarify that what I am really after is to have all the content loaded in to a string so I do some regex parsing for particular strings of text. I'm not looking to simply display the contents as they come across.
Background: Using Fiddler, I load msn.com for example. Javascript is enabled in my browser so I can get all of the content behind the tabs that way (it loads in the background). When I use my curl script this obviously doesn't work since there's no javascript functionality that allows me to load that additional content.
How do I go about loading the additional content or at least simulating the tab mouseovers (or clicks) necessary to load the content? There are no forms involved in what I need to do.
Any and all help on this matter is appreciated.
**Edit**
I should further clarify that what I am really after is to have all the content loaded in to a string so I do some regex parsing for particular strings of text. I'm not looking to simply display the contents as they come across.