1) You should consider using the node `request` to scrape instead of cURL. 2) Any scraping is only going to return what you request. This is only going to be the initially provided static content. You are getting this from the server, not the client. There is no way to get anything from the client.
3) You will have to simulate the client and run the JS inside of your app. The easiest way to do this is to use a "headless" client. I suggest you use Zombie at http://zombie.labnotes.org On Sat, Oct 6, 2012 at 1:34 PM, Narek Musakhanyan <[email protected]>wrote: > Hey guys . I tried to scrape a data from a website using PHP cURL lib but > I failed since cURl allows you to scrape only static content . But the > content I want to scrape changes via javascript(AJAX) since cURL cant > hanfle that I couldnt handle scraping via cURL . So I heard the this type > of things can be done via node . Basically I need to make my node app > handle this js wait for some time until AJAX is done and the pass it to php > .So is it possible to do via node.js ? I dont know node and I have to start > from scratch so I am here you to point out the right node framework to use > to get the result I explained . > > -- > Job Board: http://jobs.nodejs.org/ > Posting guidelines: > https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines > You received this message because you are subscribed to the Google > Groups "nodejs" group. > To post to this group, send email to [email protected] > To unsubscribe from this group, send email to > [email protected] > For more options, visit this group at > http://groups.google.com/group/nodejs?hl=en?hl=en > -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups "nodejs" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en
