Exo Survival, You could use Splash (also written by the scrapinghub team) or selenium/phantomjs (headless browser capable of rendering javascript).
http://splash.readthedocs.org/en/latest/ is a good start. On Sunday, December 7, 2014 9:47:13 PM UTC-5, Enrico Jr Tuvera wrote: > > Is the javascript included with the page, say in a <script> tag? Can you > link the site here so we can take a look at it? > > On Saturday, December 6, 2014 2:46:02 AM UTC+8, Exo Survival wrote: >> >> I am scraping a website that renders email addresses using JavaScript and >> if it's disabled it will only show me "N/A". What's the best method for >> rendering JavaScript links so I can scrape them with Scrapy? Are there any >> easy to implement middlewares for this? >> > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
