On Wed, 2016-02-24 at 22:31 -0700, Michael Torrie wrote: > On 02/24/2016 09:58 PM, Charles Curley wrote: > > I have been using Perl's www:mechanize to scrape a series of web > > pages. > > > > Unfortunately the web page now includes some Javascript, which > > mechanize does not handle. Suggestions? > > > > All of my code is in shell script and perl, so I'd like to stick > > with > > those. > > > > Suggestions? > You could give https://metacpan.org/pod/Gtk2::WebKit::Mechanize a try, you'd have to run in xvfb if you need it headless, but it'll do what you need easily.
-- Thanks, John D Jones III UNIX Zealot; Perl Lover [email protected] [email protected] http://zoelife4u.org/ Where Earth and Spirit Unite /* PLUG: http://plug.org, #utah on irc.freenode.net Unsubscribe: http://plug.org/mailman/options/plug Don't fear the penguin. */
