Hi dave.  When I was faced with this problem I spidered the site, 
concatenated all the pages into one, and thus reduced it to single-page 
scraping.

David Morris wrote:
> Is there a tutorial yet on how to scrape a site with multiple pages 
> yet? I
> would like to scrape a site like allrecipes.com or epicurious.com, and I
> can't figure out what to do to scrape multiple pages. Thanks for the 
> help,
>
> Dave
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> General mailing list
> [email protected]
> http://simile.mit.edu/mailman/listinfo/general
>   
_______________________________________________
General mailing list
[email protected]
http://simile.mit.edu/mailman/listinfo/general

Reply via email to