Affi, CouchDB doesn't natively solve the web crawling issue. I'm currently experimenting with Scrapy (http://scrapy.org) for web crawling, but I haven't advanced enough to start pushing my crawling data into CouchDB. Maybe some users out there have experience with Scrapy and CouchDB?
-Chad On Wed, Oct 9, 2013 at 1:45 PM, Brad Rhoads <[email protected]> wrote: > Or better yet, casperjs. > On Oct 7, 2013 3:37 PM, "Mark Hahn" <[email protected]> wrote: > > > Use node, phantomjs, and the nano couchdb driver. > > > > > > On Mon, Oct 7, 2013 at 2:24 PM, affi <[email protected]> wrote: > > > > > hi , > > > i am a beginner at couchdb and am learning it for a uni project. i have > > > watched many tutorials on JSON and understand how to add documents. > but i > > > dont > > > understand how to crawl webpages and store them in the couchdb > database. > > > would definitely appreciate some help with this. thanks > > > > > > > > >
