We're in a "I use couch db and I have q question group"... Which can q little ambiguous at tines On Oct 9, 2013 11:26 AM, "Mark Deibert" <[email protected]> wrote:
> Are we in a CouchDB group or a "web crawler" apps group? :-/ > > > On Wed, Oct 9, 2013 at 2:09 PM, Chad Cross <[email protected]> wrote: > > > Affi, > > > > CouchDB doesn't natively solve the web crawling issue. I'm currently > > experimenting with Scrapy (http://scrapy.org) for web crawling, but I > > haven't advanced enough to start pushing my crawling data into CouchDB. > > Maybe some users out there have experience with Scrapy and CouchDB? > > > > -Chad > > > > > > On Wed, Oct 9, 2013 at 1:45 PM, Brad Rhoads <[email protected]> wrote: > > > > > Or better yet, casperjs. > > > On Oct 7, 2013 3:37 PM, "Mark Hahn" <[email protected]> wrote: > > > > > > > Use node, phantomjs, and the nano couchdb driver. > > > > > > > > > > > > On Mon, Oct 7, 2013 at 2:24 PM, affi <[email protected]> > wrote: > > > > > > > > > hi , > > > > > i am a beginner at couchdb and am learning it for a uni project. i > > have > > > > > watched many tutorials on JSON and understand how to add documents. > > > but i > > > > > dont > > > > > understand how to crawl webpages and store them in the couchdb > > > database. > > > > > would definitely appreciate some help with this. thanks > > > > > > > > > > > > > > > > > > > >
