You can use “bin/nutch readdb crawl/crawldb -stats” to check the number of pages they crawled.
On Fri, Jul 16, 2010 at 2:07 PM, jeff <[email protected]> wrote: > Hi, > > I am testing nutch 1.1 with the exactly same configuration as that > tested on nutch 1.0. It has taken 1.0 to crawl the bestbuy site by a few > hours, while it only takes 2-3 minutes for 1.1. Does anyone have the > similar experience and know why? > > Thanks. > >
