I did check. Nutch 1.0 crawled over 300 links while Nutch 1.1 only 2.
On Fri, 2010-07-16 at 14:21 +0800, xiao yang wrote:
> You can use “bin/nutch readdb crawl/crawldb -stats” to check the
> number of pages they crawled.
>
> On Fri, Jul 16, 2010 at 2:07 PM, jeff <[email protected]> wrote:
> > Hi,
> >
> > I am testing nutch 1.1 with the exactly same configuration as that
> > tested on nutch 1.0. It has taken 1.0 to crawl the bestbuy site by a few
> > hours, while it only takes 2-3 minutes for 1.1. Does anyone have the
> > similar experience and know why?
> >
> > Thanks.
> >
> >
