Sounds like you're dealing with no more than 11 URLs and that's the behavior I would expect with so few URLs. Don't expect the cluster to be faster until you're in to the thousands of URLs or at least the hundreds.
On Nov 7, 2007 10:31 PM, Sebastien Rainville <[EMAIL PROTECTED]> wrote: > Hello, > > > > I'm new to nutch and I don't know if the results I'm getting are normal > or not. Just for test purpose, I did a small crawl with only one seed > url, a depth of 2 and topN of 5. Running in local mode, it takes about 1 > minute to complete but about 8 minutes when running on a cluster of only > one master and one slave (same pc). > > > > I know there's overhead involved in launching map reduce jobs in > distributed mode... but that much?!? > > > > Thx, > > Sebastien > > > >
