I agree. Is there anyway to disable something to speed it up? IE is the map reduce currently needed if we're not on a DFS?
Matt Vasja Ocvirk wrote: > Hello, > > I'm wondering if anyone can help. We injected 1000 seed URLs into > Nutch 0.7.2 (basic configuration + 1000 URLs in regexp filter) and it > processed them in just few hours. We just switched to 0.8 with same > configuration, same URLs, but it seems everything slowed down > significantly. Crawl script has 60 threads -- same as before but now > it works much slower. > > Thanks! > > Best, > Vasja > > __________ NOD32 1.1533 (20060512) Information __________ > > This message was checked by NOD32 antivirus system. > http://www.eset.com > > > > > ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
