Re: concurrent Nutch instances in parallel

2012-01-22 Thread Markus Jelsma
It should work just fine but you should use Hadoop. Segment merging is quite expensive! Hi, Is it safe to run concurrent instances of Nutch in different machines and just merge the segments later on? I believe Hadoop is recommended for this purpose, but I'm not ready to look into it yet.

Re: concurrent Nutch instances in parallel

2012-01-22 Thread remi tassing
Thanks Markus! I'll merge segments for now and try Hadoop when it gets more serious Remi On Sunday, January 22, 2012, Markus Jelsma markus.jel...@openindex.io wrote: It should work just fine but you should use Hadoop. Segment merging is quite expensive! Hi, Is it safe to run concurrent