Thanks Markus! I'll merge segments for now and try Hadoop when it gets more serious Remi
On Sunday, January 22, 2012, Markus Jelsma <markus.jel...@openindex.io> wrote: > It should work just fine but you should use Hadoop. Segment merging is quite > expensive! > >> Hi, >> Is it safe to run concurrent instances of Nutch in different machines and >> just merge the segments later on? >> >> I believe Hadoop is recommended for this purpose, but I'm not ready to look >> into it yet. >> >> Remi >