It should work just fine but you should use Hadoop. Segment merging is quite
expensive!
Hi,
Is it safe to run concurrent instances of Nutch in different machines and
just merge the segments later on?
I believe Hadoop is recommended for this purpose, but I'm not ready to look
into it yet.
Thanks Markus!
I'll merge segments for now and try Hadoop when it gets more serious
Remi
On Sunday, January 22, 2012, Markus Jelsma markus.jel...@openindex.io
wrote:
It should work just fine but you should use Hadoop. Segment merging is
quite
expensive!
Hi,
Is it safe to run concurrent
2 matches
Mail list logo