Re: lucene write.lock error

2005-11-12 Thread Andrzej Bialecki
Kashif Khadim wrote: Hi , I am getting this lucene write.lock error whenever two or more person perform search for same query. I am using nutch build of 09-Nov-2005. Indexes in deployed segments are never updated, so you can disable Lucene locks completely, without any adverse effects -

Re: threading versus nio

2005-11-12 Thread Johannes Zillmann
Hello Doug, --- Doug Cutting [EMAIL PROTECTED] schrieb: Mina's stream io handler requires a separate thread per connection: please correct me if i'm wrong, but if i understood all right there are 2 choices... (1) message based communication (2) stream based communication In case of (2) you

Re: threading versus nio

2005-11-12 Thread Stefan Groschupf
Hi Johannes, right, but in case you have 200 boxes and each box need to open 4 different connections to the master. Than the master has 200 * 4 connections = 800 threads = the limit of the 2.4 kernel. In case you open only one conenction per box you are also limited to run 800 boxes per

NDFS/Mapreduce questions

2005-11-12 Thread Joanna Harpell
A few questions about NDFS: - Can a single NDFS file have multiple concurrent writers? - Can the block size be changed in a running NDFS file system? - Are there any plans to localize Map tasks to block-resident nodes? - Is there any reason that big files (10TB?) wouldnt work? - Is there any