Re: ParallelMultiSearcher reimplementation

2006-11-13 Thread Chuck Williams
Doug Cutting wrote on 11/13/2006 10:50 AM: > Chuck Williams wrote: >> I followed this same logic in ParallelWriter and got burned. My first >> implementation (still the version submitted as a patch in jira) used >> dynamic threads to add the subdocuments to the parallel subindexes >> simultaneou

Re: Hibernate Lucene trademark issues

2006-11-13 Thread Emmanuel Bernard
Hi Lukas, I'd be happy to answer your question, but I don't think Lucene dev is the appropriate area for that kind of discussion. let's move this discussion here http://forum.hibernate.org/viewforum.php?f=9 (or in the Lucene User list if you want to). Emmanuel Lukas Vlcek wrote: Hi Emmanue

Re: ParallelMultiSearcher reimplementation

2006-11-13 Thread eks dev
maybe someone interested. I just remembered, we tested pure Hadop RPC a few (5+) months ago in simple setup, kind of balancing server getting and distributing requests to 3 "search units"... we went that far as java RMI proved to have ugly latency problems (or we did not get it right, don't kno

Re: ParallelMultiSearcher reimplementation

2006-11-13 Thread Doug Cutting
Chuck Williams wrote: I followed this same logic in ParallelWriter and got burned. My first implementation (still the version submitted as a patch in jira) used dynamic threads to add the subdocuments to the parallel subindexes simultaneously. This hit a problem with abnormal native heap OOM's

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-13 Thread Grant Ingersoll (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449450 ] Grant Ingersoll commented on LUCENE-675: I'm not a big fan of tacking a number on to the end of Java names, as it doesn't let you know much about what's in

[jira] Commented: (LUCENE-532) [PATCH] Indexing on Hadoop distributed file system

2006-11-13 Thread Michael McCandless (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-532?page=comments#action_12449446 ] Michael McCandless commented on LUCENE-532: --- Thank you for the patch & unit test! This is actually the same approach that I started with. But I ruled it

[jira] Updated: (LUCENE-532) [PATCH] Indexing on Hadoop distributed file system

2006-11-13 Thread Kevin Oliver (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-532?page=all ] Kevin Oliver updated LUCENE-532: Attachment: cfs-patch.txt Here are some diffs on how to remove seeks from CompoundFileWriter (this is against an older version of Lucene, 1.4.2 I think, but th

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-13 Thread Doron Cohen (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449419 ] Doron Cohen commented on LUCENE-675: Sounds good. In this case I will add my stuff under a new package: org.apache.lucene.benchmark2. (this package would have

RE: [jira] Commented: (LUCENE-532) [PATCH] Indexing on Hadoop distributed file system

2006-11-13 Thread Kevin Oliver
We considered patching this code when we ran into a data consistency issue bug with our file system. It wasn't too difficult to patch CompoundFileWriter to output lengths instead of offsets. Naturally, I can't seem to find my implementation of this, but as I recall it wasn't too difficult to do. I

[jira] Commented: (LUCENE-675) Lucene benchmark: objective performance test for Lucene

2006-11-13 Thread Grant Ingersoll (JIRA)
[ http://issues.apache.org/jira/browse/LUCENE-675?page=comments#action_12449409 ] Grant Ingersoll commented on LUCENE-675: OK, how about I commit my changes, then you can add a patch that shows your ideas? > Lucene benchmark: objective