Re: How to read multiple indices in parallel.

2015-04-07 Thread Gimantha Bandara
That was really helpful. Thanks a lot Terry! On Tue, Apr 7, 2015 at 8:17 PM, Terry Smith wrote: > Gimantha, > > Search will run in parallel even across indices. > > This happens because IndexSearcher searches by LeafReader and it doesn't > matter where those LeafReaders come from (DirectoryReade

Re: How to read multiple indices in parallel.

2015-04-07 Thread Terry Smith
Gimantha, Search will run in parallel even across indices. This happens because IndexSearcher searches by LeafReader and it doesn't matter where those LeafReaders come from (DirectoryReader or MultiReader) they are all treated equally. Example: DirectoryReader(A): LeafReader(B), LeafReader(

Re: How to read multiple indices in parallel.

2015-04-07 Thread Gimantha Bandara
Hi Terry, I have multiple indices in separate locations. If I used multireader and used an executorservice with the indexSearcher It will go thru the segments in parallel and search right? But still searching between different indices will happen sequentially..Isnt it? On Tue, Apr 7, 2015 at 7:15

Re: How to read multiple indices in parallel.

2015-04-07 Thread Terry Smith
Gimantha, With Lucene 5.0 you can pass in an ExecutorService to the constructor of your IndexSearcher and it will search the segments in parallel if you use one of the IndexSearcher.search() methods that returns a TopDocs (and don't supply your own Collector). The not-yet-released Lucene 5.1 incl

How to read multiple indices in parallel.

2015-04-07 Thread Gimantha Bandara
Hi all, As I can see the Multireader is reading the multiple indices sequentially (correct me if I am wrong). So using a IndexSearcher on a multireader will also perform sequential searches right? Is there a lucene-built-in class to search several indices parallely? -- Gimantha Bandara Software