First of all have a look at the mpi branch ofclucene. It achieves the distributed searches.
Nutch is a project which I know does this sort of thing u r looking at, so I look at the theories of that project may give u some good ideas. Good luck and please let us knowhow you go ben On Thursday, September 2, 2010, suman holani <suman.hol...@gmail.com> wrote: > Hello, > > > > I am using Clucene , and want to increase performance. > > does clucene something like parallel searching for distributed indexes. > > I want to reduce search time , which query takes for searching clucene > indexes. > > > 1. If I can I distribute my indexes such that each index , will have some > documents. > Now when I fire , query , multi searcher ll search the diff indexes in > parallel and give me result . > [I just read :MultiSearcher` searches indices sequentially. /is there nething > else which I can use for that] > > Its jst like concept of using hadoop map reduce > > > > 2. how to do distributed indexing > > > 3. If I can make subset of docs in indexes , which only will be > searched in case of query is set. > > like Lets say I have hash map of > P1 -1,2,3,4 > P2 - 3,4,5 > P3-7,5,3 > > Now I have an documents in lucene index stored as > 1-P1 > 2-P1 > 3-P1,P2,P3 > 4-P1,P2 > 5-P2,P3 > 7-P3 > .. > .. > when i search docs with P2 I get 3,4,5 > Now I want my search to b restricted to just 3,4,5 doc only. where by > I can search only these docs for further parameters. > > a. How to go abt it. > b. Is there any other searching mechanism I should use, or CLucene is > better fit? > c. should i keep my hash map also in lucene indexes and is then thr a > method to link it to another lucene indexes. > > > > Regards, > suman > ------------------------------------------------------------------------------ This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd _______________________________________________ CLucene-developers mailing list CLucene-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clucene-developers
