Re: Copying a part of index and index structure

2008-06-20 Thread Andrzej Bialecki
Anshum wrote: Hey Andrzej, Could you tell me as to what research suggests this and why is it this way? My calculation says the average load on each server would go down as I would know what server to query for an index term as opposed to querying all servers for terms. I'm looking for a solution

Re: Copying a part of index and index structure

2008-06-20 Thread Eric Bowman
Anshum wrote: Hey Andrzej, Could you tell me as to what research suggests this and why is it this way? My calculation says the average load on each server would go down as I would know what server to query for an index term as opposed to querying all servers for terms. I'm looking for a solution

Re: Copying a part of index and index structure

2008-06-20 Thread j . L
i think u can use solr to solve it. u just merge ur search result from 2 solr Instance(2 indexes). it is very simple and u can distribute it. On Wed, Jun 18, 2008 at 9:12 PM, Anshum <[EMAIL PROTECTED]> wrote: > I have 2 indexes and I would like to move index for a few 'selected' and > 'specifie

Re: Copying a part of index and index structure

2008-06-20 Thread Anshum
Hey Andrzej, Could you tell me as to what research suggests this and why is it this way? My calculation says the average load on each server would go down as I would know what server to query for an index term as opposed to querying all servers for terms. I'm looking for a solution wherein I could

Re: Copying a part of index and index structure

2008-06-20 Thread Anshum
Original Message > > From: Anshum <[EMAIL PROTECTED]> > > To: java-user@lucene.apache.org > > Sent: Friday, June 20, 2008 12:52:03 AM > > Subject: Re: Copying a part of index and index structure > > > > Hey Otis, > > > > I guess lucene AP

Re: Copying a part of index and index structure

2008-06-20 Thread Andrzej Bialecki
Otis Gospodnetic wrote: Hi, Not doable with Lucene as far as I know. I'm not even certain you would want to split by term. What would that do TF IDF in your distributed search? What's wrong with splitting t the doc level? There are about half a dozen distributed (Lucene) search solutions floa

Re: Copying a part of index and index structure

2008-06-19 Thread Otis Gospodnetic
d, why not reuse them? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Anshum <[EMAIL PROTECTED]> > To: java-user@lucene.apache.org > Sent: Friday, June 20, 2008 12:52:03 AM > Subject: Re: Copying a part of index and i

Re: Copying a part of index and index structure

2008-06-19 Thread Anshum
Hey Otis, I guess lucene API would only help me remove documents from an Index and not 'terms'. I need to remove terms from the index for all documents. any clue as to how to get it done? I'm currently analyzing the internal index structure. really need to get it done and if it works out I guess

Re: Copying a part of index and index structure

2008-06-19 Thread Otis Gospodnetic
Hi, I don't think there are tools for taking a single index and sharding it. So you'll have to create a new index and remove what you ened to remove from the old big index. I could be wrong :) Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > F