Hey Otis, Could you suggest a few good distributed (lucene) search solutions? (Open Source) Yes, I do want to split by terms as the math tells a story. :) TF IDF would be handled separately. I'd just use a different cluster of machines to store the index instead of having the search run on the same machine that stores the index.
-- Anshum On Fri, Jun 20, 2008 at 11:26 AM, Otis Gospodnetic < [EMAIL PROTECTED]> wrote: > Hi, > > Not doable with Lucene as far as I know. I'm not even certain you would > want to split by term. What would that do TF IDF in your distributed > search? What's wrong with splitting t the doc level? There are about half > a dozen distributed (Lucene) search solutions floating around, why not reuse > them? > > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > ----- Original Message ---- > > From: Anshum <[EMAIL PROTECTED]> > > To: java-user@lucene.apache.org > > Sent: Friday, June 20, 2008 12:52:03 AM > > Subject: Re: Copying a part of index and index structure > > > > Hey Otis, > > > > I guess lucene API would only help me remove documents from an Index and > not > > 'terms'. I need to remove terms from the index for all documents. any > clue > > as to how to get it done? I'm currently analyzing the internal index > > structure. really need to get it done and if it works out I guess we'd > be > > closer to having a kinda distributed lucene index. > > > > -- > > Anshum > > > > On Fri, Jun 20, 2008 at 8:04 AM, Otis Gospodnetic < > > [EMAIL PROTECTED]> wrote: > > > > > Hi, > > > > > > I don't think there are tools for taking a single index and sharding > it. > > > So you'll have to create a new index and remove what you ened to > remove > > > from the old big index. I could be wrong :) > > > > > > > > > Otis > > > -- > > > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > > > > > > ----- Original Message ---- > > > > From: Anshum > > > > To: java-user@lucene.apache.org > > > > Sent: Wednesday, June 18, 2008 9:12:57 AM > > > > Subject: Copying a part of index and index structure > > > > > > > > I have 2 indexes and I would like to move index for a few 'selected' > and > > > > 'specified' terms from one of the indexes to the other. > > > > Would some one have an idea on how to do it? > > > > Actually, I am looking at splitting my index on keywords (terms) and > > > would > > > > like a single index be distributed over 2 smaller indexes after it > has > > > been > > > > created. > > > > How can I do it? > > > > > > > > -- > > > > -- > > > > The facts expressed here belong to everybody, the opinions to me. > > > > The distinction is yours to draw............ > > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: [EMAIL PROTECTED] > > > For additional commands, e-mail: [EMAIL PROTECTED] > > > > > > > > > > > > -- > > -- > > The facts expressed here belong to everybody, the opinions to me. > > The distinction is yours to draw............ > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [EMAIL PROTECTED] > For additional commands, e-mail: [EMAIL PROTECTED] > > -- -- The facts expressed here belong to everybody, the opinions to me. The distinction is yours to draw............
