Great, Thanks for the quick response, I am very interested in hearing how lucene handles itself in the 15-20 million doc range.
I will be doing some testing this week with lucene and will report my findings as well. I am also testing FAST and AltaVista and I will post some comparison details. I would be very happy to find that we did not need to buy a commercial engine because Lucene could do the job. Joel ----- Original Message ----- From: "Armbrust, Daniel C." <[EMAIL PROTECTED]> To: "'Lucene Users List'" <[EMAIL PROTECTED]> Sent: Monday, April 29, 2002 2:37 PM Subject: RE: Lucene's scalability > I currently have an index of ~ 12 million documents, which are each about > that size (but in xml form). > > When they are transformed for lucene to index, there are upwards of 50 > searchable fields. > > The index is about 10 GB right now. > > I have not yet had any problems with "pushing the limits" of lucene. > > In the next few weeks, I will be pushing my number of indexed documents up > into the 15-20 million range. I can let you know if any problems arise. > > Dan > > > > -----Original Message----- > From: Joel Bernstein [mailto:[EMAIL PROTECTED]] > Sent: Monday, April 29, 2002 1:32 PM > To: [EMAIL PROTECTED] > Subject: Lucene's scalability > > > Is there a known limit to the number of documents that Lucene can handle > efficiently? I'm looking to index around 15 million, 2K docs which contain > 7-10 searchable fields. Should I be attempting this with Lucene? > > Thanks, > > Joel > > > -- > To unsubscribe, e-mail: <mailto:[EMAIL PROTECTED]> > For additional commands, e-mail: <mailto:[EMAIL PROTECTED]> > -- To unsubscribe, e-mail: <mailto:[EMAIL PROTECTED]> For additional commands, e-mail: <mailto:[EMAIL PROTECTED]>
