We are running on one box in prod with 20 million docs in one index. -John On Fri, Mar 14, 2008 at 8:01 PM, Grant Ingersoll <[EMAIL PROTECTED]> wrote:
> How big is your machine and how big are your docs? (unique terms, > etc.) Even if it would fit, it sounds like you are going to have to > go distributed sooner or later, so you might as well start planning > for it. > > -Grant > > On Mar 14, 2008, at 8:51 AM, <[EMAIL PROTECTED]> <[EMAIL PROTECTED]> wrote: > > > Yes of course, the answers to your questions are important too. > > But no anwser at all until now :( > > > > For me I can say (not production yet): > > > > 2 ID-Fields and one content field per doc. Seach on content field > > only. > > Simple searches like "content:foo" or "content:foo*". > > 1,5 GB index per 1 million docs. > > About 50 million docs now. > > Max. 10 million docs per year increase. > > > > So I will have 75 GB index soon. > > > > Can searching this index be handled by a single machine? > > > > Thank you. > > > >> -----Original Message----- > >> From: Otis Gospodnetic [mailto:[EMAIL PROTECTED] > >> Sent: Dienstag, 11. März 2008 20:07 > >> To: java-user@lucene.apache.org > >> Subject: Re: Biggest index > >> > >> Questions like these are always hard to answer well. > >> Actually, no, they are easy, right Erik: "It depends" ;) > >> > >> Just kidding...partially. Anyhow, you should ask a few more > >> questions then: > >> > >> - what is the response latency? (average, median, Nth percentile...) > >> - are stored fields involved, if so how many and how big are they? > >> - what kind of queries are involves (some are costlier than others) > >> - what is the search rate? > >> ... > >> > >> > >> Otis > >> > >> -- > >> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > >> > >> ----- Original Message ---- > >> From: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> > >> To: java-user@lucene.apache.org > >> Sent: Monday, March 10, 2008 5:06:04 PM > >> Subject: Biggest index > >> > >> Hi, > >> > >> I have some question about the index size on a single machine: > >> > >> What is your biggest index you use in production? > >> Do you use MultiReader/Searcher? > >> What hardware do you need to serve it? > >> What kind of application is it? > >> > >> Thank you. > >> > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: [EMAIL PROTECTED] > >> For additional commands, e-mail: [EMAIL PROTECTED] > >> > >> > >> > >> > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: [EMAIL PROTECTED] > >> For additional commands, e-mail: [EMAIL PROTECTED] > >> > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [EMAIL PROTECTED] > > For additional commands, e-mail: [EMAIL PROTECTED] > > > > -------------------------- > Grant Ingersoll > http://www.lucenebootcamp.com > Next Training: April 7, 2008 at ApacheCon Europe in Amsterdam > > Lucene Helpful Hints: > http://wiki.apache.org/lucene-java/BasicsOfPerformance > http://wiki.apache.org/lucene-java/LuceneFAQ > > > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [EMAIL PROTECTED] > For additional commands, e-mail: [EMAIL PROTECTED] > >
