Re: How many documents in the biggest Lucene index to date?

2007-01-30 Thread karl wettin
30 jan 2007 kl. 04.18 skrev Daniel Noll: karl wettin wrote: Then it hit me that perheps the integer limitation should be in the store (Directory) and not the IndexReader? If not now, perhaps in the future when everybody is running on 64bit JVMs. I don't think it will be a very expensive

Re: How many documents in the biggest Lucene index to date?

2007-01-30 Thread Daniel Noll
karl wettin wrote: I think the big undertaking would be to refactor all of Lucene to use longs as document numbers. But not in the store. There it would still be integers, and the MultiReader can keep track of Integer.MAX_VALUE stores. Integer.MAX_VALUE*Integer.MAX_VALUE = Long.MAX_VALUE. So

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread Grant Ingersoll
] To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 8:03:11 AM Subject: Re: How many documents in the biggest Lucene index to date? I just indexed a collection w/ 15+ million docs in one index. Index size is roughly 42 gb. On Jan 26, 2007, at 12:45 AM, Bill Taylor wrote: I have used

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread Daniel Noll
karl wettin wrote: The maximum number of documents in an index is Integer.MAX_VALUE (2 147 483 647), but it it possible to combine multiple indices. It's true that you can combine multiple indexes, but don't make assumptions that this lets you break the limitation. MultiReader still extends

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread karl wettin
29 jan 2007 kl. 23.21 skrev Daniel Noll: karl wettin wrote: The maximum number of documents in an index is Integer.MAX_VALUE (2 147 483 647), but it it possible to combine multiple indices. It's true that you can combine multiple indexes, but don't make assumptions that this lets you

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread Daniel Noll
karl wettin wrote: Then it hit me that perheps the integer limitation should be in the store (Directory) and not the IndexReader? If not now, perhaps in the future when everybody is running on 64bit JVMs. I don't think it will be a very expensive thing to implement. But did anyone need that

Re: How many documents in the biggest Lucene index to date?

2007-01-28 Thread Erik Hatcher
[EMAIL PROTECTED] To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 12:45:43 AM Subject: How many documents in the biggest Lucene index to date? I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread karl wettin
26 jan 2007 kl. 06.45 skrev Bill Taylor: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million documents and could easily grow to two million. The maximum number of

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Andrzej Bialecki
Bill Taylor wrote: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million documents and could easily grow to two million. Has anyone used Lucene with an index that large?

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread mark harwood
, 26 January, 2007 8:32:01 AM Subject: Re: How many documents in the biggest Lucene index to date? Bill Taylor wrote: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Grant Ingersoll
I just indexed a collection w/ 15+ million docs in one index. Index size is roughly 42 gb. On Jan 26, 2007, at 12:45 AM, Bill Taylor wrote: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Chiradeep Vittal
From: Grant Ingersoll [EMAIL PROTECTED] To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 8:03:11 AM Subject: Re: How many documents in the biggest Lucene index to date? I just indexed a collection w/ 15+ million docs in one index. Index size is roughly 42 gb. On Jan 26, 2007

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Otis Gospodnetic
@lucene.apache.org Sent: Friday, January 26, 2007 12:45:43 AM Subject: How many documents in the biggest Lucene index to date? I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million

How many documents in the biggest Lucene index to date?

2007-01-25 Thread Bill Taylor
I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million documents and could easily grow to two million. Has anyone used Lucene with an index that large? Thank you very