maxDoc/numDocs int fields

2014-03-21 Thread Artem Gayardo-Matrosov
Hi all, I am using lucene to index a large corpus of text, with every word being a separate document (this is something I cannot change), and I am hitting a limitation of the CompositeReader only supporting Integer.MAX_VALUE documents. Is there any way to work around this limitation? For the

RE: maxDoc/numDocs int fields

2014-03-21 Thread Oliver Christ
Can you split your corpus across multiple Lucene instances? Cheers, Oli -Original Message- From: Artem Gayardo-Matrosov [mailto:ar...@gayardo.com] Sent: Friday, March 21, 2014 12:29 PM To: java-user@lucene.apache.org Subject: maxDoc/numDocs int fields Hi all, I am using lucene

Re: maxDoc/numDocs int fields

2014-03-21 Thread Artem Gayardo-Matrosov
, 2014 12:29 PM To: java-user@lucene.apache.org Subject: maxDoc/numDocs int fields Hi all, I am using lucene to index a large corpus of text, with every word being a separate document (this is something I cannot change), and I am hitting a limitation of the CompositeReader only supporting

Re: maxDoc/numDocs int fields

2014-03-21 Thread Tri Cao
corpus across multiple Lucene instances? Cheers, Oli -Original Message- From: Artem Gayardo-Matrosov [mailto:ar...@gayardo.com] Sent: Friday, March 21, 2014 12:29 PM To: java-user@lucene.apache.org Subject: maxDoc/numDocs int fields Hi all, I am

Re: maxDoc/numDocs int fields

2014-03-21 Thread Jack Krupansky
now, but otherwise, that's the limit for now. -- Jack Krupansky -Original Message- From: Artem Gayardo-Matrosov Sent: Friday, March 21, 2014 12:41 PM To: java-user@lucene.apache.org Subject: Re: maxDoc/numDocs int fields Hi Oli, Thanks for your reply, I thought about this, but it feels

Re: maxDoc/numDocs int fields

2014-03-21 Thread Artem Gayardo-Matrosov
@lucene.apache.org Subject: Re: maxDoc/numDocs int fields Hi Oli, Thanks for your reply, I thought about this, but it feels like making a crude, inefficient implementation of what's already in lucene -- CompositeReader, isn't it? It would involve writing my CompositeCompositeReader which would