Re: Lucene Merge failing on Open Files
On Apr 14, 2011, at 3:24 PM, Simon Willnauer wrote: > On Wed, Apr 6, 2011 at 8:44 PM, Grant Ingersoll wrote: >> >> >> Begin forwarded message: >> >> From: Michael McCandless >> Date: April 5, 2011 5:46:13 AM EDT >> To: simon.willna...@gmail.com >> Cc: Simon Willnauer , >> java-u...@lucene.apache.org, paul_t...@fastmail.fm >> Subject: Re: Lucene Merge failing on Open Files >> Reply-To: java-u...@lucene.apache.org >> >> Yeah, that mergeFactor is way too high and will cause >> too-many-open-files (if the index has enough segments). >> >> This is one of the things that has always bothered me about Merge Factor. >> We state what the lower bound is, but we don't doc the upper bound. >> Should we even allow higher values? Of course, how does one pick the >> cutoff? I've seen up to about 100 be effective. But 3000 is a bit high >> (although, who knows what the future will hold) > > grant, we can at least add some documentation no? > Definitely! Docs good. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Lucene Merge failing on Open Files
On Wed, Apr 6, 2011 at 8:44 PM, Grant Ingersoll wrote: > > > Begin forwarded message: > > From: Michael McCandless > Date: April 5, 2011 5:46:13 AM EDT > To: simon.willna...@gmail.com > Cc: Simon Willnauer , > java-u...@lucene.apache.org, paul_t...@fastmail.fm > Subject: Re: Lucene Merge failing on Open Files > Reply-To: java-u...@lucene.apache.org > > Yeah, that mergeFactor is way too high and will cause > too-many-open-files (if the index has enough segments). > > This is one of the things that has always bothered me about Merge Factor. > We state what the lower bound is, but we don't doc the upper bound. > Should we even allow higher values? Of course, how does one pick the > cutoff? I've seen up to about 100 be effective. But 3000 is a bit high > (although, who knows what the future will hold) grant, we can at least add some documentation no? simon - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Fwd: Lucene Merge failing on Open Files
Begin forwarded message: > From: Michael McCandless > Date: April 5, 2011 5:46:13 AM EDT > To: simon.willna...@gmail.com > Cc: Simon Willnauer , > java-u...@lucene.apache.org, paul_t...@fastmail.fm > Subject: Re: Lucene Merge failing on Open Files > Reply-To: java-u...@lucene.apache.org > > Yeah, that mergeFactor is way too high and will cause > too-many-open-files (if the index has enough segments). This is one of the things that has always bothered me about Merge Factor. We state what the lower bound is, but we don't doc the upper bound. Should we even allow higher values? Of course, how does one pick the cutoff? I've seen up to about 100 be effective. But 3000 is a bit high (although, who knows what the future will hold)
