Re: Lucene 6.6: "Too many open files"

2017-08-04 Thread Varun Thacker
I just ran into this issue yesterday and a couple of times last week. The team I was working with was running Solr 5.4.1 so the auto-throttle merge policy applies. We were using the default merge policy. When infoStream was turned on for a dummy collection on the same box the output for the settin

Re: Lucene 6.6: "Too many open files"

2017-08-04 Thread Nawab Zada Asad Iqbal
varun: How do you set auto-IOThrottle? Is there a way to turn it off? I don't see a setting for it. Nawab On Fri, Aug 4, 2017 at 9:49 AM, Varun Thacker wrote: > I just ran into this issue yesterday and a couple of times last week. > > The team I was working with was running Solr 5.4.1 so the

Re: Lucene 6.6: "Too many open files"

2017-08-04 Thread Varun Thacker
HI Nawab, I don't see a way to turn it of directly from Solr. Can you please create a Jira for this? In your case do you see evidence why you need to turn it off? I'd suggest turning on Lucene level info stream logging by enabling then in the resources/log4j.properties file . Index the documents

Re: Lucene 6.6: "Too many open files"

2017-08-04 Thread Nawab Zada Asad Iqbal
Hi Varun, Thanks, I will try that and open the jira. Btw, is it possible (and reasonable?) to create large segments during bulk-indexing (without interleaved commits) and then merge them into fewer (e.g. 40) segments when committing at the end? So far my feeling (without logging enabled) is that m