Re: Too many Soft commits and opening searchers realtime

2015-07-09 Thread Alessandro Benedetti
Cool ! So actually you were not using the default you defined in th Solrconfig, but it was loaded from a java environment property set to be 3 ms ? Cheers 2015-07-09 4:21 GMT+01:00 Summer Shire shiresum...@gmail.com: Yonik, Mikhail, Alessandro After a lot of digging around and isolation,

Re: Too many Soft commits and opening searchers realtime

2015-07-08 Thread Mikhail Khludnev
Summer, A log excerpt usually helps to troubleshoot any magic. Would you mind to provide one? On Wed, Jul 8, 2015 at 2:30 PM, Alessandro Benedetti benedetti.ale...@gmail.com wrote: So you are saying that no-one is triggering any commit, and that the auto soft commit solution is not actually

Re: Too many Soft commits and opening searchers realtime

2015-07-08 Thread Yonik Seeley
A realtime searcher is necessary for internal bookkeeping / uses if a normal searcher isn't opened on a commit. This searcher doesn't have caches and hence doesn't carry the weight that a normal searcher would. It's also invisible to clients (it doesn't change the view of the index for normal

Re: Too many Soft commits and opening searchers realtime

2015-07-08 Thread Alessandro Benedetti
So you are saying that no-one is triggering any commit, and that the auto soft commit solution is not actually waiting the proper time ? I suspect something is not like described, because if the Auto Soft commit was not working I would expect thousands of bugs raised. let's dig a little bit into

Re: Too many Soft commits and opening searchers realtime

2015-07-08 Thread Summer Shire
Yonik, Mikhail, Alessandro After a lot of digging around and isolation, All u guys were right. I was using property based value and there was one place where it was 30 secs and that was overriding my main props. Also Yonik thanks for the explanation on the real time searcher. I wasn't sure

Too many Soft commits and opening searchers realtime

2015-07-07 Thread Summer Shire
HI All, Can someone help me understand the following behavior. I have the following maxTimes on hard and soft commits yet I see a lot of Opening Searchers in the log org.apache.solr.search.SolrIndexSearcher- Opening Searcher@1656a258[main] realtime also I see a soft commit happening almost

Re: Too many Soft commits and opening searchers realtime

2015-07-07 Thread Mike Drob
Are the clients that are posting updates requesting commits? On Tue, Jul 7, 2015 at 4:29 PM, Summer Shire shiresum...@gmail.com wrote: HI All, Can someone help me understand the following behavior. I have the following maxTimes on hard and soft commits yet I see a lot of Opening Searchers

Re: Too many Soft commits and opening searchers realtime

2015-07-07 Thread Summer Shire
No the client lets solr handle it. On Jul 7, 2015, at 2:38 PM, Mike Drob mad...@cloudera.com wrote: Are the clients that are posting updates requesting commits? On Tue, Jul 7, 2015 at 4:29 PM, Summer Shire shiresum...@gmail.com wrote: HI All, Can someone help me understand the