Hi Erick,
Some of the partial updates are taking huge time. Average QTime for updates
in 15 minute interval is 14344.
2017-11-10 08:15:11.863 INFO (qtp225493257-43961) [ x:collection]
o.a.s.c.S.Request [collection] webapp=/solr path=/update
params={wt=javabin&version=2} status=0 QTime=10073904.
On Fri, Nov 10, 2017 at 12:27 PM, Sujay Bawaskar <sujaybawas...@gmail.com>
wrote:
> Any reason we get below log even if client does not issue commit or we can
> ignore this log?
>
> Log: 2017-11-10 05:13:33.730 INFO (qtp225493257-38746) [ x:collection]
> o.a.s.s.SolrIndexSearcher Opening [Searcher@7010b1c6[collection]
> realtime]
>
> On Fri, Nov 10, 2017 at 12:06 PM, Sujay Bawaskar <sujaybawas...@gmail.com>
> wrote:
>
>> We are not issuing client side commit for partial update. We have
>> openSearcher=false
>> in solrconfig.xml, in this case we have set softCommit interval as 15
>> minutes. Solr version is 6.4.1.
>>
>> Thanks,
>> Sujay
>>
>> On Fri, Nov 10, 2017 at 11:58 AM, Erick Erickson <erickerick...@gmail.com
>> > wrote:
>>
>>> bq: We are getting below log without invoking commit operation after
>>> every partial update call
>>>
>>> Not sure what you mean here. If you're issuing a commit from the
>>> client every time you update a doc (or even a batch) that's an
>>> anti-pattern and you're opening searchers all the time. Don't do that
>>> ;).
>>>
>>> I'd set my autoCommit time to something reasonable like 60 seconds (or
>>> even 15) with openSearcher=false in solrconfig.xml. Set your soft
>>> commit to however long you can stand, I try for at least 10 seconds,
>>> but 60 or even 300 if possible, it all depends on how long after you
>>> index a document it has to be available for search.
>>>
>>> The settings you have are dangerous. See:
>>>
>>> https://lucidworks.com/2013/08/23/understanding-transaction-
>>> logs-softcommit-and-commit-in-sorlcloud/
>>>
>>> Best,
>>> Erick
>>>
>>> On Thu, Nov 9, 2017 at 9:25 PM, Sujay Bawaskar <sujaybawas...@gmail.com>
>>> wrote:
>>> > Hi,
>>> >
>>> > We are getting below log without invoking commit operation after every
>>> > partial update call. We have configured soft commit and commit time as
>>> > below. With below configuration we are able to perform 800 partial
>>> updates
>>> > per minutes which I think is very slow. Our Index size is 10GB for this
>>> > particular core.
>>> > Is there any configuration we are missing here?
>>> >
>>> > Log:
>>> > 2017-11-10 05:13:33.730 INFO (qtp225493257-38746) [ x:collection]
>>> > o.a.s.s.SolrIndexSearcher Opening [Searcher@7010b1c6[collection]
>>> realtime]
>>> >
>>> > Commit configuration:
>>> > solr.autoCommit.maxTime:1800000
>>> > solr.autoSoftCommit.maxTime:900000
>>> >
>>> >
>>> >
>>> > --
>>> > Thanks,
>>> > Sujay P Bawaskar
>>> > M:+91-77091 53669
>>>
>>
>>
>>
>> --
>> Thanks,
>> Sujay P Bawaskar
>> M:+91-77091 53669
>>
>
>
>
> --
> Thanks,
> Sujay P Bawaskar
> M:+91-77091 53669
>
--
Thanks,
Sujay P Bawaskar
M:+91-77091 53669
