Should this autowarm value be set based on the number of lookups? From the
info I provided that like 60k. filterCache{lookups=58522
Will 25k be enough?
Also, does that mean that we have to at least increase the size and initial
size as big as we set the autowarm?
Feak, Todd wrote:
>
> Sorry, my bad. Didn't read the entire thread.
>
> Look at your filter cache first. You are autowarming 1000, and there is
> exactly 1000 in there. Yet it looks like there may be tens of thousands
> of filter queries in your system. I would try autowarming more. Try
> 10,000 or 20,000 and see if it helps.
>
> Second look at your document cache. Document caches don't use autowarm.
> But you can add queries to your firstSeacher and newSearcher entries in
> your solrconfig to pre-populate the document cache during warming.
>
> -Todd Feak
>
>
> -----Original Message-----
> From: oleg_gnatovskiy [mailto:oleg_gnatovs...@citysearch.com]
> Sent: Friday, December 12, 2008 11:19 AM
> To: solr-user@lucene.apache.org
> Subject: RE: Query Performance while updating teh index
>
>
> The auto warm time is not an issue. We take the server off the load
> balancer
> while it is autowarming. It seems that the slowness occurs after
> autowarm is
> done.
>
>
>
> Feak, Todd wrote:
>>
>> It's spending 4-5 seconds warming up your query cache. If 4-5 seconds
> is
>> too much, you could reduce the number of queries to auto-warm with on
>> that cache.
>>
>> Notice that the 4-5 seconds is spent only putting about 420 queries
> into
>> the query cache. Your autowarm of 50000 for the query cache seems a
> bit
>> high. If you need to reduce that autowarm time below 5 seconds, you
> may
>> have to set that value in the hundreds, as opposed to tens of
> thousands.
>>
>> -Todd Feak
>>
>> -----Original Message-----
>> From: oleg_gnatovskiy [mailto:oleg_gnatovs...@citysearch.com]
>> Sent: Friday, December 12, 2008 10:08 AM
>> To: solr-user@lucene.apache.org
>> Subject: Re: Query Performance while updating teh index
>>
>>
>> Here's what we have on one of the data slaves for the autowarming.
>>
>>
>>
>> --
>>
>> Dec 12, 2008 8:46:02 AM org.apache.solr.search.SolrIndexSearcher warm
>>
>> INFO: autowarming searc...@3f32ca2b main from searc...@443ad545 main
>>
>>
>>
> filterCache{lookups=351993,hits=347055,hitratio=0.98,inserts=8332,evicti
>>
> ons=0,size=8245,warmupTime=215,cumulative_lookups=2837676,cumulative_hit
>>
> s=2766551,cumulative_hitratio=0.97,cumulative_inserts=72050,cumulative_e
>> victions=0}
>>
>> Dec 12, 2008 8:46:02 AM org.apache.solr.search.SolrIndexSearcher warm
>>
>> INFO: autowarming result for searc...@3f32ca2b main
>>
>>
>>
> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=1000,evictions=0,size
>>
> =1000,warmupTime=317,cumulative_lookups=2837676,cumulative_hits=2766551,
>>
> cumulative_hitratio=0.97,cumulative_inserts=72050,cumulative_evictions=0
>> }
>>
>> Dec 12, 2008 8:46:02 AM org.apache.solr.search.SolrIndexSearcher warm
>>
>> INFO: autowarming searc...@3f32ca2b main from searc...@443ad545 main
>>
>>
>>
> queryResultCache{lookups=5309,hits=5223,hitratio=0.98,inserts=422,evicti
>>
> ons=0,size=421,warmupTime=4628,cumulative_lookups=77802,cumulative_hits=
>>
> 77216,cumulative_hitratio=0.99,cumulative_inserts=424,cumulative_evictio
>> ns=0}
>>
>> --
>>
>> Dec 12, 2008 8:46:07 AM org.apache.solr.search.SolrIndexSearcher warm
>>
>> INFO: autowarming result for searc...@3f32ca2b main
>>
>>
>>
> queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=421,evictions=0,
>>
> size=421,warmupTime=5536,cumulative_lookups=77804,cumulative_hits=77218,
>>
> cumulative_hitratio=0.99,cumulative_inserts=424,cumulative_evictions=0}
>>
>> Dec 12, 2008 8:46:07 AM org.apache.solr.search.SolrIndexSearcher warm
>>
>> INFO: autowarming searc...@3f32ca2b main from searc...@443ad545 main
>>
>>
>>
> documentCache{lookups=87216,hits=86686,hitratio=0.99,inserts=570,evictio
>>
> ns=0,size=570,warmupTime=0,cumulative_lookups=1270773,cumulative_hits=12
>>
> 68318,cumulative_hitratio=0.99,cumulative_inserts=2455,cumulative_evicti
>> ons=0}
>>
>> Dec 12, 2008 8:46:07 AM org.apache.solr.search.SolrIndexSearcher warm
>>
>> INFO: autowarming result for searc...@3f32ca2b main
>>
>>
>>
> documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=
>>
> 0,warmupTime=0,cumulative_lookups=1270773,cumulative_hits=1268318,cumula
>> tive_hitratio=0.99,cumulative_inserts=2455,cumulative_evictions=0}
>>
>> --
>>
>>
>>
>> This is our current values after I've messed with them a few times
>> trying to
>> get better performance.
>>
>>
>>
>> <filterCache
>>
>> class="solr.LRUCache"
>>
>> size="30000"
>>
>> initialSize="15000"
>>
>> autowarmCount="1000"/>
>>
>> <queryResultCache
>>
>> class="solr.LRUCache"
>>
>> size="60000"
>>
>> initialSize="30000"
>>
>> autowarmCount="50000"/>
>>
>> <documentCache
>>
>> class="solr.LRUCache"
>>
>> size="200000"
>>
>> initialSize="125000"
>>
>> autowarmCount="0"/>
>>
>>
>> --
>> View this message in context:
>>
> http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452
>> 835p20980669.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>>
>>
>
> --
> View this message in context:
> http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452
> 835p20981862.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
>
>
--
View this message in context:
http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452835p20982647.html
Sent from the Solr - User mailing list archive at Nabble.com.
