Great, It went down to less than 10 secs now :) What I don't really understand is that my autowarmCount were pretty low ( like 128 ) and still the autowarming of the caches were very slow.
Can you explain more why it can be that slow ? Cheers ! Jerome. On Tue, Mar 3, 2009 at 8:00 PM, Yonik Seeley <yo...@lucidimagination.com> wrote: > Looks like cache autowarming. > If you have statically defined warming queries in solrconfig.xml, you > could try setting autowarmCount=0 for all the caches. > > -Yonik > http://www.lucidimagination.com > > > On Tue, Mar 3, 2009 at 2:37 PM, Jérôme Etévé <jerome.et...@gmail.com> wrote: >> Dear solr fans, >> >> I have a solr index of roughly 8M docs and I have here a little >> problem when I commit some insertion into it. >> >> The insert itself is very fast, but my commit takes 163 seconds. >> >> Here's the solr trace the commit leaves: >> >> INFO: start commit(optimize=false,waitFlush=false,waitSearcher=true) >> 03-Mar-2009 20:20:35 org.apache.solr.search.SolrIndexSearcher <init> >> INFO: Opening searc...@7de212f9 main >> 03-Mar-2009 20:20:35 org.apache.solr.update.DirectUpdateHandler2 commit >> INFO: end_commit_flush >> 03-Mar-2009 20:20:35 org.apache.solr.search.SolrIndexSearcher warm >> INFO: autowarming searc...@7de212f9 main from searc...@732d8b11 main >> >> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=16,evictions=0,size=16,warmupTime=71641,cumulative_lookups=90,cumulative_hits=68,cumulative_hitratio=0.75,cumulative_inserts=22,cumulative_evictions=0} >> 03-Mar-2009 20:21:52 org.apache.solr.search.SolrIndexSearcher warm >> INFO: autowarming result for searc...@7de212f9 main >> >> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=16,evictions=0,size=16,warmupTime=76905,cumulative_lookups=90,cumulative_hits=68,cumulative_hitratio=0.75,cumulative_inserts=22,cumulative_evictions=0} >> 03-Mar-2009 20:21:52 org.apache.solr.search.SolrIndexSearcher warm >> INFO: autowarming searc...@7de212f9 main from searc...@732d8b11 main >> >> queryResultCache{lookups=24,hits=24,hitratio=1.00,inserts=32,evictions=0,size=32,warmupTime=82406,cumulative_lookups=6310,cumulative_hits=268,cumulative_hitratio=0.04,cumulative_inserts=6041,cumulative_evictions=5522} >> 03-Mar-2009 20:23:17 org.apache.solr.search.SolrIndexSearcher warm >> INFO: autowarming result for searc...@7de212f9 main >> >> queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=32,evictions=0,size=32,warmupTime=85591,cumulative_lookups=6310,cumulative_hits=268,cumulative_hitratio=0.04,cumulative_inserts=6041,cumulative_evictions=5522} >> 03-Mar-2009 20:23:17 org.apache.solr.search.SolrIndexSearcher warm >> INFO: autowarming searc...@7de212f9 main from searc...@732d8b11 main >> >> documentCache{lookups=720,hits=710,hitratio=0.98,inserts=40,evictions=0,size=40,warmupTime=0,cumulative_lookups=415308,cumulative_hits=283661,cumulative_hitratio=0.68,cumulative_inserts=131647,cumulative_evictions=131105} >> 03-Mar-2009 20:23:17 org.apache.solr.search.SolrIndexSearcher warm >> INFO: autowarming result for searc...@7de212f9 main >> >> documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=415308,cumulative_hits=283661,cumulative_hitratio=0.68,cumulative_inserts=131647,cumulative_evictions=131105} >> 03-Mar-2009 20:23:17 org.apache.solr.core.QuerySenderListener newSearcher >> INFO: QuerySenderListener sending requests to searc...@7de212f9 main >> >> // Then the few warm up queries defined in solrconfig.xml >> >> INFO: Closing searc...@732d8b11 main >> >> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=16,evictions=0,size=16,warmupTime=71641,cumulative_lookups=90,cumulative_hits=68,cumulative_hitratio=0.75,cumulative_inserts=22,cumulative_evictions=0} >> >> queryResultCache{lookups=24,hits=24,hitratio=1.00,inserts=32,evictions=0,size=32,warmupTime=82406,cumulative_lookups=6310,cumulative_hits=268,cumulative_hitratio=0.04,cumulative_inserts=6041,cumulative_evictions=5522} >> >> documentCache{lookups=720,hits=710,hitratio=0.98,inserts=40,evictions=0,size=40,warmupTime=0,cumulative_lookups=415308,cumulative_hits=283661,cumulative_hitratio=0.68,cumulative_inserts=131647,cumulative_evictions=131105} >> 03-Mar-2009 20:23:18 org.apache.solr.update.processor.LogUpdateProcessor >> finish >> INFO: {commit=} 0 163189 >> 03-Mar-2009 20:23:18 org.apache.solr.core.SolrCore execute >> INFO: [jobs] webapp=/cjsolr path=/update/ params={} status=0 QTime=163189 >> >> >> I'm sure I'm doing something wrong. Does this 163 seconds commit time >> have to do with the commit parameters : >> (optimize=false,waitFlush=false,waitSearcher=true) ?? >> >> Thanks for any help. >> >> Cheers !! >> >> Jerome. >> >> -- >> Jerome Eteve. >> >> Chat with me live at http://www.eteve.net >> >> jer...@eteve.net >> > -- Jerome Eteve. Chat with me live at http://www.eteve.net jer...@eteve.net
