>From your logs, it looks like the time is spent in closing of the index. There may be some pending deletes buffered, but they shouldn't take too long. There could also be a merge triggered... but this would only happen sometimes, not every time you commit.
One more relatively recent change in Lucene is to sync the index files for safety. Are you perhaps running on Linux with the ext3 filesystem? Not sure what's causing the null pointer exception... do you have a stack trace? -Yonik http://www.lucidimagination.com On Fri, Mar 13, 2009 at 9:05 PM, mahendra mahendra <mahendra_featu...@yahoo.com> wrote: > Hello, > > I am experiencing strange problems while doing commit. I am doing indexing > for every 10 min to update index with data base values. commit is taking 7 to > 10 min approximately and my indexing is failing due to null pointer > exception. If first thread is not completed in 10 min the second thread will > be starting to index data. > I changed wait=false for the listener from solrconfig.xml file. It stopped > getting Null pointer exception but the commit is taking 7 to 10 min. I have > approximately 70 to 90 kb of data every time. > <listener event="postCommit" class="solr.RunExecutableListener"> > <str name="exe">solr/bin/snapshooter</str> > <str name="dir">.</str> > <bool name="wait">false</bool> > <arr name="args"> <str>arg1</str> <str>arg2</str> </arr> > <arr name="env"> <str>MYVAR=val1</str> </arr> > </listener> > I kept all default parameter values in solrconfig.xml except the > ramBuffersize to 512. > Could you please tell me how can I overcome these problems, also some times I > see "INFO: Failed to unregister mbean: partitioned because it was not > registered > Mar 13, 2009 11:49:16 AM org.apache.solr.core.JmxMonitoredMap unregister" in > my log files. > > Log file > > ar 13, 2009 1:28:40 PM org.apache.solr.core.SolrCore execute > INFO: [EnglishAuction1-0] webapp=/solr path=/update > params={wt=javabin&waitFlush=true&commit=true&waitSearcher=true&version=2.2} > status=0 QTime=247232 > Mar 13, 2009 1:30:32 PM org.apache.solr.update.processor.LogUpdateProcessor > finish > INFO: {add=[79827482, 79845504, 79850902, 79850913, 79850697, 79850833, > 79850901, 79798207, ...(93 more)]} 0 62578 > Mar 13, 2009 1:30:32 PM org.apache.solr.core.SolrCore execute > INFO: [EnglishAuction1-0] webapp=/solr path=/update > params={wt=javabin&version=2.2} status=0 QTime=62578 > Mar 13, 2009 1:30:32 PM org.apache.solr.update.DirectUpdateHandler2 commit > INFO: start commit(optimize=false,waitFlush=true,waitSearcher=true) > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher <init> > INFO: Opening searc...@1ba5edf main > Mar 13, 2009 1:34:38 PM org.apache.solr.update.DirectUpdateHandler2 commit > INFO: end_commit_flush > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher warm > INFO: autowarming searc...@1ba5edf main from searc...@81f25 main > filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher warm > INFO: autowarming result for searc...@1ba5edf main > filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher warm > INFO: autowarming searc...@1ba5edf main from searc...@81f25 main > queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=3,evictions=0,size=3,warmupTime=63,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher warm > INFO: autowarming result for searc...@1ba5edf main > queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=3,evictions=0,size=3,warmupTime=94,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher warm > INFO: autowarming searc...@1ba5edf main from searc...@81f25 main > documentCache{lookups=0,hits=0,hitratio=0.00,inserts=20,evictions=0,size=20,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher warm > INFO: autowarming result for searc...@1ba5edf main > documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > Mar 13, 2009 1:34:38 PM org.apache.solr.core.QuerySenderListener newSearcher > INFO: QuerySenderListener sending requests to searc...@1ba5edf main > Mar 13, 2009 1:34:38 PM org.apache.solr.core.SolrCore execute > INFO: [EnglishAuction1-0] webapp=null path=null > params={rows=10&start=0&q=solr} hits=0 status=0 QTime=0 > Mar 13, 2009 1:34:38 PM org.apache.solr.core.QuerySenderListener newSearcher > INFO: QuerySenderListener done. > Mar 13, 2009 1:34:38 PM org.apache.solr.core.SolrCore execute > INFO: [EnglishAuction1-0] webapp=null path=null > params={rows=10&start=0&q=rocks} hits=223 status=0 QTime=0 > Mar 13, 2009 1:34:38 PM org.apache.solr.core.QuerySenderListener newSearcher > INFO: QuerySenderListener done. > Mar 13, 2009 1:34:38 PM org.apache.solr.core.SolrCore execute > INFO: [EnglishAuction1-0] webapp=null path=null > params={q=static+newSearcher+warming+query+from+solrconfig.xml} hits=4297 > status=0 QTime=0 > Mar 13, 2009 1:34:38 PM org.apache.solr.core.QuerySenderListener newSearcher > INFO: QuerySenderListener done. > Mar 13, 2009 1:34:38 PM org.apache.solr.core.SolrCore registerSearcher > INFO: [EnglishAuction1-0] Registered new searcher searc...@1ba5edf main > Mar 13, 2009 1:34:38 PM org.apache.solr.search.SolrIndexSearcher close > > Any help would appreciate!! > > Thanks, > Mahendra > > > >
