Re: Corrupted Index

Thu, 07 Jan 2010 12:15:53 -0800 

what version of solr are you running?


On Jan 7, 2010, at 3:08 PM, Jake Brownell wrote:


Hi all,
Our application uses solrj to communicate with our solr servers. We started a fresh index yesterday after upping the maxFieldLength setting in solrconfig. Our task indexes content in batches and all appeared to be well until noonish today, when after 40k docs, I started seeing errors. I've placed three stack traces below, the first occurred once and was the initial error, the second occurred a few times before the third started occurring on each request. I'd really appreciate any insight into what could have caused this, a missing file and then a corrupt index. If you know we'll have to nuke the entire index and start over I'd like to know that too-oddly enough searches against the index appear to be working. 

Thanks!
Jake

#1

January 7, 2010 12:10:06 PM CST Caught error; TaskWrapper block 1
January 7, 2010 12:10:07 PM CST solr-home/core0/data/index/ _fsk_1uj.del (No such file or directory) 

solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
request: /core0/update solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) 

solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)

request: /core0/update
January 7, 2010 12:10:07 PM CST solr-home/core0/data/index/ _fsk_1uj.del (No such file or directory) 

solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
request: /core0/update solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) 

solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)

request: /core0/update
org.benetech.exception.WrappedException org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) org .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) 
           org.apache.solr.client.solrj.SolrServer#commit(86)
           org.apache.solr.client.solrj.SolrServer#commit(75)
           org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
           org.bookshare.search.solr.SolrSearchEngine#index(232)
org .bookshare .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) 
           org.bookshare.service.task.SearchEngineIndexingTask#run(53)
           org.bookshare.service.scheduler.TaskWrapper#run(233)
           java.util.TimerThread#mainLoop(512)
           java.util.TimerThread#run(462)
Caused by:
solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)

solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)

request: /core0/update
org.apache.solr.common.SolrException org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) org .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) 
           org.apache.solr.client.solrj.SolrServer#commit(86)
           org.apache.solr.client.solrj.SolrServer#commit(75)
           org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
           org.bookshare.search.solr.SolrSearchEngine#index(232)
org .bookshare .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) 
           org.bookshare.service.task.SearchEngineIndexingTask#run(53)
           org.bookshare.service.scheduler.TaskWrapper#run(233)
           java.util.TimerThread#mainLoop(512)
           java.util.TimerThread#run(462)

#2

January 7, 2010 12:10:10 PM CST Caught error; TaskWrapper block 1
January 7, 2010 12:10:10 PM CST org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
request: /core0/update org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2 

request: /core0/update
January 7, 2010 12:10:10 PM CST org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
request: /core0/update org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2 

request: /core0/update
org.benetech.exception.WrappedException org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) org .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) 
           org.apache.solr.client.solrj.SolrServer#commit(86)
           org.apache.solr.client.solrj.SolrServer#commit(75)
           org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
           org.bookshare.search.solr.SolrSearchEngine#index(232)
org .bookshare .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) 
           org.bookshare.service.task.SearchEngineIndexingTask#run(53)
           org.bookshare.service.scheduler.TaskWrapper#run(233)
           java.util.TimerThread#mainLoop(512)
           java.util.TimerThread#run(462)
Caused by:
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment _hug: fieldsReader shows 8 but segmentInfo shows 2 

request: /core0/update
org.apache.solr.common.SolrException org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) org .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) 
           org.apache.solr.client.solrj.SolrServer#commit(86)
           org.apache.solr.client.solrj.SolrServer#commit(75)
           org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
           org.bookshare.search.solr.SolrSearchEngine#index(232)
org .bookshare .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) 
           org.bookshare.service.task.SearchEngineIndexingTask#run(53)
           org.bookshare.service.scheduler.TaskWrapper#run(233)
           java.util.TimerThread#mainLoop(512)
           java.util.TimerThread#run(462)


#3


January 7, 2010 12:10:21 PM CST Caught error; TaskWrapper block 1
January 7, 2010 12:10:21 PM CST Array index out of range: 7

Array index out of range: 7

request: /core0/update Array index out of range: 7

Array index out of range: 7

request: /core0/update
January 7, 2010 12:10:21 PM CST Array index out of range: 7

Array index out of range: 7

request: /core0/update Array index out of range: 7

Array index out of range: 7

request: /core0/update
org.benetech.exception.WrappedException org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) org .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) 
           org.apache.solr.client.solrj.SolrServer#commit(86)
           org.apache.solr.client.solrj.SolrServer#commit(75)
           org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
           org.bookshare.search.solr.SolrSearchEngine#index(232)
org .bookshare .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) 
           org.bookshare.service.task.SearchEngineIndexingTask#run(53)
           org.bookshare.service.scheduler.TaskWrapper#run(233)
           java.util.TimerThread#mainLoop(512)
           java.util.TimerThread#run(462)
Caused by:
Array index out of range: 7

Array index out of range: 7

request: /core0/update
org.apache.solr.common.SolrException org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) org .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) 
           org.apache.solr.client.solrj.SolrServer#commit(86)
           org.apache.solr.client.solrj.SolrServer#commit(75)
           org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
           org.bookshare.search.solr.SolrSearchEngine#index(232)
org .bookshare .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) 
           org.bookshare.service.task.SearchEngineIndexingTask#run(53)
           org.bookshare.service.scheduler.TaskWrapper#run(233)
           java.util.TimerThread#mainLoop(512)
           java.util.TimerThread#run(462)

Reply via email to