Hello, We had a running cluster with CDCR and there were some issues with indexing on Source cluster which got resolved after restarting the nodes (in my absence...) and now I see below errors on a shard at Target cluster. Any suggestions / ideas what could have caused this and whats the best way to recover.
Thnx Caused by: org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2069) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2189) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1926) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1826) at org.apache.solr.request.SolrQueryRequestBase.getSearcher(SolrQueryRequestBase.java:127) at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:310) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2477) at org.apache.solr.handler.PingRequestHandler.handlePing(PingRequestHandler.java:267) ... 34 more Caused by: org.apache.lucene.index.CorruptIndexException: Corrupted bitsPerDocBase: 6033 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/app/solr/data/COLL_shard8_replica1/data/index.20180903220548447/_9nsy.tvx"))) at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexReader.<init>(CompressingStoredFieldsIndexReader.java:89) at org.apache.lucene.codecs.compressing.CompressingTermVectorsReader.<init>(CompressingTermVectorsReader.java:126) at org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsReader(CompressingTermVectorsFormat.java:91) at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:128) at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:74) at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145) at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:197) at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:103) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:467) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:79) at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:39) at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2033) ... 43 more Suppressed: org.apache.lucene.index.CorruptIndexException: checksum failed (hardware problem?) : expected=e5bf0d15 actual=21722825 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/app/solr/data/COLL_shard8_replica1/data/index.20180903220548447/_9nsy.tvx"))) at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:419) at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:462) at org.apache.lucene.codecs.compressing.CompressingTermVectorsReader.<init>(CompressingTermVectorsReader.java:131) ... 54 more