I committed a fix. It was an IW concurrency issue, when threads are still indexing while another thread closes IW, and then a flush was able to sneak in after IW was closed. I don't think there's risk of index corruption, just this assert trip.
Mike McCandless http://blog.mikemccandless.com On Sat, Oct 11, 2014 at 5:45 AM, Michael McCandless <[email protected]> wrote: > Not good... I'm looking. > > Mike McCandless > > http://blog.mikemccandless.com > > > On Fri, Oct 10, 2014 at 2:06 PM, <[email protected]> wrote: >> Build: builds.flonkings.com/job/Lucene-5x-Linux-Java7-64-test-only/33037/ >> >> 1 tests failed. >> REGRESSION: >> org.apache.lucene.index.TestIndexWriterThreadsToSegments.testManyThreadsClose >> >> Error Message: >> Captured an uncaught exception in thread: Thread[id=392, name=Thread-258, >> state=RUNNABLE, group=TGRP-TestIndexWriterThreadsToSegments] >> >> Stack Trace: >> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=392, name=Thread-258, >> state=RUNNABLE, group=TGRP-TestIndexWriterThreadsToSegments] >> at >> __randomizedtesting.SeedInfo.seed([220A9CAF8517BBB8:10B35B4DF8AAF35E]:0) >> Caused by: java.lang.AssertionError: fileName=_z.cfe is in pending delete >> list but also has refCount=1 >> at __randomizedtesting.SeedInfo.seed([220A9CAF8517BBB8]:0) >> at >> org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:515) >> at >> org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:555) >> at >> org.apache.lucene.index.IndexWriter.checkpoint(IndexWriter.java:2236) >> at >> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2293) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >> at >> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:182) >> at org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4539) >> at >> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:717) >> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4581) >> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4573) >> at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1398) >> at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1132) >> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:143) >> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:104) >> at >> org.apache.lucene.index.TestIndexWriterThreadsToSegments$3.run(TestIndexWriterThreadsToSegments.java:256) >> >> >> >> >> Build Log: >> [...truncated 1353 lines...] >> [junit4] Suite: org.apache.lucene.index.TestIndexWriterThreadsToSegments >> [junit4] 2> oct 10, 2014 4:06:06 PM >> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler >> uncaughtException >> [junit4] 2> ADVERTENCIA: Uncaught exception in thread: >> Thread[Thread-258,5,TGRP-TestIndexWriterThreadsToSegments] >> [junit4] 2> java.lang.AssertionError: fileName=_z.cfe is in pending >> delete list but also has refCount=1 >> [junit4] 2> at >> __randomizedtesting.SeedInfo.seed([220A9CAF8517BBB8]:0) >> [junit4] 2> at >> org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:515) >> [junit4] 2> at >> org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:555) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.checkpoint(IndexWriter.java:2236) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2293) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:182) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4539) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:717) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4581) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4573) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1398) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1132) >> [junit4] 2> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:143) >> [junit4] 2> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:104) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterThreadsToSegments$3.run(TestIndexWriterThreadsToSegments.java:256) >> [junit4] 2> >> [junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=TestIndexWriterThreadsToSegments >> -Dtests.method=testManyThreadsClose -Dtests.seed=220A9CAF8517BBB8 >> -Dtests.slow=true -Dtests.locale=es_HN -Dtests.timezone=America/Godthab >> -Dtests.file.encoding=ISO-8859-1 >> [junit4] ERROR 0.42s J4 | >> TestIndexWriterThreadsToSegments.testManyThreadsClose <<< >> [junit4] > Throwable #1: >> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=392, name=Thread-258, >> state=RUNNABLE, group=TGRP-TestIndexWriterThreadsToSegments] >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([220A9CAF8517BBB8:10B35B4DF8AAF35E]:0) >> [junit4] > Caused by: java.lang.AssertionError: fileName=_z.cfe is in >> pending delete list but also has refCount=1 >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([220A9CAF8517BBB8]:0) >> [junit4] > at >> org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:515) >> [junit4] > at >> org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:555) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.checkpoint(IndexWriter.java:2236) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2293) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:182) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4539) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:717) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4581) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4573) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1398) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1132) >> [junit4] > at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:143) >> [junit4] > at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:104) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterThreadsToSegments$3.run(TestIndexWriterThreadsToSegments.java:256) >> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): >> {field=PostingsFormat(name=Memory doPackFST= false)}, docValues:{}, >> sim=DefaultSimilarity, locale=es_HN, timezone=America/Godthab >> [junit4] 2> NOTE: Linux 3.2.0-26-generic amd64/Oracle Corporation >> 1.7.0_65 (64-bit)/cpus=8,threads=1,free=41789424,total=230686720 >> [junit4] 2> NOTE: All tests run in this JVM: [TestTryDelete, >> TestIndexWriterOnJRECrash, TestAssertingPostingsFormat, TestNot, >> TestPhraseQuery, TestSegmentReader, TestFieldType, TestFilterIterator, >> TestTermVectorsFormat, Test2BNumericDocValues, TestDocValuesScoring, >> TestConstantScoreQuery, TestSimilarityProvider, Test2BPositions, >> TestSpanFirstQuery, TestBytesRefHash, TestSimilarityBase, >> TestSameScoresWithThreads, TestParallelLeafReader, TestQueryBuilder, >> TestAttributeSource, TestConcurrentMergeScheduler, TestOrdinalMap, TestSort, >> TestPrefixInBooleanQuery, TestShardSearching, TestMultiMMap, TestNorms, >> TestDirectoryReaderReopen, TestIndexWriterUnicode, TestSimpleExplanations, >> TestLockFactory, TestCollectionUtil, TestRegexpRandom2, >> TestDocValuesIndexing, TestIndexWriterOnDiskFull, TestMixedCodecs, >> TestDeterminism, TestOmitPositions, TestDisjunctionMaxQuery, >> TestTermRangeQuery, TestMultiTermConstantScore, TestTermRangeFilter, >> TestSpansAdvanced2, TestMultiValuedNumericRangeQuery, >> TestParallelReaderEmptyIndex, TestSumDocFreq, TestPrefixRandom, >> TestSearchForDuplicates, TestCompiledAutomaton, TestIndexWriterConfig, >> TestSetOnce, TestCachingCollector, TestIsCurrent, TestAssertions, >> TestCodecHoldsOpenFiles, TestPositiveScoresOnlyCollector, >> TestPackedTokenAttributeImpl, TestAllFilesHaveChecksumFooter, >> TestExceedMaxTermLength, TestFieldReuse, TestIndexReaderClose, >> TestIndexWriterMaxDocs, TestIndexWriterThreadsToSegments] >> [junit4] Completed on J4 in 21.34s, 4 tests, 1 error <<< FAILURES! >> >> [...truncated 102 lines...] >> BUILD FAILED >> /var/lib/jenkins/workspace/Lucene-5x-Linux-Java7-64-test-only/checkout/lucene/build.xml:49: >> The following error occurred while executing this line: >> /var/lib/jenkins/workspace/Lucene-5x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:1360: >> The following error occurred while executing this line: >> /var/lib/jenkins/workspace/Lucene-5x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:962: >> There were test failures: 404 suites, 3282 tests, 1 error, 61 ignored (51 >> assumptions) >> >> Total time: 6 minutes 45 seconds >> Build step 'Invoke Ant' marked build as failure >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
