mikemccand commented on pull request #1623:
URL: https://github.com/apache/lucene-solr/pull/1623#issuecomment-673725282


   > I kicked off beasting of all Lucene (core + modules) tests with this 
change ... no failures yet after 31 iterations.
   
   OK, it has run 1061 iterations now of all Lucene (core + modules) tests, and 
some interesting (~15) failures:
   
   ```
   ant test  -Dtestcase=TestIndexWriter -Dtests.method=testRandomOperations 
-Dtests.seed=432EB011B0898067 -Dtests.slow=true -Dtests.badapples=true 
-Dtests.locale=pt-ST -Dtests.timezone=US/Mountain -Dtests.asserts=true -Dtest\
   s.file.encoding=UTF-8
   
      [junit4]   2> ago 13, 2020 3:37:55 DA TARDE 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
      [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[Thread-0,5,TGRP-TestIndexWriter]
      [junit4]   2> java.lang.AssertionError: java.lang.IllegalStateException: 
this writer hit an unrecoverable error; cannot commit
      [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([432EB011B0898067]:0)
      [junit4]   2>        at 
org.apache.lucene.index.TestIndexWriter.lambda$testRandomOperations$48(TestIndexWriter.java:3886)
      [junit4]   2>        at java.base/java.lang.Thread.run(Thread.java:834)
      [junit4]   2> Caused by: java.lang.IllegalStateException: this writer hit 
an unrecoverable error; cannot commit
      [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4930)
      [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3365)
      [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3664)
      [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3622)
      [junit4]   2>        at 
org.apache.lucene.index.TestIndexWriter.lambda$testRandomOperations$48(TestIndexWriter.java:3879)
      [junit4]   2>        ... 1 more
      [junit4]   2>        Suppressed: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
      [junit4]   2>                at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
      [junit4]   2>                at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
      [junit4]   2>                at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:589)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3375)
      [junit4]   2>                ... 4 more
      [junit4]   2>        Caused by: 
org.apache.lucene.index.CorruptIndexException: Problem reading index from 
MockDirectoryWrapper(ByteBuffersDirectory@ebddcb6 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bd239b2) 
(resource=MockDir\
   ectoryWrapper(ByteBuffersDirectory@ebddcb6 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bd239b2))
      [junit4]   2>                at 
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:142)
      [junit4]   2>                at 
org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:83)
      [junit4]   2>                at 
org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:171)
      [junit4]   2>                at 
org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:213)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter.lambda$getReader$0(IndexWriter.java:568)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter.lambda$getReader$1(IndexWriter.java:614)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter$2.onMergeComplete(IndexWriter.java:3461)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter.commitMerge(IndexWriter.java:4078)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4697)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4257)
      [junit4]   2>                at 
org.apache.lucene.index.IndexWriter$IndexWriterMergeSource.merge(IndexWriter.java:5808)
      [junit4]   2>                at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:624)
      [junit4]   2>                at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:682)
      [junit4]   2>        Caused by: java.io.FileNotFoundException: _1m.fnm in 
dir=ByteBuffersDirectory@ebddcb6 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bd239b2
      [junit4]   2>                at 
org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:748)
      [junit4]   2>                at 
org.apache.lucene.store.Directory.openChecksumInput(Directory.java:157)
      [junit4]   2>                at 
org.apache.lucene.store.MockDirectoryWrapper.openChecksumInput(MockDirectoryWrapper.java:1044)
      [junit4]   2>                at 
org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat.read(Lucene60FieldInfosFormat.java:113)
      [junit4]   2>                at 
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:109)
      [junit4]   2>                ... 12 more
   ```
   
   This one does reproduce with this PR (but not on mainline).
   
   BTW, we need to fix mainline's `Reproduce with: ...` line to show `gradle` 
not `ant`?
   
   This one also repros, only with this PR, but is maybe a test issue?  Not 
sure:
   ```
      [junit4] Started J0 PID(1331595@localhost).
      [junit4] Suite: org.apache.lucene.index.TestIndexWriter
      [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestIndexWriter 
-Dtests.method=testSoftAndHardLiveDocs -Dtests.seed=8ECCF6879557EA9E 
-Dtests.slow=true -Dtests.badapples=true -Dtests.locale=th-TH 
-Dtests.timezone=America/Shiprock -Dtests\
   .asserts=true -Dtests.file.encoding=UTF-8
      [junit4] ERROR   0.30s | TestIndexWriter.testSoftAndHardLiveDocs <<<
      [junit4]    > Throwable #1: 
org.apache.lucene.store.AlreadyClosedException: this IndexReader is closed
      [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8ECCF6879557EA9E:5BCA4864AD808EEB]:0)
      [junit4]    >        at 
org.apache.lucene.index.IndexReader.ensureOpen(IndexReader.java:257)
      [junit4]    >        at 
org.apache.lucene.index.IndexReader.incRef(IndexReader.java:184)
      [junit4]    >        at 
org.apache.lucene.index.IndexWriter.lambda$getReader$2(IndexWriter.java:653)
      [junit4]    >        at 
org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:105)
      [junit4]    >        at 
org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:642)
      [junit4]    >        at 
org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
      [junit4]    >        at 
org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:79)
      [junit4]    >        at 
org.apache.lucene.index.TestIndexWriter.assertHardLiveDocs(TestIndexWriter.java:3638)
      [junit4]    >        at 
org.apache.lucene.index.TestIndexWriter.testSoftAndHardLiveDocs(TestIndexWriter.java:3624)
      [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      [junit4]    >        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      [junit4]    >        at 
java.base/java.lang.reflect.Method.invoke(Method.java:566)
      [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:834)
      [junit4]   2> NOTE: test params are: codec=Asserting(Lucene86): 
{id=PostingsFormat(name=LuceneFixedGap)}, 
docValues:{soft_delete=DocValuesFormat(name=Asserting)}, 
maxPointsInLeafNode=362, maxMBSortInHeap=5.242399601460019, 
sim=Asserting(RandomSi\
   milarity(queryNorm=true): {}), locale=th-TH, timezone=America/Shiprock
      [junit4]   2> NOTE: Linux 5.5.6-arch1-1 amd64/Oracle Corporation 11.0.6 
(64-bit)/cpus=128,threads=1,free=455736688,total=536870912
      [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriter]
      [junit4] Completed [1/1 (1!)] in 0.49s, 1 test, 1 error <<< FAILURES!
      [junit4]
      [junit4]
      [junit4] Tests with failures [seed: 8ECCF6879557EA9E]:
      [junit4]   - 
org.apache.lucene.index.TestIndexWriter.testSoftAndHardLiveDocs
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to