this seems like a windows / files issue. We can not obtain the write lock quickly enough. Maybe we should do a retry loop in the test if we are on windows?
simon On Thu, Jun 28, 2012 at 6:25 PM, Steven A Rowe <[email protected]> wrote: > I see this roughly 50% of the time I run all Lucene core tests (Win7 64, Sun > JDK 1.6.0_21 64-bit), but the seeds don't reproduce the error when it's run > individually. > > The only unusual thing I'm doing on this machine is running some web crawls > in a VirtualBox Linux VM, hosted on and writing to a different physical drive > than the one I ran Lucene tests on. > > Here's the most recent failure: > > Suite: org.apache.lucene.index.TestIndexWriterWithThreads > OK 0.04s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringAbortOnlyOnce > OK 1.01s J0 | > TestIndexWriterWithThreads.testOpenTwoIndexWritersOnDifferentThreads > OK 0.97s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreads > ERROR 7.07s J0 | TestIndexWriterWithThreads.testRollbackAndCommitWithThreads > > Throwable #1: java.lang.AssertionError > > at > __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931:5BC9FB3E94E8E02C]:0) > > at org.junit.Assert.fail(Assert.java:92) > > at org.junit.Assert.assertTrue(Assert.java:43) > > at org.junit.Assert.assertTrue(Assert.java:54) > > at > org.apache.lucene.index.TestIndexWriterWithThreads.testRollbackAndCommitWithThreads(TestIndexWriterWithThreads.java:588) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1969) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:814) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:875) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:889) > > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:821) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > > at > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) > > at > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) > > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) > > Throwable #2: java.lang.RuntimeException: Thread threw an uncaught > exception, thread: Thread[Thread-34,5,] > > at > com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > > at > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) > > at > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) > > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) > > Caused by: java.lang.RuntimeException: > org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed > > at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931]:0) > > at > org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:576) > > Caused by: org.apache.lucene.store.AlreadyClosedException: this > IndexWriter is closed > > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:551) > > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:556) > > at org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:1773) > > at > org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:532) > > Throwable #3: java.lang.RuntimeException: Thread threw an uncaught > exception, thread: Thread[Thread-35,5,] > > at > com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > > at > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) > > at > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) > > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) > > Caused by: java.lang.RuntimeException: > org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed > > at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931]:0) > > at > org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:576) > > Caused by: org.apache.lucene.store.AlreadyClosedException: this > IndexWriter is closed > > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:551) > > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:556) > > at org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:1773) > > at > org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:532) > > Throwable #4: java.lang.RuntimeException: Thread threw an uncaught > exception, thread: Thread[Thread-36,5,] > > at > com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > > at > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) > > at > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) > > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) > > Caused by: java.lang.RuntimeException: > org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: > org.apache.lucene.store.MockLockFactoryWrapper$MockLock@32846ede > > at __randomizedtesting.SeedInfo.seed([299FEFE00B1E1931]:0) > > at > org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:576) > > Caused by: org.apache.lucene.store.LockObtainFailedException: Lock obtain > timed out: org.apache.lucene.store.MockLockFactoryWrapper$MockLock@32846ede > > at org.apache.lucene.store.Lock.obtain(Lock.java:84) > > at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:595) > > at > org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:536) > > > 2> NOTE: download the large Jenkins line-docs file by running 'ant > get-jenkins-line-docs' in the lucene directory. > 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexWriterWithThreads > -Dtests.method=testRollbackAndCommitWithThreads -Dtests.seed=299FEFE00B1E1931 > -Dtests.linedocsfile=e:/Lucene_data/enwiki.random.lines.txt > -Dtests.locale=en_IN -Dtests.timezone=PST8PDT -Dargs="-Dfile.encoding=UTF-8" > 2> > OK 1.05s J0 | TestIndexWriterWithThreads.testCloseWithThreads > OK 0.57s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreads > OK 0.74s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreadsOnlyOnce > OK 0.60s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreadsOnlyOnce > OK 0.38s J0 | TestIndexWriterWithThreads.testImmediateDiskFullWithThreads > OK 0.05s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringWriteSegment > OK 0.04s J0 | > TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentOnlyOnce > OK 0.02s J0 | TestIndexWriterWithThreads.testIOExceptionDuringAbort > > (@AfterClass output) > 2> NOTE: test params are: codec=Lucene40: {field=Pulsing40(freqCutoff=16 > minBlockSize=12 maxBlockSize=100), docid=Lucene40(minBlockSize=12 > maxBlockSize=100), body=Pulsing40(freqCutoff=16 minBlockSize=12 > maxBlockSize=100), title=PostingsFormat(name=MockRandom), > titleTokenized=PostingsFormat(name=Memory doPackFST= true), > date=Pulsing40(freqCutoff=16 minBlockSize=12 maxBlockSize=100)}, > sim=DefaultSimilarity, locale=en_IN, timezone=PST8PDT > 2> NOTE: Windows 7 6.1 amd64/Sun Microsystems Inc. 1.6.0_21 > (64-bit)/cpus=8,threads=1,free=223919176,total=261357568 > 2> NOTE: All tests run in this JVM: [TestCharTermAttributeImpl, > TestSearchForDuplicates, TestPositionIncrement, TestNRTThreads, > TestDeletionPolicy, TestWeakIdentityMap, TestAutomatonQueryUnicode, > TestOmitTf, TestBytesRefHash, NestedSetupChain, NestedTeardownChain, > TestIndexWriterWithThreads] > 2> > > Completed on J0 in 12.73s, 12 tests, 1 error <<< FAILURES! > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
