I picked same JVM version and args and revision number, and tried beasting the seed and master seed. I cannot make this one fail. I don't see a leak in OrdsBlockTreeTermsReader at a glance.
The test itself is provoking random low level exceptions and assertHandlerRevision is masking some of them, which worries me a little that there is a race somewhere and its a real problem. I will improve the exception on leaked files to not just show the first one but give more debugging information in case it happens again. On Tue, Mar 31, 2015 at 1:06 PM, Apache Jenkins Server <jenk...@builds.apache.org> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/803/ > > 1 tests failed. > FAILED: > junit.framework.TestSuite.org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest > > Error Message: > file handle leaks: > [FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/replicator/test/J2/temp/lucene.replicator.IndexAndTaxonomyReplicationClientTest > 10CCB411FDA8B966-001/index-MMapDirectory-001/_1j_MockRandom_0.tio)] > > Stack Trace: > java.lang.RuntimeException: file handle leaks: > [FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/replicator/test/J2/temp/lucene.replicator.IndexAndTaxonomyReplicationClientTest > 10CCB411FDA8B966-001/index-MMapDirectory-001/_1j_MockRandom_0.tio)] > at __randomizedtesting.SeedInfo.seed([10CCB411FDA8B966]:0) > at org.apache.lucene.mockfile.LeakFS.onClose(LeakFS.java:64) > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:78) > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79) > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79) > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79) > at > org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:212) > at > com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.Exception > at org.apache.lucene.mockfile.LeakFS.onOpen(LeakFS.java:47) > at > org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84) > at > org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:191) > at > org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204) > at > org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:163) > at > org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204) > at > org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:163) > at > org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204) > at java.nio.channels.FileChannel.open(FileChannel.java:287) > at java.nio.channels.FileChannel.open(FileChannel.java:334) > at > org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:213) > at > org.apache.lucene.codecs.blocktreeords.OrdsBlockTreeTermsReader.<init>(OrdsBlockTreeTermsReader.java:71) > at > org.apache.lucene.codecs.mockrandom.MockRandomPostingsFormat.fieldsProducer(MockRandomPostingsFormat.java:383) > at > org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:258) > at > org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:336) > at > org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:104) > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:65) > at > org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:58) > at > org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:50) > at > org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:660) > at > org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:50) > at > org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:63) > at > org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest.assertHandlerRevision(IndexAndTaxonomyReplicationClientTest.java:158) > at > org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest.testConsistencyOnExceptions(IndexAndTaxonomyReplicationClientTest.java:477) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886) > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > ... 8 more > > > > > Build Log: > [...truncated 8356 lines...] > [junit4] Suite: > org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest > [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): > {$full_path$=PostingsFormat(name=Asserting), > $payloads$=BlockTreeOrds(blocksize=128), > $facets=PostingsFormat(name=MockRandom)}, > docValues:{$facets=DocValuesFormat(name=Lucene50)}, sim=DefaultSimilarity, > locale=hu_HU, timezone=America/Scoresbysund > [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation > 1.7.0_65 (64-bit)/cpus=16,threads=1,free=197578352,total=245366784 > [junit4] 2> NOTE: All tests run in this JVM: [SessionTokenTest, > IndexAndTaxonomyReplicationClientTest] > [junit4] 2> NOTE: download the large Jenkins line-docs file by running > 'ant get-jenkins-line-docs' in the lucene directory. > [junit4] 2> NOTE: reproduce with: ant test > -Dtestcase=IndexAndTaxonomyReplicationClientTest > -Dtests.seed=10CCB411FDA8B966 -Dtests.multiplier=2 -Dtests.nightly=true > -Dtests.slow=true > -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt > -Dtests.locale=hu_HU -Dtests.timezone=America/Scoresbysund > -Dtests.asserts=true -Dtests.file.encoding=UTF-8 > [junit4] ERROR 0.00s J2 | IndexAndTaxonomyReplicationClientTest (suite) > <<< > [junit4] > Throwable #1: java.lang.RuntimeException: file handle leaks: > [FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/replicator/test/J2/temp/lucene.replicator.IndexAndTaxonomyReplicationClientTest > 10CCB411FDA8B966-001/index-MMapDirectory-001/_1j_MockRandom_0.tio)] > [junit4] > at > __randomizedtesting.SeedInfo.seed([10CCB411FDA8B966]:0) > [junit4] > at > org.apache.lucene.mockfile.LeakFS.onClose(LeakFS.java:64) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:78) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79) > [junit4] > at java.lang.Thread.run(Thread.java:745) > [junit4] > Caused by: java.lang.Exception > [junit4] > at > org.apache.lucene.mockfile.LeakFS.onOpen(LeakFS.java:47) > [junit4] > at > org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84) > [junit4] > at > org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:191) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204) > [junit4] > at > org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:163) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204) > [junit4] > at > org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:163) > [junit4] > at > org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204) > [junit4] > at > java.nio.channels.FileChannel.open(FileChannel.java:287) > [junit4] > at > java.nio.channels.FileChannel.open(FileChannel.java:334) > [junit4] > at > org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:213) > [junit4] > at > org.apache.lucene.codecs.blocktreeords.OrdsBlockTreeTermsReader.<init>(OrdsBlockTreeTermsReader.java:71) > [junit4] > at > org.apache.lucene.codecs.mockrandom.MockRandomPostingsFormat.fieldsProducer(MockRandomPostingsFormat.java:383) > [junit4] > at > org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:258) > [junit4] > at > org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:336) > [junit4] > at > org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:104) > [junit4] > at > org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:65) > [junit4] > at > org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:58) > [junit4] > at > org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:50) > [junit4] > at > org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:660) > [junit4] > at > org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:50) > [junit4] > at > org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:63) > [junit4] > at > org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest.assertHandlerRevision(IndexAndTaxonomyReplicationClientTest.java:158) > [junit4] > at > org.apache.lucene.replicator.IndexAndTaxonomyReplicationClientTest.testConsistencyOnExceptions(IndexAndTaxonomyReplicationClientTest.java:477) > [junit4] > ... 8 more > [junit4] Completed on J2 in 42.96s, 5 tests, 1 error <<< FAILURES! > > [...truncated 12 lines...] > BUILD FAILED > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:536: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:477: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build.xml:456: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:2166: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/module-build.xml:58: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1370: > The following error occurred while executing this line: > /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:976: > There were test failures: 7 suites, 31 tests, 1 suite-level error > > Total time: 104 minutes 58 seconds > Build step 'Invoke Ant' marked build as failure > Archiving artifacts > Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716 > Archived 5 artifacts > Archive block size is 32768 > Received 0 blocks and 109219 bytes > Compression is 0.0% > Took 52 ms > Recording test results > Email was triggered for: Failure > Sending email for trigger: Failure > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
