Thanks for looking into this, Robert. I admit I was a lazy ass and simply increased the limit on my build server once this started happening...
D. On Mon, Apr 16, 2012 at 5:54 AM, Robert Muir <[email protected]> wrote: > biggest problem causing these too many open files was fixed in > r1326473... still i see other linefiledocs leaks (just looking with > lsof). > > On Sun, Apr 15, 2012 at 11:34 PM, Apache Jenkins Server > <[email protected]> wrote: >> Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk/13174/ >> >> 5 tests failed. >> REGRESSION: >> org.apache.lucene.analysis.TestLookaheadTokenFilter.testRandomStrings >> >> Error Message: >> some thread(s) failed >> >> Stack Trace: >> java.lang.RuntimeException: some thread(s) failed >> at >> __randomizedtesting.SeedInfo.seed([11B7DBC0291A847B:993EDB7E8A1ED34E]:0) >> at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:449) >> at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:371) >> at >> org.apache.lucene.analysis.TestLookaheadTokenFilter.testRandomStrings(TestLookaheadTokenFilter.java:38) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1844) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1000(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:748) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:809) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:823) >> at >> org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:758) >> at >> org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:680) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:613) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.LuceneTestCase$SaveThreadAndTestNameRule$1.evaluate(LuceneTestCase.java:652) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:755) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:606) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:625) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:661) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:672) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:38) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:553) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:499) >> >> >> REGRESSION: >> org.apache.lucene.index.TestIndexWriterWithThreads.testIOExceptionDuringWriteSegment >> >> Error Message: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/core/test/S1/index7357373586tmp/_1.tvd >> (Too many open files in system) >> >> Stack Trace: >> java.io.FileNotFoundException: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/core/test/S1/index7357373586tmp/_1.tvd >> (Too many open files in system) >> at >> __randomizedtesting.SeedInfo.seed([11B7DBC0291A847B:A2C0EA58D8CF1347]:0) >> at java.io.RandomAccessFile.open(Native Method) >> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233) >> at >> org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.<init>(SimpleFSDirectory.java:98) >> at >> org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.<init>(SimpleFSDirectory.java:121) >> at >> org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.<init>(NIOFSDirectory.java:116) >> at >> org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:81) >> at >> org.apache.lucene.store.NRTCachingDirectory.openInput(NRTCachingDirectory.java:228) >> at >> org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:503) >> at >> org.apache.lucene.codecs.lucene40.Lucene40TermVectorsReader.<init>(Lucene40TermVectorsReader.java:112) >> at >> org.apache.lucene.codecs.lucene40.Lucene40TermVectorsFormat.vectorsReader(Lucene40TermVectorsFormat.java:35) >> at >> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:119) >> at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:55) >> at >> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62) >> at >> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:629) >> at >> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52) >> at >> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:64) >> at >> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:585) >> at >> org.apache.lucene.index.TestIndexWriterWithThreads._testSingleThreadFailure(TestIndexWriterWithThreads.java:324) >> at >> org.apache.lucene.index.TestIndexWriterWithThreads.testIOExceptionDuringWriteSegment(TestIndexWriterWithThreads.java:408) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1844) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1000(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:748) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:809) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:823) >> at >> org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:758) >> at >> org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:680) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:613) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.LuceneTestCase$SaveThreadAndTestNameRule$1.evaluate(LuceneTestCase.java:652) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:755) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:606) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:625) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:661) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:672) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:38) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:553) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:499) >> >> >> REGRESSION: >> org.apache.lucene.index.TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreadsOnlyOnce >> >> Error Message: >> hit unexpected Throwable >> >> Stack Trace: >> java.lang.AssertionError: hit unexpected Throwable >> at >> __randomizedtesting.SeedInfo.seed([11B7DBC0291A847B:46E1FC218CABC125]:0) >> at org.junit.Assert.fail(Assert.java:93) >> at org.junit.Assert.assertTrue(Assert.java:43) >> at >> org.apache.lucene.index.TestIndexWriterWithThreads._testMultipleThreadsFailure(TestIndexWriterWithThreads.java:267) >> at >> org.apache.lucene.index.TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreadsOnlyOnce(TestIndexWriterWithThreads.java:382) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1844) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1000(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:748) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:809) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:823) >> at >> org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:758) >> at >> org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:680) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:613) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.LuceneTestCase$SaveThreadAndTestNameRule$1.evaluate(LuceneTestCase.java:652) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:755) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:606) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:625) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:661) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:672) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:38) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:553) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:499) >> >> >> FAILED: >> junit.framework.TestSuite.org.apache.lucene.index.TestLazyProxSkipping >> >> Error Message: >> org.apache.lucene.index.TestLazyProxSkipping >> >> Stack Trace: >> java.lang.ClassNotFoundException: >> org.apache.lucene.index.TestLazyProxSkipping >> at java.net.URLClassLoader$1.run(URLClassLoader.java:214) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:205) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:321) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:266) >> at java.lang.Class.forName0(Native Method) >> at java.lang.Class.forName(Class.java:264) >> at >> com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:143) >> at >> com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:121) >> at >> com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:202) >> at >> com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12) >> Caused by: java.io.FileNotFoundException: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/core/classes/test/org/apache/lucene/index/TestLazyProxSkipping.class >> (Too many open files in system) >> at java.io.FileInputStream.open(Native Method) >> at java.io.FileInputStream.<init>(FileInputStream.java:137) >> at >> sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1005) >> at sun.misc.Resource.cachedInputStream(Resource.java:77) >> at sun.misc.Resource.getByteBuffer(Resource.java:160) >> at java.net.URLClassLoader.defineClass(URLClassLoader.java:266) >> at java.net.URLClassLoader.access$000(URLClassLoader.java:73) >> at java.net.URLClassLoader$1.run(URLClassLoader.java:212) >> ... 11 more >> >> >> FAILED: org.apache.lucene.search.TestShardSearching.testSimple >> >> Error Message: >> _a_4.doc >> >> Stack Trace: >> java.io.FileNotFoundException: _a_4.doc >> at >> __randomizedtesting.SeedInfo.seed([11B7DBC0291A847B:2904FF3E0EE950AA]:0) >> at >> org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:266) >> at >> org.apache.lucene.store.MockDirectoryWrapper.fileLength(MockDirectoryWrapper.java:728) >> at >> org.apache.lucene.store.MockDirectoryWrapper.crash(MockDirectoryWrapper.java:214) >> at >> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:566) >> at >> org.apache.lucene.search.ShardSearchingTestBase$NodeState.close(ShardSearchingTestBase.java:510) >> at >> org.apache.lucene.search.ShardSearchingTestBase.finish(ShardSearchingTestBase.java:597) >> at >> org.apache.lucene.search.TestShardSearching.testSimple(TestShardSearching.java:270) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1844) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1000(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:748) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:809) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:823) >> at >> org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:758) >> at >> org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:680) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:613) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.LuceneTestCase$SaveThreadAndTestNameRule$1.evaluate(LuceneTestCase.java:652) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:755) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:606) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:625) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:661) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:672) >> at >> org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:75) >> at >> org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:38) >> at >> org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:69) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:553) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:142) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:499) >> >> >> >> >> Build Log (for compile errors): >> [...truncated 5690 lines...] >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] > > > > -- > lucidimagination.com > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
