The exception is being thrown by org.apache.lucene.mockfile.HandleLimitFS, so the OS level utlimit isn't relevant (as long as it's greter then 2048, hardcoded in TestRuleTemporaryFilesCleanup)
With the test creating 2 diff indexes, that means each index index gets an effective max open files limit of ~1024 files ... and with RandomSimilarity it might be leaving a lot of small segments on "disk" for both of those indexes -- which will have at least 100,000 docs in each because this is a nightly run.... I haven't tested this (my co is currently dirty and i'm in the middle of something) but i suspect the seed will reproduce anywhere. See also SOLR-10234 where i recently pointed out similar concerns about TestRuleTemporaryFilesCleanup's fixed limit of 2048 for the entire JVM, even when the JVM itself is trying to simulate multiple diff indexes (or completley distint nodes in the solr cloud test case). : Date: Wed, 8 Mar 2017 11:29:45 -0500 : From: Steve Rowe <sar...@gmail.com> : Reply-To: dev@lucene.apache.org : To: dev@lucene.apache.org : Subject: Re: [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 303 - Still : Unstable : : : > On Mar 8, 2017, at 8:38 AM, Apache Jenkins Server <jenk...@builds.apache.org> wrote: : > : > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/303/ : > : > 2 tests failed. : > FAILED: org.apache.lucene.index.TestIndexSorting.testRandom3 : > : > Error Message: : > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_4609011308FB57E6-001/tempDir-004/_e4_Lucene50_0.tim: Too many open files : > : > Stack Trace: : > java.nio.file.FileSystemException: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_4609011308FB57E6-001/tempDir-004/_e4_Lucene50_0.tim: Too many open files : : I logged in as the jenkins user on lucene1-us-west.apache.org (the ‘lucene' jenkins slave), and ‘ulimit -aHS’ says (in part): : : open files (-n) 1048576 : : I think this is the maximum value. : : Not sure what can be done here? : : -- : Steve : www.lucidworks.com : : : --------------------------------------------------------------------- : To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org : For additional commands, e-mail: dev-h...@lucene.apache.org : : -Hoss http://www.lucidworks.com/
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
