There was a logging change that miller made on master ~Nov29 (and backported to 7x a few days later) that i just dialed down from INFO to DEBUG ... was causing an INFO log message once a second from every solr core, which can add up in long running tests.
might explain the recent up tick... de65b45fca00445d5dde8f25ee5bc67f791a84f7 a61c9f2c22362692b47e4d38dd32953f3a7156d1 : Date: Sun, 9 Dec 2018 11:12:27 -0500 : From: Steve Rowe <[email protected]> : Reply-To: [email protected] : To: Lucene Dev <[email protected]> : Subject: Re: [JENKINS] Lucene-Solr-NightlyTests-7.x - Build # 399 - Still : Failing : : Yet again with the huge dump files taking up all available disk space. : : I cleaned up the offending workspace, this time on lucene2-us-west.apache.org (previous occurrences were on lucene1-us-west.apache.org). : : Short term, I'm planning on adding a build step to Nightly jobs that deletes .spill and .events files from solr/build/solr-core/test/, so that at least following jobs won't be affected. : : But this is a new and apparently regular occurrence, caused so far by 2 or 3 nightly tests. I'll make a JIRA to address the problem. : : : Details: : : sarowe@lucene2-us-west:~$ df / : Filesystem 1K-blocks Used Available Use% Mounted on : tmpfs 1643108 181216 1461892 12% /run : /dev/xvda1 206285636 197802932 0 100% / : : : jenkins@lucene2-us-west:~/jenkins-slave/workspace$ du -s * : 1271808 Lucene-Artifacts-7.6 : 1264020 Lucene-Artifacts-master : 15750800 Lucene-Solr-BadApples-NightlyTests-7.x : 1621736 Lucene-Solr-BadApples-Tests-7.x : 1617648 Lucene-Solr-BadApples-Tests-master : 2734584 Lucene-Solr-Clover-master : 2361508 Lucene-Solr-Maven-7.6 : 15021028 Lucene-Solr-NightlyTests-7.x : 112371484 Lucene-Solr-NightlyTests-master : 667676 Lucene-Solr-repro : 2533624 Lucene-Solr-SmokeRelease-7.x : 1525000 Lucene-Solr-Tests-7.6 : 1609060 Lucene-Solr-Tests-7.x : 1398080 Lucene-Solr-Tests-http2 : 1536444 Lucene-Solr-Tests-master : 651328 PreCommit-LUCENE-Build : 562424 PreCommit-SOLR-Build : 2181100 Solr-Artifacts-7.x : : : jenkins@lucene2-us-west:~/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp$ ls -l : total 104673716 : -rw------- 1 jenkins jenkins 2460 Dec 8 00:37 junit4-J0-20181207_213237_5281644469254378944054.dynamic-suites : -rw------- 1 jenkins jenkins 0 Dec 7 21:32 junit4-J0-20181207_213237_5281963525838928405811.sysout : -rw------- 1 jenkins jenkins 16690023845 Dec 8 14:16 junit4-J0-20181207_213237_5283940733299267111752.spill : -rw------- 1 jenkins jenkins 18444929688 Dec 8 14:16 junit4-J0-20181207_213237_5284750168668511801086.events : -rw------- 1 jenkins jenkins 6870 Dec 7 21:32 junit4-J0-20181207_213237_5284802883128804182261.suites : -rw------- 1 jenkins jenkins 0 Dec 7 21:32 junit4-J0-20181207_213237_5285641300610839792270.syserr : -rw------- 1 jenkins jenkins 464481230 Dec 8 01:20 junit4-J1-20181207_213237_5284937026404127032021.events : -rw------- 1 jenkins jenkins 25459 Dec 8 01:20 junit4-J1-20181207_213237_5288789412646473446742.suites : -rw------- 1 jenkins jenkins 0 Dec 7 21:32 junit4-J2-20181207_213237_5282096853245782476953.dynamic-suites : -rw------- 1 jenkins jenkins 6800 Dec 7 21:32 junit4-J2-20181207_213237_528463483300429978386.suites : -rw------- 1 jenkins jenkins 0 Dec 7 21:32 junit4-J2-20181207_213237_5285486845202840697499.syserr : -rw------- 1 jenkins jenkins 33950726895 Dec 8 14:16 junit4-J2-20181207_213237_5285797394699351079580.spill : -rw------- 1 jenkins jenkins 37635559909 Dec 8 14:16 junit4-J2-20181207_213237_5288482247068446662812.events : -rw------- 1 jenkins jenkins 0 Dec 7 21:32 junit4-J2-20181207_213237_5288762604139909343123.sysout : : : From https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1716/consoleText : : : [junit4] HEARTBEAT J2 PID([email protected]): 2018-12-08T14:15:16, stalled for 57571s at: MoveReplicaHDFSTest (suite) : [junit4] HEARTBEAT J0 PID([email protected]): 2018-12-08T14:15:16, stalled for 49037s at: HdfsCollectionsAPIDistributedZkTest (suite) : Build timed out (after 1,440 minutes). Marking the build as aborted. : Build was aborted : : : > On Dec 8, 2018, at 8:40 PM, Apache Jenkins Server <[email protected]> wrote: : > : > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/399/ : > : > All tests passed : > : > Build Log: : > [...truncated 851 lines...] : > [junit4] JVM J0: stderr was not empty, see: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J0-20181209_010444_7151919688626920913546.syserr : > [junit4] >>> JVM J0 emitted unexpected output (verbatim) ---- : > [junit4] WARN: Unhandled exception in event serialization. -> java.security.PrivilegedActionException: java.io.IOException: No space left on device : > [junit4] at java.security.AccessController.doPrivileged(Native Method) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:124) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:98) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.RunListenerEmitter.testFailure(RunListenerEmitter.java:54) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.NoExceptionRunListenerDecorator.testFailure(NoExceptionRunListenerDecorator.java:55) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.BeforeAfterRunListenerDecorator.testFailure(BeforeAfterRunListenerDecorator.java:60) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$4.notifyListener(OrderedRunNotifier.java:129) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$SafeNotifier.run(OrderedRunNotifier.java:63) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier.fireTestFailure(OrderedRunNotifier.java:131) : > [junit4] at com.carrotsearch.randomizedtesting.ThreadLeakControl$SubNotifier.fireTestFailure(ThreadLeakControl.java:184) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner.fireTestFailure(RandomizedRunner.java:862) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:950) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891) : > [junit4] at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) : > [junit4] at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverr : > [junit4] idesOnMethodsRule.java:40) : > [junit4] at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) : > [junit4] at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) : > [junit4] at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) : > [junit4] at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) : > [junit4] at java.lang.Thread.run(Thread.java:748) : > [junit4] Caused by: java.io.IOException: No space left on device : > [junit4] at java.io.FileOutputStream.writeBytes(Native Method) : > [junit4] at java.io.FileOutputStream.write(FileOutputStream.java:326) : > [junit4] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.EventsOutputStream.write(EventsOutputStream.java:28) : > [junit4] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) : > [junit4] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) : > [junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125) : > [junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:135) : > [junit4] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.string(JsonWriter.java:566) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.value(JsonWriter.java:415) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.FailureEvent.serialize(FailureEvent.java:46) : > [junit4] at com.carrotsearch.ant.tasks.junit4 : > [junit4] .events.Serializer$2.run(Serializer.java:129) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:124) : > [junit4] ... 30 more : > [junit4] <<< JVM J0: EOF ---- : > : > [...truncated 1 lines...] : > [junit4] JVM J1: stderr was not empty, see: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J1-20181209_010444_7133307074783061758329.syserr : > [junit4] >>> JVM J1 emitted unexpected output (verbatim) ---- : > [junit4] WARN: Unhandled exception in event serialization. -> java.security.PrivilegedActionException: java.io.IOException: No space left on device : > [junit4] at java.security.AccessController.doPrivileged(Native Method) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:124) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:98) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.RunListenerEmitter.testRunStarted(RunListenerEmitter.java:40) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.NoExceptionRunListenerDecorator.testRunStarted(NoExceptionRunListenerDecorator.java:23) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.BeforeAfterRunListenerDecorator.testRunStarted(BeforeAfterRunListenerDecorator.java:24) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$1.notifyListener(OrderedRunNotifier.java:82) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$SafeNotifier.run(OrderedRunNotifier.java:63) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$SafeNotifier.run(OrderedRunNotifier.java:49) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier.fireTestRunStarted(OrderedRunNotifier.java:84) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:267) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:394) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13) : > [junit4] Caused by: java.io.IOException: No space left on device : > [junit4] at java.io.FileOutputStream.writeBytes(Native Method) : > [junit4] at java.io.FileOutputStream.write(FileOutputStream.java:326) : > [junit4] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) : > [junit4] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:121) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.EventsOutputStream.write(EventsOutputStream.java:28) : > [junit4] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) : > [junit4] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) : > [junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125) : > [junit4] at sun.nio.cs.Strea : > [junit4] mEncoder.write(StreamEncoder.java:135) : > [junit4] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) : > [junit4] at java.io.Writer.write(Writer.java:157) : > [junit4] at java.io.Writer.append(Writer.java:227) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.beforeValue(JsonWriter.java:639) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.open(JsonWriter.java:321) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.beginArray(JsonWriter.java:284) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.JsonHelpers.writeDescription(JsonHelpers.java:29) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.JsonHelpers.writeDescription(JsonHelpers.java:31) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.AbstractEvent.writeDescription(AbstractEvent.java:119) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.AbstractEventWithDescription.serialize(AbstractEventWithDescription.java:29) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.SuiteStartedEvent.serialize(SuiteStartedEvent.java:36) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:129) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:124) : > [junit4] ... 13 more : > [junit4] <<< JVM J1: EOF ---- : > : > [...truncated 3 lines...] : > [junit4] JVM J2: stderr was not empty, see: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J2-20181209_010444_7152386996292974006490.syserr : > [junit4] >>> JVM J2 emitted unexpected output (verbatim) ---- : > [junit4] WARN: Unhandled exception in event serialization. -> java.security.PrivilegedActionException: java.io.IOException: No space left on device : > [junit4] at java.security.AccessController.doPrivileged(Native Method) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.flushQueue(Serializer.java:124) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:98) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.RunListenerEmitter.testFailure(RunListenerEmitter.java:54) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.NoExceptionRunListenerDecorator.testFailure(NoExceptionRunListenerDecorator.java:55) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.BeforeAfterRunListenerDecorator.testFailure(BeforeAfterRunListenerDecorator.java:60) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$4.notifyListener(OrderedRunNotifier.java:129) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$SafeNotifier.run(OrderedRunNotifier.java:63) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier.fireTestFailure(OrderedRunNotifier.java:131) : > [junit4] at com.carrotsearch.randomizedtesting.ThreadLeakControl$SubNotifier.fireTestFailure(ThreadLeakControl.java:184) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner.fireTestFailure(RandomizedRunner.java:862) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner.fireTestFailure(RandomizedRunner.java:859) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:950) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880) : > [junit4] at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891) : > [junit4] at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) : > [junit4] at com.car : > [junit4] rotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) : > [junit4] at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) : > [junit4] at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) : > [junit4] at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) : > [junit4] at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) : > [junit4] at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) : > [junit4] at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) : > [junit4] at java.lang.Thread.run(Thread.java:748) : > [junit4] Caused by: java.io.IOException: No space left on device : > [junit4] at java.io.FileOutputStream.writeBytes(Native Method) : > [junit4] at java.io.FileOutputStream.write(FileOutputStream.java:326) : > [junit4] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122) : > [junit4] at com.carrotsearch.ant.tasks.junit4.slave.EventsOutputStream.write(EventsOutputStream.java:28) : > [junit4] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221) : > [junit4] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) : > [junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125) : > [junit4] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:135) : > [junit4] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.string(JsonWriter.java:566) : > [junit4] at com.carrotsearch.ant.tasks.junit4.gson.stream.JsonWriter.value(JsonWriter.java:415) : > [junit4] at com.carrotsearch.ant.tas : > [junit4] ks.junit4.events.FailureEvent.serialize(FailureEvent.java:46) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:129) : > [junit4] at com.carrotsearch.ant.tasks.junit4.events.Serializer$2.run(Serializer.java:124) : > [junit4] ... 31 more : > [junit4] <<< JVM J2: EOF ---- : > : > [...truncated 110 lines...] : > [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_191/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=2ABEC139CAED9038 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=7.7.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io..tmpdir=./temp -Dcommon.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene -Dclover.db.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/clover/db -Djava.security.policy=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.7.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/J0 -Djunit4.tempDir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp -Djunit4.childvm.id=0 -Djunit4.childvm .count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.badapples=false -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/codecs/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/test-framework/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/test-framework/lib/junit-4.10.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/test-framework/lib/randomizedtesting-runner-2.6.4.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/home/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins /tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/je nkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/usr/local/asfpackages/java/jdk1.8.0_191/lib/tools.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.6.4.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J0-20181209_010444_7151856360400559018552.events @/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J0-20181209_010444_7152474650355417946128.suites -stdin : > [junit4] ERROR: JVM J0 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs. : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1563) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994) : > [junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266) : > [junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) : > [junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) : > [junit4] at java.lang.Thread.run(Thread.java:748) : > [junit4] ERROR: JVM J1 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_191/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=2ABEC139CAED9038 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=7.7.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io..tmpdir=./temp -Dcommon.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene -Dclover.db.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/clover/db -Djava.security.policy=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.7.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/J1 -Djunit4.tempDir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp -Djunit4.childvm.id=1 -Djunit4.childvm .count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.badapples=false -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/codecs/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/test-framework/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/test-framework/lib/junit-4.10.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/test-framework/lib/randomizedtesting-runner-2.6.4.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/home/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins /tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/je nkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/usr/local/asfpackages/java/jdk1.8.0_191/lib/tools.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.6.4.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J1-20181209_010444_7131303777250425632446.events @/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J1-20181209_010444_7134387055577978503681.suites -stdin : > [junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs. : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1563) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994) : > [junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266) : > [junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) : > [junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) : > [junit4] at java.lang.Thread.run(Thread.java:748) : > [junit4] ERROR: JVM J2 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_191/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=2ABEC139CAED9038 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt -Dtests.luceneMatchVersion=7.7.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/tools/junit4/logging.properties -Dtests.nightly=true -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io..tmpdir=./temp -Dcommon.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene -Dclover.db.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/clover/db -Djava.security.policy=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.7.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/J2 -Djunit4.tempDir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp -Djunit4.childvm.id=2 -Djunit4.childvm .count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.badapples=false -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/codecs/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/test-framework/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/test-framework/lib/junit-4.10.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/test-framework/lib/randomizedtesting-runner-2.6.4.jar:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/classes/java:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/home/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins /tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/je nkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/usr/local/asfpackages/java/jdk1.8.0_191/lib/tools.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.6.4.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J2-20181209_010444_7155745863738715618596.events @/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build/core/test/temp/junit4-J2-20181209_010444_7156088894684391063736.suites -stdin : > [junit4] ERROR: JVM J2 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs. : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1563) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997) : > [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994) : > [junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266) : > [junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) : > [junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) : > [junit4] at java.lang.Thread.run(Thread.java:748) : > : > BUILD FAILED : > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:651: The following error occurred while executing this line: : > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:577: The following error occurred while executing this line: : > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:59: The following error occurred while executing this line: : > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/build.xml:50: The following error occurred while executing this line: : > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/common-build.xml:1572: The following error occurred while executing this line: : > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/lucene/common-build.xml:1099: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs. : > : > Total time: 37 minutes 44 seconds : > Build step 'Invoke Ant' marked build as failure : > Archiving artifacts : > [Fast Archiver] No artifacts from Lucene-Solr-NightlyTests-7.x #391 to compare, so performing full copy of artifacts : > Recording test results : > Email was triggered for: Failure - Any : > Sending email for trigger: Failure - Any : > : > --------------------------------------------------------------------- : > To unsubscribe, e-mail: [email protected] : > For additional commands, e-mail: [email protected] : : : : --------------------------------------------------------------------- : To unsubscribe, e-mail: [email protected] : For additional commands, e-mail: [email protected] : : -Hoss http://www.lucidworks.com/
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
