[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1706 - Failure

[Apache Jenkins Server]

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1706/

16 tests failed.
FAILED:  
org.apache.lucene.codecs.lucene50.TestLucene50TermVectorsFormat.testHighFreqs

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:40BB41C22CC75F2]:0)
        at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
        at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
        at 
org.apache.lucene.codecs.lucene70.Lucene70DocValuesConsumer.addBinaryField(Lucene70DocValuesConsumer.java:348)
        at 
org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addBinaryField(AssertingDocValuesFormat.java:107)
        at 
org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:114)
        at 
org.apache.lucene.index.ReadersAndUpdates.handleDVUpdates(ReadersAndUpdates.java:330)
        at 
org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:570)
        at 
org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:628)
        at 
org.apache.lucene.index.FrozenBufferedUpdates.forceApply(FrozenBufferedUpdates.java:322)
        at 
org.apache.lucene.index.FrozenBufferedUpdates.tryApply(FrozenBufferedUpdates.java:228)
        at 
org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2613)
        at 
org.apache.lucene.index.IndexWriter$$Lambda$92/851977769.process(Unknown Source)
        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5136)
        at 
org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1794)
        at 
org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1324)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)


FAILED:  org.apache.lucene.index.TestBinaryDocValuesUpdates.testSimple

Error Message:
Captured an uncaught exception in thread: Thread[id=1059, name=Lucene Merge 
Thread #1, state=RUNNABLE, group=TGRP-TestBinaryDocValuesUpdates]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1059, name=Lucene Merge Thread #1, 
state=RUNNABLE, group=TGRP-TestBinaryDocValuesUpdates]
        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:449D4EE9E71F8EC1]:0)
Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
        at __randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
Caused by: org.apache.lucene.store.AlreadyClosedException: refusing to delete 
any files: this IndexWriter hit an unrecoverable exception
        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
        at 
org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664)
        at 
org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5054)
        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4569)
        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4078)
        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:40BB41C22CC75F2]:0)
        at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
        at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
        at 
org.apache.lucene.codecs.lucene70.Lucene70DocValuesConsumer.addBinaryField(Lucene70DocValuesConsumer.java:348)
        at 
org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addBinaryField(AssertingDocValuesFormat.java:107)
        at 
org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:114)
        at 
org.apache.lucene.index.ReadersAndUpdates.handleDVUpdates(ReadersAndUpdates.java:330)
        at 
org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:570)
        at 
org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:628)
        at 
org.apache.lucene.index.FrozenBufferedUpdates.forceApply(FrozenBufferedUpdates.java:322)
        at 
org.apache.lucene.index.FrozenBufferedUpdates.tryApply(FrozenBufferedUpdates.java:228)
        at 
org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2613)
        at 
org.apache.lucene.index.IndexWriter$$Lambda$92/851977769.process(Unknown Source)
        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5136)
        at 
org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1794)
        at 
org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1324)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)


FAILED:  org.apache.lucene.index.TestDemoParallelLeafReader.testRandom

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  org.apache.lucene.index.TestIndexWriterMaxDocs.testAddTooManyIndexesDir

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  org.apache.lucene.index.TestIndexWriterWithThreads.testCloseWithThreads

Error Message:
this writer hit an unrecoverable error; cannot commit

Stack Trace:
java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot 
commit
        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:61EA4360A31940B6]:0)
        at 
org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4759)
        at 
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3298)
        at 
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3466)
        at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3431)
        at 
org.apache.lucene.index.TestIndexWriterWithThreads.testCloseWithThreads(TestIndexWriterWithThreads.java:241)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
        Suppressed: org.apache.lucene.store.AlreadyClosedException: refusing to 
delete any files: this IndexWriter hit an unrecoverable exception
                at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
                at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
                at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:589)
                at 
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3308)
                ... 39 more
        Caused by: java.lang.OutOfMemoryError: Java heap space
        [CIRCULAR REFERENCE:java.lang.OutOfMemoryError: Java heap space]


FAILED:  
org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit

Error Message:
this IndexWriter is closed

Stack Trace:
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
        at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
        at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
        at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3430)
        at 
org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit(TestIndexingSequenceNumbers.java:547)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at __randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
        at org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)


FAILED:  org.apache.lucene.index.TestMixedDocValuesUpdates.testTonsOfUpdates

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  org.apache.lucene.index.TestNumericDocValuesUpdates.testTonsOfUpdates

Error Message:
Java heap space: failed reallocation of scalar replaced objects

Stack Trace:
java.lang.OutOfMemoryError: Java heap space: failed reallocation of scalar 
replaced objects


FAILED:  org.apache.lucene.index.TestTermsEnum.testIntersectRandom

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  
org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica

Error Message:
Expected new active leader null Live Nodes: [127.0.0.1:39144_solr, 
127.0.0.1:40378_solr, 127.0.0.1:41779_solr] Last available state: 
DocCollection(raceDeleteReplica_false//collections/raceDeleteReplica_false/state.json/14)={
   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{"shard1":{       
"range":"80000000-7fffffff",       "state":"active",       "replicas":{         
"core_node4":{           "core":"raceDeleteReplica_false_shard1_replica_n2",    
       "base_url":"http://127.0.0.1:46158/solr";,           
"node_name":"127.0.0.1:46158_solr",           "state":"down",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node6":{           
"core":"raceDeleteReplica_false_shard1_replica_n5",           
"base_url":"http://127.0.0.1:46158/solr";,           
"node_name":"127.0.0.1:46158_solr",           "state":"down",           
"type":"NRT",           "force_set_state":"false"}}}},   
"router":{"name":"compositeId"},   "maxShardsPerNode":"1",   
"autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Expected new active leader
null
Live Nodes: [127.0.0.1:39144_solr, 127.0.0.1:40378_solr, 127.0.0.1:41779_solr]
Last available state: 
DocCollection(raceDeleteReplica_false//collections/raceDeleteReplica_false/state.json/14)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"raceDeleteReplica_false_shard1_replica_n2",
          "base_url":"http://127.0.0.1:46158/solr";,
          "node_name":"127.0.0.1:46158_solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node6":{
          "core":"raceDeleteReplica_false_shard1_replica_n5",
          "base_url":"http://127.0.0.1:46158/solr";,
          "node_name":"127.0.0.1:46158_solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
        at 
__randomizedtesting.SeedInfo.seed([1C427C2D2F9B9AF5:76541DFD4769D03F]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:280)
        at 
org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:328)
        at 
org.apache.solr.cloud.DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica(DeleteReplicaTest.java:224)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards

Error Message:
Error from server at http://127.0.0.1:39144/solr: Cannot create collection 
deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes 
currently live or live and part of your createNodeSet is 3. This allows a 
maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, 
value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 
shards to be created (higher than the allowed number)

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:39144/solr: Cannot create collection 
deleteByCountNew. Value of maxShardsPerNode is 1, and the number of nodes 
currently live or live and part of your createNodeSet is 3. This allows a 
maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, 
value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 
shards to be created (higher than the allowed number)
        at 
__randomizedtesting.SeedInfo.seed([1C427C2D2F9B9AF5:20D33B7960DAC7A0]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaByCountForAllShards(DeleteReplicaTest.java:161)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest

Error Message:
Error from server at http://127.0.0.1:39144/solr: Cannot create collection 
delLiveColl. Value of maxShardsPerNode is 1, and the number of nodes currently 
live or live and part of your createNodeSet is 3. This allows a maximum of 3 to 
be created. Value of numShards is 2, value of nrtReplicas is 2, value of 
tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be 
created (higher than the allowed number)

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:39144/solr: Cannot create collection 
delLiveColl. Value of maxShardsPerNode is 1, and the number of nodes currently 
live or live and part of your createNodeSet is 3. This allows a maximum of 3 to 
be created. Value of numShards is 2, value of nrtReplicas is 2, value of 
tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be 
created (higher than the allowed number)
        at 
__randomizedtesting.SeedInfo.seed([1C427C2D2F9B9AF5:B122C82632A43280]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:73)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestSimGenericDistributedQueue.testDistributedQueueBlocking

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
        at 
__randomizedtesting.SeedInfo.seed([1C427C2D2F9B9AF5:59E80E546BC92681]:0)
        at java.util.concurrent.FutureTask.get(FutureTask.java:205)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.testDistributedQueueBlocking(TestSimDistributedQueue.java:102)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSimGenericDistributedQueue

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestSimGenericDistributedQueue:     1) 
Thread[id=8220, name=sdqtest--2285-thread-1, state=TIMED_WAITING, 
group=TGRP-TestSimGenericDistributedQueue]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:194)
         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:167)
         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.lambda$testDistributedQueueBlocking$0(TestSimDistributedQueue.java:93)
         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue$$Lambda$947/1389395902.call(Unknown
 Source)         at java.util.concurrent.FutureTask.run(FutureTask.java:266)    
     at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$10/963048326.run(Unknown
 Source)         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
        at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestSimGenericDistributedQueue: 
   1) Thread[id=8220, name=sdqtest--2285-thread-1, state=TIMED_WAITING, 
group=TGRP-TestSimGenericDistributedQueue]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:194)
        at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:167)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.lambda$testDistributedQueueBlocking$0(TestSimDistributedQueue.java:93)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue$$Lambda$947/1389395902.call(Unknown
 Source)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$10/963048326.run(Unknown
 Source)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([1C427C2D2F9B9AF5]:0)


FAILED:  
org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest.testPreemptiveCreation

Error Message:
Error from server at 
http://127.0.0.1:43000/solr/myalias_2017-10-23_shard1_replica_n1: 
KeeperErrorCode = Session expired for /configs/timeConfigtestPreemptiveCreation

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from 
server at http://127.0.0.1:43000/solr/myalias_2017-10-23_shard1_replica_n1: 
KeeperErrorCode = Session expired for /configs/timeConfigtestPreemptiveCreation
        at 
__randomizedtesting.SeedInfo.seed([1C427C2D2F9B9AF5:7128F98617F977C1]:0)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)
        at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
        at 
org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest.testPreemptiveCreation(TimeRoutedAliasUpdateProcessorTest.java:351)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at 
http://127.0.0.1:43000/solr/myalias_2017-10-23_shard1_replica_n1: 
KeeperErrorCode = Session expired for /configs/timeConfigtestPreemptiveCreation
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more




Build Log:
[...truncated 811 lines...]
   [junit4] Suite: org.apache.lucene.index.TestBinaryDocValuesUpdates
   [junit4]   1> TEST: isNRT=false reader1=StandardDirectoryReader(segments_1:4 
_0(8.0.0):C2)
   [junit4]   1> TEST: now reopen
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestBinaryDocValuesUpdates -Dtests.method=testTonsOfUpdates 
-Dtests.seed=7C2E6A17C0EC5A10 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=en-US -Dtests.timezone=US/Michigan -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   28.9s J1 | TestBinaryDocValuesUpdates.testTonsOfUpdates <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:40BB41C22CC75F2]:0)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]    >        at 
org.apache.lucene.codecs.lucene70.Lucene70DocValuesConsumer.addBinaryField(Lucene70DocValuesConsumer.java:348)
   [junit4]    >        at 
org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addBinaryField(AssertingDocValuesFormat.java:107)
   [junit4]    >        at 
org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:114)
   [junit4]    >        at 
org.apache.lucene.index.ReadersAndUpdates.handleDVUpdates(ReadersAndUpdates.java:330)
   [junit4]    >        at 
org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:570)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:628)
   [junit4]    >        at 
org.apache.lucene.index.FrozenBufferedUpdates.forceApply(FrozenBufferedUpdates.java:322)
   [junit4]    >        at 
org.apache.lucene.index.FrozenBufferedUpdates.tryApply(FrozenBufferedUpdates.java:228)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2613)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter$$Lambda$92/851977769.process(Unknown Source)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5136)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1794)
   [junit4]    >        at 
org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1324)
   [junit4]   2> Nov 25, 2018 4:20:47 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #1,5,TGRP-TestBinaryDocValuesUpdates]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: 
refusing to delete any files: this IndexWriter hit an unrecoverable exception
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5054)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4569)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4078)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:40BB41C22CC75F2]:0)
   [junit4]   2>        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]   2>        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]   2>        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]   2>        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]   2>        at 
org.apache.lucene.codecs.lucene70.Lucene70DocValuesConsumer.addBinaryField(Lucene70DocValuesConsumer.java:348)
   [junit4]   2>        at 
org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addBinaryField(AssertingDocValuesFormat.java:107)
   [junit4]   2>        at 
org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:114)
   [junit4]   2>        at 
org.apache.lucene.index.ReadersAndUpdates.handleDVUpdates(ReadersAndUpdates.java:330)
   [junit4]   2>        at 
org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:570)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:628)
   [junit4]   2>        at 
org.apache.lucene.index.FrozenBufferedUpdates.forceApply(FrozenBufferedUpdates.java:322)
   [junit4]   2>        at 
org.apache.lucene.index.FrozenBufferedUpdates.tryApply(FrozenBufferedUpdates.java:228)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2613)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter$$Lambda$92/851977769.process(Unknown Source)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5136)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1794)
   [junit4]   2>        at 
org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1324)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestBinaryDocValuesUpdates -Dtests.method=testSimple 
-Dtests.seed=7C2E6A17C0EC5A10 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=en-US -Dtests.timezone=US/Michigan -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.05s J1 | TestBinaryDocValuesUpdates.testSimple <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1059, name=Lucene Merge Thread #1, 
state=RUNNABLE, group=TGRP-TestBinaryDocValuesUpdates]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:449D4EE9E71F8EC1]:0)
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
this IndexWriter hit an unrecoverable exception
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: 
refusing to delete any files: this IndexWriter hit an unrecoverable exception
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5054)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4569)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4078)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10:40BB41C22CC75F2]:0)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:84)
   [junit4]    >        at 
org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:57)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:168)
   [junit4]    >        at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:154)
   [junit4]    >        at 
org.apache.lucene.codecs.lucene70.Lucene70DocValuesConsumer.addBinaryField(Lucene70DocValuesConsumer.java:348)
   [junit4]    >        at 
org.apache.lucene.codecs.asserting.AssertingDocValuesFormat$AssertingDocValuesConsumer.addBinaryField(AssertingDocValuesFormat.java:107)
   [junit4]    >        at 
org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.addBinaryField(PerFieldDocValuesFormat.java:114)
   [junit4]    >        at 
org.apache.lucene.index.ReadersAndUpdates.handleDVUpdates(ReadersAndUpdates.java:330)
   [junit4]    >        at 
org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:570)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.writeSomeDocValuesUpdates(IndexWriter.java:628)
   [junit4]    >        at 
org.apache.lucene.index.FrozenBufferedUpdates.forceApply(FrozenBufferedUpdates.java:322)
   [junit4]    >        at 
org.apache.lucene.index.FrozenBufferedUpdates.tryApply(FrozenBufferedUpdates.java:228)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.lambda$publishFrozenUpdates$3(IndexWriter.java:2613)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter$$Lambda$92/851977769.process(Unknown Source)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:5136)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocValues(IndexWriter.java:1794)
   [junit4]    >        at 
org.apache.lucene.index.TestBinaryDocValuesUpdates.testTonsOfUpdates(TestBinaryDocValuesUpdates.java:1324)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/build/core/test/J1/temp/lucene.index.TestBinaryDocValuesUpdates_7C2E6A17C0EC5A10-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): 
{bdv=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
f=PostingsFormat(name=Direct), k1=PostingsFormat(name=Direct), 
foo=PostingsFormat(name=Direct), 
dvUpdateKey=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
k2=PostingsFormat(name=LuceneFixedGap), upd=FST50, 
updKey=PostingsFormat(name=Direct), id=PostingsFormat(name=LuceneFixedGap), 
key=PostingsFormat(name=LuceneFixedGap)}, 
docValues:{ndv=DocValuesFormat(name=Lucene70), 
f10=DocValuesFormat(name=Direct), f12=DocValuesFormat(name=Lucene70), 
f11=DocValuesFormat(name=Asserting), f14=DocValuesFormat(name=Direct), 
f13=DocValuesFormat(name=Lucene70), f0=DocValuesFormat(name=Asserting), 
f16=DocValuesFormat(name=Lucene70), f1=DocValuesFormat(name=Lucene70), 
f15=DocValuesFormat(name=Asserting), f2=DocValuesFormat(name=Lucene70), 
f18=DocValuesFormat(name=Direct), f17=DocValuesFormat(name=Lucene70), 
f3=DocValuesFormat(name=Direct), f4=DocValuesFormat(name=Asserting), 
f19=DocValuesFormat(name=Asserting), f5=DocValuesFormat(name=Lucene70), 
bdv2=DocValuesFormat(name=Asserting), f6=DocValuesFormat(name=Lucene70), 
number=DocValuesFormat(name=Lucene70), f7=DocValuesFormat(name=Direct), 
f8=DocValuesFormat(name=Asserting), bdv1=DocValuesFormat(name=Direct), 
f9=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70), 
val=DocValuesFormat(name=Direct), f21=DocValuesFormat(name=Direct), 
f20=DocValuesFormat(name=Lucene70), f23=DocValuesFormat(name=Lucene70), 
f22=DocValuesFormat(name=Asserting), f25=DocValuesFormat(name=Direct), 
upd=DocValuesFormat(name=Direct), f24=DocValuesFormat(name=Lucene70), 
f27=DocValuesFormat(name=Lucene70), sort=DocValuesFormat(name=Asserting), 
f26=DocValuesFormat(name=Asserting), cf0=DocValuesFormat(name=Direct), 
f28=DocValuesFormat(name=Lucene70), cf2=DocValuesFormat(name=Lucene70), 
cf1=DocValuesFormat(name=Asserting), cf4=DocValuesFormat(name=Direct), 
cf3=DocValuesFormat(name=Lucene70), cf6=DocValuesFormat(name=Lucene70), 
cf5=DocValuesFormat(name=Asserting), cf8=DocValuesFormat(name=Direct), 
cf7=DocValuesFormat(name=Lucene70), cf9=DocValuesFormat(name=Asserting), 
ssdv=DocValuesFormat(name=Asserting), sdv=DocValuesFormat(name=Direct), 
cf27=DocValuesFormat(name=Lucene70), cf28=DocValuesFormat(name=Direct), 
cf25=DocValuesFormat(name=Asserting), cf26=DocValuesFormat(name=Lucene70), 
cf23=DocValuesFormat(name=Lucene70), cf24=DocValuesFormat(name=Direct), 
cf21=DocValuesFormat(name=Asserting), cf22=DocValuesFormat(name=Lucene70), 
cf20=DocValuesFormat(name=Direct), key=DocValuesFormat(name=Lucene70), 
cf=DocValuesFormat(name=Lucene70), cf18=DocValuesFormat(name=Asserting), 
cf19=DocValuesFormat(name=Lucene70), f=DocValuesFormat(name=Asserting), 
cf16=DocValuesFormat(name=Lucene70), cf17=DocValuesFormat(name=Direct), 
cf14=DocValuesFormat(name=Asserting), cf15=DocValuesFormat(name=Lucene70), 
control=DocValuesFormat(name=Direct), cf12=DocValuesFormat(name=Lucene70), 
cf13=DocValuesFormat(name=Direct), cf10=DocValuesFormat(name=Asserting), 
cf11=DocValuesFormat(name=Lucene70), bdv=DocValuesFormat(name=Lucene70)}, 
maxPointsInLeafNode=1648, maxMBSortInHeap=6.650856656555558, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@100c7579),
 locale=en-US, timezone=US/Michigan
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 
1.8.0_191 (64-bit)/cpus=4,threads=1,free=69147952,total=444071936
   [junit4]   2> NOTE: All tests run in this JVM: [TestSloppyPhraseQuery, 
TestDisjunctionMaxQuery, TestDocValuesRewriteMethod, TestTerm, 
TestRecyclingIntBlockAllocator, TestLongBitSet, TestMatchesIterator, 
Test2BBKDPoints, TestLongPostings, TestNotDocIdSet, TestSimpleFSLockFactory, 
TestThreadedForceMerge, TestSimilarityBase, TestTopDocsMerge, 
TestAttributeSource, TestVersion, Test2BSortedDocValuesFixedSorted, 
TestReadOnlyIndex, TestStressDeletes, TestSloppyMath, 
TestTrackingDirectoryWrapper, TestLockFactory, TestBytesRefArray, 
TestIndexWriterMergePolicy, TestAllFilesDetectTruncation, TestTimSorter, 
TestFutureArrays, TestGraphTokenizers, TestMaxTermFrequency, TestFilterSpans, 
TestIndexWriterFromReader, TestPagedBytes, TestFilterDirectory, 
TestAtomicUpdate, TestNIOFSDirectory, TestOneMergeWrappingMergePolicy, 
TestMutablePointsReaderUtils, TestSpansEnum, TestSynonymQuery, 
TestDirectMonotonic, TestSpanExplanationsOfNonMatches, TestTwoPhaseCommitTool, 
TestRegexpRandom, TestIndexTooManyDocs, TestLMDirichletSimilarity, 
TestWildcard, TestIndexWriterOnDiskFull, TestParallelLeafReader, 
TestDocsWithFieldSet, TestFieldInvertState, TestToken, TestInPlaceMergeSorter, 
TestNewestSegment, TestDemo, TestIndependenceChiSquared, TestLongValuesSource, 
TestPrefixRandom, TestIndexedDISI, TestCrashCausesCorruptIndex, 
TestBasicModelIn, TestOperations, TestBinaryDocValuesUpdates]
   [junit4] Completed [146/511 (1!)] on J1 in 109.70s, 29 tests, 2 errors <<< 
FAILURES!

[...truncated 561 lines...]
   [junit4] Suite: org.apache.lucene.index.TestIndexingSequenceNumbers
   [junit4]   2> Nov 25, 2018 11:24:04 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[thread4,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]   2>        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]   2>        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)
   [junit4]   2> 
   [junit4]   2> Nov 25, 2018 11:24:55 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[thread3,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.RuntimeException: 
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:534)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: 
this IndexWriter is closed
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1615)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]   2>        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]   2>        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]   2>        ... 2 more
   [junit4]   2> 
   [junit4]   2> Nov 25, 2018 11:25:17 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[thread2,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.RuntimeException: 
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:534)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: 
this IndexWriter is closed
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1305)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1281)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:524)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]   2>        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]   2>        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)
   [junit4]   2> 
   [junit4]   2> Nov 25, 2018 11:25:17 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #1488,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.OutOfMemoryError: Java heap space
   [junit4]   2> 
   [junit4]   2> Nov 25, 2018 11:25:13 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #1489,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.OutOfMemoryError: Java heap space: failed 
reallocation of scalar replaced objects
   [junit4]   2> 
   [junit4]   2> Nov 25, 2018 11:25:13 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[thread0,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.RuntimeException: 
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:534)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: 
this IndexWriter is closed
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3430)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:502)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]   2>        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]   2>        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)
   [junit4]   2> 
   [junit4]   2> Nov 25, 2018 11:25:10 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge 
Thread #1487,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot 
merge
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]   2> Caused by: java.lang.IllegalStateException: this writer hit an 
unrecoverable error; cannot merge
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:4240)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:4220)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4072)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
   [junit4]   2>        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]   2>        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]   2>        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]   2>        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestIndexingSequenceNumbers 
-Dtests.method=testStressConcurrentAddAndDeleteAndCommit 
-Dtests.seed=7C2E6A17C0EC5A10 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=en-AU -Dtests.timezone=Africa/Bangui -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR    394s J1 | 
TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit <<<
   [junit4]    > Throwable #1: org.apache.lucene.store.AlreadyClosedException: 
this IndexWriter is closed
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3430)
   [junit4]    >        at 
org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit(TestIndexingSequenceNumbers.java:547)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]    >        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]    >        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]    >        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)Throwable
 #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=3491, name=thread4, state=RUNNABLE, 
group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]    >        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]    >        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]    >        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)Throwable
 #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=3488, name=thread1, state=RUNNABLE, 
group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]    >        at java.util.HashMap.resize(HashMap.java:704)
   [junit4]    >        at java.util.HashMap.putVal(HashMap.java:663)
   [junit4]    >        at java.util.HashMap.put(HashMap.java:612)
   [junit4]    >        at java.util.HashSet.add(HashSet.java:220)
   [junit4]    >        at 
java.util.AbstractCollection.addAll(AbstractCollection.java:344)
   [junit4]    >        at 
org.apache.lucene.index.SegmentInfos.files(SegmentInfos.java:781)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:550)
   [junit4]    >        at 
org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:517)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.checkpointNoSIS(IndexWriter.java:2596)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.writeReaderPool(IndexWriter.java:3329)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3239)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3466)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3431)
   [junit4]    >        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:502)Throwable
 #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=3490, name=thread3, state=RUNNABLE, 
group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.RuntimeException: 
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]    >        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:534)
   [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: 
this IndexWriter is closed
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1615)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237)
   [junit4]    >        at 
org.apache.lucene.index.TestIndexingSequenceNumbers$4.run(TestIndexingSequenceNumbers.java:526)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7C2E6A17C0EC5A10]:0)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread$IntBlockAllocator.getIntBlock(DocumentsWriterPerThread.java:662)
   [junit4]    >        at 
org.apache.lucene.util.IntBlockPool.nextBuffer(IntBlockPool.java:155)
   [junit4]    >        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:159)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:856)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:441)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:405)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1618)
   [junit4]    >        ... 2 moreThrowable #5: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=4979, name=Lucene Merge Thread #1487, 
state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot 
merge
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:704)
   [junit4]    >        at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:684)
   [junit4]    > Caused by: java.lang.IllegalStateException: this writer hit an 
unrecoverable error; cannot merge
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter._mergeInit(IndexWriter.java:4240)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.mergeInit(IndexWriter.java:4220)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4072

[...truncated too long message...]

d1.replica_t1, service url = null, agent id = null] for registry 
solr.core.deleteByCount.shard1.replica_t1 / 
com.codahale.metrics.MetricRegistry@1591948b
   [junit4]   2> 4109067 INFO  (coreCloseExecutor-7731-thread-2) 
[n:127.0.0.1:40378_solr c:deleteByCount s:shard1 r:core_node3 
x:deleteByCount_shard1_replica_t1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.deleteByCount.shard1.leader, tag=1395551b
   [junit4]   2> 4109075 INFO  (jetty-closer-6306-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=73731937863729158-127.0.0.1:40378_solr-n_0000000000) closing
   [junit4]   2> 4109075 INFO  
(OverseerStateUpdate-73731937863729158-127.0.0.1:40378_solr-n_0000000000) 
[n:127.0.0.1:40378_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:40378_solr
   [junit4]   2> 4109076 WARN  
(OverseerAutoScalingTriggerThread-73731937863729158-127.0.0.1:40378_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 4109083 INFO  (jetty-closer-6306-thread-4) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7403d0de{/solr,null,UNAVAILABLE}
   [junit4]   2> 4109084 INFO  (jetty-closer-6306-thread-4) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 4109091 INFO  (jetty-closer-6306-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@119b8e0c{/solr,null,UNAVAILABLE}
   [junit4]   2> 4109096 INFO  (jetty-closer-6306-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@4d762d5a{/solr,null,UNAVAILABLE}
   [junit4]   2> 4109096 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105f2ce8cf8001d, likely client has closed socket
   [junit4]   2> 4109096 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105f2ce8cf80006, likely client has closed socket
   [junit4]   2> 4109105 INFO  (jetty-closer-6306-thread-1) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 4109105 INFO  (jetty-closer-6306-thread-2) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 4109109 ERROR 
(SUITE-DeleteReplicaTest-seed#[1C427C2D2F9B9AF5]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 4109109 INFO  
(SUITE-DeleteReplicaTest-seed#[1C427C2D2F9B9AF5]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:43141 43141
   [junit4]   2> 4109299 INFO  (Thread-4678) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:43141 43141
   [junit4]   2> 4109300 WARN  (Thread-4678) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        15      /solr/aliases.json
   [junit4]   2>        10      
/solr/collections/raceDeleteReplica_true/terms/shard1
   [junit4]   2>        10      /solr/configs/conf
   [junit4]   2>        9       
/solr/collections/deleteReplicaOnIndexing/terms/shard1
   [junit4]   2>        9       /solr/clusterprops.json
   [junit4]   2>        7       /solr/security.json
   [junit4]   2>        7       
/solr/collections/deletereplica_test/terms/shard1
   [junit4]   2>        6       /solr/collections/deleteByCount/terms/shard1
   [junit4]   2>        6       
/solr/collections/raceDeleteReplica_false/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        16      
/solr/collections/raceDeleteReplica_true/state.json
   [junit4]   2>        15      /solr/clusterprops.json
   [junit4]   2>        15      /solr/clusterstate.json
   [junit4]   2>        4       /solr/collections/deleteByCount/state.json
   [junit4]   2>        4       
/solr/overseer_elect/election/73731937863729158-127.0.0.1:40378_solr-n_0000000000
   [junit4]   2>        3       
/solr/collections/deleteReplicaOnIndexing/state.json
   [junit4]   2>        3       
/solr/collections/raceDeleteReplica_false/state.json
   [junit4]   2>        2       /solr/collections/deletereplica_test/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/73731937863729173-127.0.0.1:39144_solr-n_0000000004
   [junit4]   2>        2       
/solr/collections/raceDeleteReplica_false/leader_elect/shard1/election/73731937863729165-core_node4-n_0000000000
   [junit4]   2>        2       
/solr/collections/raceDeleteReplica_true/leader_elect/shard1/election/73731937863729160-core_node3-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/73731937863729165-127.0.0.1:46158_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        15      /solr/live_nodes
   [junit4]   2>        15      /solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteReplicaTest_1C427C2D2F9B9AF5-001
   [junit4]   2> Nov 26, 2018 5:46:39 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): 
{id=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=1392, 
maxMBSortInHeap=6.6148065966552165, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@17c1f802),
 locale=hi-IN, timezone=Europe/Saratov
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 
1.8.0_191 (64-bit)/cpus=4,threads=1,free=105365904,total=524812288
   [junit4]   2> NOTE: All tests run in this JVM: [HLLUtilTest, 
CdcrBootstrapTest, ConfigSetsAPITest, TestManagedStopFilterFactory, 
RegexBytesRefFilterTest, ResourceLoaderTest, ResponseHeaderTest, 
ZookeeperStatusHandlerTest, TestSSLRandomization, TestRestoreCore, 
MetricTriggerIntegrationTest, DateFieldTest, TestLMDirichletSimilarityFactory, 
SuggesterWFSTTest, SliceStateTest, HdfsRecoverLeaseTest, SchemaApiFailureTest, 
TestSmileRequest, TestExceedMaxTermLength, HDFSCollectionsAPITest, 
SecurityConfHandlerTest, QueryParsingTest, SpellCheckCollatorTest, 
LargeFieldTest, TestPartialUpdateDeduplication, TestExportWriter, 
TestSearchPerf, ZkCLITest, CreateRoutedAliasTest, 
LeaderFailoverAfterPartitionTest, TestSolrQueryParser, TestSimpleTextCodec, 
StatelessScriptUpdateProcessorFactoryTest, DefaultValueUpdateProcessorTest, 
TestCSVResponseWriter, RollingRestartTest, TestDistributedGrouping, 
TestPayloadCheckQParserPlugin, TestUseDocValuesAsStored2, 
TestEmbeddedSolrServerSchemaAPI, HighlighterConfigTest, TestPullReplica, 
TestRecoveryHdfs, DirectSolrSpellCheckerTest, ScriptEngineTest, 
TestReversedWildcardFilterFactory, SimpleMLTQParserTest, 
AnalysisErrorHandlingTest, TestDownShardTolerantSearch, 
BasicAuthIntegrationTest, TestStressLucene, PeerSyncTest, 
TestSimpleTrackingShardHandler, TestNumericTerms64, 
AtomicUpdateProcessorFactoryTest, MigrateRouteKeyTest, ChangedSchemaMergeTest, 
NodeMarkersRegistrationTest, CoreAdminRequestStatusTest, 
TestMaxScoreQueryParser, TestSolrConfigHandlerCloud, TestMergePolicyConfig, 
TestInPlaceUpdatesStandalone, TestLeaderElectionWithEmptyReplica, 
MultiThreadedOCPTest, SolrCloudReportersTest, TestJsonFacetsWithNestedObjects, 
DebugComponentTest, OverseerTest, LeaderVoteWaitTimeoutTest, 
SolrTestCaseJ4Test, TestFacetMethods, DateMathParserTest, 
AutoScalingHandlerTest, LeaderElectionContextKeyTest, TestManagedSchema, 
AnalyticsQueryTest, AssignBackwardCompatibilityTest, NumberUtilsTest, 
TestBulkSchemaConcurrent, TestAddFieldRealTimeGet, SimplePostToolTest, 
TestCloudNestedDocsSort, SolrCoreMetricManagerTest, HdfsSyncSliceTest, 
TestRestManager, TestWriterPerf, SearchRateTriggerTest, TestInitParams, 
TestLegacyNumericUtils, TestCloudInspectUtil, TestSchemalessBufferedUpdates, 
TestCharFilters, TestStressInPlaceUpdates, BadCopyFieldTest, TestUpdate, 
TestLuceneIndexBackCompat, TestTrie, TestWithCollection, 
HdfsDirectoryFactoryTest, TestDynamicURP, RecoveryZkTest, 
ByteBuffersDirectoryFactoryTest, OpenExchangeRatesOrgProviderTest, 
TestTestInjection, TestRandomCollapseQParserPlugin, URLClassifyProcessorTest, 
TestSolrCloudWithKerberosAlt, SpellingQueryConverterTest, ZkNodePropsTest, 
SolrCmdDistributorTest, TestSimDistribStateManager, BasicDistributedZkTest, 
TestMiniSolrCloudClusterSSL, SolrMetricsIntegrationTest, 
DistributedTermsComponentTest, TestMaxTokenLenTokenizer, TestLFUCache, 
TestFuzzyAnalyzedSuggestions, TestDocumentBuilder, 
TriggerSetPropertiesIntegrationTest, SolrIndexSplitterTest, 
UninvertDocValuesMergePolicyTest, DocValuesNotIndexedTest, SolrXmlInZkTest, 
CoreSorterTest, TestCollationField, TestFieldCacheSort, 
BigEndianAscendingWordDeserializerTest, PingRequestHandlerTest, 
TestBlendedInfixSuggestions, HdfsChaosMonkeyNothingIsSafeTest, 
OverriddenZkACLAndCredentialsProvidersTest, FieldAnalysisRequestHandlerTest, 
UpdateRequestProcessorFactoryTest, TestJoin, TestRandomDVFaceting, 
TestSolrCoreProperties, TestTolerantSearch, TestWordDelimiterFilterFactory, 
TokenizerChainTest, ActionThrottleTest, AddReplicaTest, AliasIntegrationTest, 
ClusterStateTest, ClusterStateUpdateTest, CollectionPropsTest, 
CollectionStateFormat2Test, ConnectionManagerTest, CreateCollectionCleanupTest, 
DeleteReplicaTest]
   [junit4] Completed [464/836 (3!)] on J2 in 141.89s, 7 tests, 1 failure, 2 
errors, 1 skipped <<< FAILURES!

[...truncated 10332 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:585:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid5541.hprof

Total time: 600 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org