Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/248/

3 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
        at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
        at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
        at java.nio.charset.CharsetEncoder.encode(CharsetEncoder.java:795)
        at java.nio.charset.Charset.encode(Charset.java:843)
        at java.nio.charset.Charset.encode(Charset.java:863)
        at 
org.apache.http.client.utils.URLEncodedUtils.urlEncode(URLEncodedUtils.java:532)
        at 
org.apache.http.client.utils.URLEncodedUtils.encodeFormFields(URLEncodedUtils.java:652)
        at 
org.apache.http.client.utils.URLEncodedUtils.format(URLEncodedUtils.java:404)
        at 
org.apache.http.client.utils.URLEncodedUtils.format(URLEncodedUtils.java:382)
        at 
org.apache.http.client.entity.UrlEncodedFormEntity.<init>(UrlEncodedFormEntity.java:75)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.fillContentStream(HttpSolrClient.java:513)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.createMethod(HttpSolrClient.java:420)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:974)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:990)
        at 
org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:228)
        at 
org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:167)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:668)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)


FAILED:  
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_stored_idx

Error Message:
Some docs had errors -- check logs expected:<0> but was:<6>

Stack Trace:
java.lang.AssertionError: Some docs had errors -- check logs expected:<0> but 
was:<6>
        at 
__randomizedtesting.SeedInfo.seed([BC9584D1D2827C3F:B6B2D5F1ADF4DF68]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:342)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv_stored_idx(TestStressCloudBlindAtomicUpdates.java:221)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction.testNodeLost

Error Message:
ComputePlanAction should have computed exactly 1 operation expected:<1> but 
was:<2>

Stack Trace:
java.lang.AssertionError: ComputePlanAction should have computed exactly 1 
operation expected:<1> but was:<2>
        at 
__randomizedtesting.SeedInfo.seed([BC9584D1D2827C3F:3804A2F516819B9]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at 
org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction.testNodeLost(TestComputePlanAction.java:173)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13564 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestComputePlanAction_BC9584D1D2827C3F-001/init-core-data-001
   [junit4]   2> 949799 DEBUG 
(SUITE-TestComputePlanAction-seed#[BC9584D1D2827C3F]-worker) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 949800 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 949800 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 0
   [junit4]   2> 949801 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 949801 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 949806 INFO  
(SUITE-TestComputePlanAction-seed#[BC9584D1D2827C3F]-worker) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 949808 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 949810 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and 
clearing object cache...
   [junit4]   2> 949811 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10000_solr]
   [junit4]   2> 949816 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 949816 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:177)
 [java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 949831 DEBUG (ScheduledTrigger-1329-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 949849 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool 
executor now
   [junit4]   2> 949849 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 949849 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 949849 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread 
pool executor
   [junit4]   2> 949850 WARN  (ScheduledTrigger-1329-thread-3) [    ] 
o.a.s.c.a.ScheduledTrigger ScheduledTrigger ran but was already closed
   [junit4]   2> 949850 ERROR (ScheduledTrigger-1329-thread-3) [    ] 
o.a.s.c.a.ScheduledTriggers Unexpected exception from trigger: 
.scheduled_maintenance
   [junit4]   2> java.lang.RuntimeException: Trigger has been closed
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTrigger.run(ScheduledTrigger.java:155)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.run(ScheduledTriggers.java:589)
 [java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
 [?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
 [?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 949850 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 949850 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 949855 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 949855 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 2
   [junit4]   2> 949990 DEBUG (simCloudManagerPool-1333-thread-1) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 950207 DEBUG (simCloudManagerPool-1333-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 950227 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion -1
   [junit4]   2> 950227 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 950229 DEBUG (simCloudManagerPool-1333-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 950230 DEBUG (simCloudManagerPool-1333-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 950231 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10000_solr]
   [junit4]   2> 950247 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 950247 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 3
   [junit4]   2> 950247 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 950247 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 950247 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 950247 DEBUG (ScheduledTrigger-1334-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 950268 DEBUG (ScheduledTrigger-1334-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 950288 DEBUG (ScheduledTrigger-1334-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 950309 DEBUG (ScheduledTrigger-1334-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 950329 DEBUG (ScheduledTrigger-1334-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 950349 DEBUG (ScheduledTrigger-1334-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950350 DEBUG (simCloudManagerPool-1333-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 950350 DEBUG (simCloudManagerPool-1333-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
5
   [junit4]   2> 950352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 950352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr, 127.0.0.1:10002_solr, 
127.0.0.1:10003_solr]
   [junit4]   2> 950352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 950352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 950353 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950365 DEBUG (simCloudManagerPool-1333-thread-4) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: 
testNodeWithMultipleReplicasLost
   [junit4]   2> 950370 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950373 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950381 DEBUG (simCloudManagerPool-1333-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 950384 DEBUG (simCloudManagerPool-1333-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 950390 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950393 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950410 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950413 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950430 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950433 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950450 INFO  (simCloudManagerPool-1333-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 30280746068 
sessionWrapper.createTime 30280742758805522, this.sessionWrapper.createTime 
30280742758805522 
   [junit4]   2> 950450 DEBUG (simCloudManagerPool-1333-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 950451 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950453 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950471 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950474 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950491 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950494 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950511 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950514 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950532 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950534 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950552 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950554 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950574 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950575 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950585 DEBUG (simCloudManagerPool-1333-thread-11) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for 
testNodeWithMultipleReplicasLost / shard2: {"core_node4":{
   [junit4]   2>     
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testNodeWithMultipleReplicasLost"}}
   [junit4]   2> 950594 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 950595 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4
   [junit4]   2> 950603 DEBUG (simCloudManagerPool-1333-thread-12) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for 
testNodeWithMultipleReplicasLost / shard1: {"core_node1":{
   [junit4]   2>     
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testNodeWithMultipleReplicasLost"}}
   [junit4]   2> 950605 DEBUG 
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction -- cluster state: znodeVersion: 5
   [junit4]   2> live nodes:[127.0.0.1:10001_solr, 127.0.0.1:10000_solr, 
127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 
collections:{testNodeWithMultipleReplicasLost=DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/4)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node6":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n5",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node3":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n3",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}}
   [junit4]   2> 950614 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3
   [junit4]   2> 950614 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10001_solr
   [junit4]   2> 950615 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 3
   [junit4]   2> 950615 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10001_solr
   [junit4]   2> 950635 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3
   [junit4]   2> 950635 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 3
   [junit4]   2> 950635 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:10001_solr]
   [junit4]   2> 950635 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"6b942f842d4b8aT7lb18b2cw2zb07m1ytmks54i0",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":30280754309974922,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[30280754309974922],
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}}
   [junit4]   2> 950636 DEBUG (ScheduledTrigger-1334-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
.scheduled_maintenance, node_lost_trigger]
   [junit4]   2> 950867 DEBUG (simCloudManagerPool-1333-thread-15) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: .system
   [junit4]   2> 950877 DEBUG (simCloudManagerPool-1333-thread-15) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 950879 DEBUG (simCloudManagerPool-1333-thread-15) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 950890 INFO  (simCloudManagerPool-1333-thread-15) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 30280768055 
sessionWrapper.createTime 30280767534649922, this.sessionWrapper.createTime 
30280767534649922 
   [junit4]   2> 950890 DEBUG (simCloudManagerPool-1333-thread-15) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 950920 DEBUG (simCloudManagerPool-1333-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
   [junit4]   2>   "replicas":{"core_node1":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>       "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>       "INDEX.sizeInBytes":10240,
   [junit4]   2>       "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "type":"NRT",
   [junit4]   2>       "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>       "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 950927 DEBUG (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"6b942f842d4b8aT7lb18b2cw2zb07m1ytmks54i0",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":30280754309974922,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[30280754309974922],
   [junit4]   2>     "_enqueue_time_":30280755352410822,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}}
   [junit4]   2> 950927 DEBUG (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"6b942f842d4b8aT7lb18b2cw2zb07m1ytmks54i0",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":30280754309974922,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[30280754309974922],
   [junit4]   2>     "_enqueue_time_":30280755352410822,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}} with context 
properties: {BEFORE_ACTION=[compute_plan]}
   [junit4]   2> 950927 DEBUG (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 950959 DEBUG (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 950961 INFO  (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10003_solr&inPlaceMove=true&replica=core_node5
   [junit4]   2> 950971 INFO  (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10000_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 950971 INFO  (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 30280772118 
sessionWrapper.createTime 30280771511191572, this.sessionWrapper.createTime 
30280771511191572 
   [junit4]   2> 950971 DEBUG (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 950976 DEBUG (simCloudManagerPool-1333-thread-18) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
   [junit4]   2>   "replicas":{"core_node1":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>       "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>       "INDEX.sizeInBytes":10240,
   [junit4]   2>       "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "type":"NRT",
   [junit4]   2>       "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>       "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 950984 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10003_solr&inPlaceMove=true&replica=core_node5
   [junit4]   2> 950984 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10000_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 950984 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction -------------_ FINAL STATE 
--------------
   [junit4]   2> 950984 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction * Node values: {
   [junit4]   2>   "127.0.0.1:10001_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":2,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1022,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10001_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10001,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
   [junit4]   2>   "127.0.0.1:10000_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":999,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10000_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10000,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
   [junit4]   2>   "127.0.0.1:10002_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":2,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1022,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10002,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
   [junit4]   2>   "127.0.0.1:10003_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":2,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1022,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10003,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
   [junit4]   2> 950985 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction * Live nodes: [127.0.0.1:10000_solr, 
127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 950985 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction * Collection .system state: 
DocCollection(.system//clusterstate.json/9)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{"core_node1":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 950985 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.TestComputePlanAction * Collection 
testNodeWithMultipleReplicasLost state: 
DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/9)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node6":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n5",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node3":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n3",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 950993 INFO  
(TEST-TestComputePlanAction.testNodeWithMultipleReplicasLost-seed#[BC9584D1D2827C3F])
 [    ] o.a.s.c.a.s.SimSolrCloudTestCase #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:         3
   [junit4]   2> ## Empty nodes:        0
   [junit4]   2> ## Dead nodes:         1
   [junit4]   2> ##             127.0.0.1:10001_solr
   [junit4]   2> ## Collections:        [.system, 
testNodeWithMultipleReplicasLost]
   [junit4]   2> ## Max replicas per node:      2
   [junit4]   2> ## Min replicas per node:      1
   [junit4]   2> ## Total replicas:             5
   [junit4]   2> ## * .system           1
   [junit4]   2> ##             - active           1
   [junit4]   2> ## * testNodeWithMultipleReplicasLost          4
   [junit4]   2> ##             - active           4
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##             - CREATE             1
   [junit4]   2> ##             - autoscaling        3
   [junit4]   2> ##             - update             2
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: node_lost_trigger
   [junit4]   2> ##             - BEFORE_ACTION     1
   [junit4]   2> ##             - STARTED         1
   [junit4]   2> 
   [junit4]   2> 951089 DEBUG (simCloudManagerPool-1333-thread-19) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
   [junit4]   2>   "replicas":{"core_node1":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>       "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>       "INDEX.sizeInBytes":10240,
   [junit4]   2>       "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "type":"NRT",
   [junit4]   2>       "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>       "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 951157 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
6
   [junit4]   2> 951157 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimNodeStateProvider - removing dead node values: 
127.0.0.1:10001_solr
   [junit4]   2> 951158 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimNodeStateProvider --removing value for 127.0.0.1:10002_solr
   [junit4]   2> 951158 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10003_solr
   [junit4]   2> 951158 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimNodeStateProvider --removing value for 127.0.0.1:10000_solr
   [junit4]   2> 951158 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 951158 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 951158 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 951159 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 951159 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 951159 WARN  (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Exception sending event to collection .system
   [junit4]   2> java.io.IOException: java.lang.InterruptedException
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:632)
 ~[test/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.SystemLogListener.onEvent(SystemLogListener.java:118)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerListeners.fireListeners(ScheduledTriggers.java:790)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerListeners.fireListeners(ScheduledTriggers.java:757)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:322)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> Caused by: java.lang.InterruptedException
   [junit4]   2>        at 
java.util.concurrent.FutureTask.awaitDone(FutureTask.java:404) ~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.get(FutureTask.java:191) ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:630)
 ~[test/:?]
   [junit4]   2>        ... 10 more
   [junit4]   2> 951160 DEBUG (AutoscalingActionExecutor-1335-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 11684 ms for event 
id=6b942f842d4b8aT7lb18b2cw2zb07m1ytmks54i0
   [junit4]   2> 951160 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 951160 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 951160 DEBUG 
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 951179 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 951179 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 7
   [junit4]   2> 951180 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion -1
   [junit4]   2> 951180 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 951198 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10003_solr]
   [junit4]   2> 951219 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 951219 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 951219 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951240 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951260 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951280 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951300 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951314 DEBUG (simCloudManagerPool-1336-thread-1) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 951320 DEBUG (simCloudManagerPool-1336-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
8
   [junit4]   2> 951320 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
   [junit4]   2> 951321 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 951321 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 951321 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951338 DEBUG (simCloudManagerPool-1336-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 951338 DEBUG (simCloudManagerPool-1336-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
9
   [junit4]   2> 951341 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951345 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
   [junit4]   2> 951345 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 951345 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
   [junit4]   2> 951361 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951382 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951402 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951422 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951442 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951463 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951468 DEBUG (simCloudManagerPool-1336-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 951468 DEBUG (simCloudManagerPool-1336-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
10
   [junit4]   2> 951473 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
   [junit4]   2> 951474 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial 
livenodes: [127.0.0.1:10003_solr]
   [junit4]   2> 951474 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated 
with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, 
class=solr.ComputePlanAction}, {name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestComputePlanAction$AssertingTriggerAction}],
 enabled=true}
   [junit4]   2> 951474 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
   [junit4]   2> 951475 DEBUG (ScheduledTrigger-1337-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951475 DEBUG (ScheduledTrigger-1337-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951483 DEBUG (ScheduledTrigger-1337-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951493 DEBUG (simCloudManagerPool-1336-thread-4) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 951493 DEBUG (simCloudManagerPool-1336-thread-4) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
11
   [junit4]   2> 951494 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 11
   [junit4]   2> 951494 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 11, lastZnodeVersion 11
   [junit4]   2> 951496 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951496 DEBUG (ScheduledTrigger-1337-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951503 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951509 DEBUG (simCloudManagerPool-1336-thread-5) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: testNodeAdded
   [junit4]   2> 951516 DEBUG (ScheduledTrigger-1337-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951516 DEBUG (ScheduledTrigger-1337-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951520 WARN  (simCloudManagerPool-1336-thread-5) [    ] 
o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 4 on collection 
testNodeAdded is higher than the number of Solr instances currently live or 
live and part of your createNodeSet(1). It's unusual to run two replica of the 
same slice on the same Solr-instance.
   [junit4]   2> 951520 DEBUG (simCloudManagerPool-1336-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 951521 DEBUG (simCloudManagerPool-1336-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 951522 INFO  (simCloudManagerPool-1336-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 30280799676 
sessionWrapper.createTime 30280799606090372, this.sessionWrapper.createTime 
30280799606090372 
   [junit4]   2> 951522 DEBUG (simCloudManagerPool-1336-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 951526 DEBUG (ScheduledTrigger-1337-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951542 DEBUG (ScheduledTrigger-1337-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951542 DEBUG (ScheduledTrigger-1337-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951565 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951565 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951566 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951586 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951586 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951586 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951606 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 951606 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951606 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 951606 DEBUG (simCloudManagerPool-1336-thread-10) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeAdded / 
shard1: {"core_node2":{
   [junit4]   2>     "core":"testNodeAdded_shard1_replica_n2",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0,
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testNodeAdded"}}
   [junit4]   2> 951615 DEBUG (simCloudManagerPool-1336-thread-11) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 951615 DEBUG (simCloudManagerPool-1336-thread-11) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
12
   [junit4]   2> 951619 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 12
   [junit4]   2> 951619 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 12, lastZnodeVersion 12
   [junit4]   2> 951626 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 951626 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951626 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 951626 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10004_solr at time 
30280804875708822
   [junit4]   2> 951646 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 951647 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 951647 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 951647 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing 
registered processor for nodes: [127.0.0.1:10004_solr] added at times 
[30280804875708822], now=30280805904298372
   [junit4]   2> 951647 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"6b943b4a212996T7lb18b2cw2zb07m1ytmks54i5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":30280804875708822,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[30280804875708822],
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 951648 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
.scheduled_maintenance, node_added_trigger]
   [junit4]   2> 951662 DEBUG (simCloudManagerPool-1336-thread-12) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: .system
   [junit4]   2> 951803 DEBUG (simCloudManagerPool-1336-thread-12) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 951803 DEBUG (simCloudManagerPool-1336-thread-12) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 951804 INFO  (simCloudManagerPool-1336-thread-12) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 30280813751 
sessionWrapper.createTime 30280813719234372, this.sessionWrapper.createTime 
30280813719234372 
   [junit4]   2> 951804 DEBUG (simCloudManagerPool-1336-thread-12) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 951822 DEBUG (simCloudManagerPool-1336-thread-12) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>       "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>       "INDEX.sizeInBytes":10240,
   [junit4]   2>       "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "type":"NRT",
   [junit4]   2>       "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>       "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 951831 DEBUG (ScheduledTrigger-1337-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - removing 
marker path: /autoscaling/nodeAdded/127.0.0.1:10004_solr
   [junit4]   2> 951832 DEBUG (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"6b943b4a212996T7lb18b2cw2zb07m1ytmks54i5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":30280804875708822,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[30280804875708822],
   [junit4]   2>     "_enqueue_time_":30280805945024722,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 951832 DEBUG (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"6b943b4a212996T7lb18b2cw2zb07m1ytmks54i5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":30280804875708822,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[30280804875708822],
   [junit4]   2>     "_enqueue_time_":30280805945024722,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}} with context 
properties: {BEFORE_ACTION=[compute_plan]}
   [junit4]   2> 951832 DEBUG (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 951833 DEBUG (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 951833 INFO  (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testNodeAdded&targetNode=127.0.0.1:10004_solr&inPlaceMove=true&replica=core_node2
   [junit4]   2> 951835 INFO  (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 30280815315 
sessionWrapper.createTime 30280815190956422, this.sessionWrapper.createTime 
30280815190956422 
   [junit4]   2> 951835 DEBUG (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 951847 DEBUG (simCloudManagerPool-1336-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- no leader in shard1:{
   [junit4]   2>   "replicas":{"core_node2":{
   [junit4]   2>       "core":".system_shard1_replica_n1",
   [junit4]   2>       "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>       "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>       "INDEX.sizeInBytes":10240,
   [junit4]   2>       "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "type":"NRT",
   [junit4]   2>       "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>       "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 951847 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction Node values: {
   [junit4]   2>   "127.0.0.1:10004_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1023,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10004_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10004,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
   [junit4]   2>   "127.0.0.1:10003_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":4,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":996,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10003,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
   [junit4]   2> 951847 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction Live nodes: [127.0.0.1:10004_solr, 
127.0.0.1:10003_solr], collection state: 
DocCollection(testNodeAdded//clusterstate.json/19)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"4",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n1",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n2",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n3",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n4",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 951848 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction -------------_ FINAL STATE --------------
   [junit4]   2> 951848 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction * Node values: {
   [junit4]   2>   "127.0.0.1:10004_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1023,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10004_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10004,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0},
   [junit4]   2>   "127.0.0.1:10003_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":4,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":996,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10003_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10003,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0}}
   [junit4]   2> 951848 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction * Live nodes: [127.0.0.1:10004_solr, 
127.0.0.1:10003_solr]
   [junit4]   2> 951848 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction * Collection .system state: 
DocCollection(.system//clusterstate.json/19)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 951848 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.TestComputePlanAction * Collection testNodeAdded state: 
DocCollection(testNodeAdded//clusterstate.json/19)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"4",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n1",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n2",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n3",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testNodeAdded_shard1_replica_n4",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 951849 INFO  
(TEST-TestComputePlanAction.testNodeAdded-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:         2
   [junit4]   2> ## Empty nodes:        0
   [junit4]   2> ## Dead nodes:         0
   [junit4]   2> ## Collections:        [.system, testNodeAdded]
   [junit4]   2> ## Max replicas per node:      4
   [junit4]   2> ## Min replicas per node:      1
   [junit4]   2> ## Total replicas:             5
   [junit4]   2> ## * .system           1
   [junit4]   2> ##             - active           1
   [junit4]   2> ## * testNodeAdded             4
   [junit4]   2> ##             - active           4
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##             - CREATE             1
   [junit4]   2> ##             - autoscaling        5
   [junit4]   2> ##             - update             2
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: node_added_trigger
   [junit4]   2> ##             - BEFORE_ACTION     1
   [junit4]   2> ##             - STARTED         1
   [junit4]   2> 
   [junit4]   2> 951855 DEBUG 
(TEST-TestComputePlanAction.testNodeLost-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
13
   [junit4]   2> 951855 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 13
   [junit4]   2> 951855 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 951856 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 951856 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 13, lastZnodeVersion 13
   [junit4]   2> 951858 DEBUG 
(TEST-TestComputePlanAction.testNodeLost-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimNodeStateProvider --removing value for 127.0.0.1:10004_solr
   [junit4]   2> 951860 INFO  
(TEST-TestComputePlanAction.testNodeLost-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 951860 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189)
 [java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 951860 DEBUG 
(TEST-TestComputePlanAction.testNodeLost-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 951860 DEBUG 
(TEST-TestComputePlanAction.testNodeLost-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 951860 DEBUG 
(TEST-TestComputePlanAction.testNodeLost-seed#[BC9584D1D2827C3F]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 951867 WARN  (AutoscalingActionExecutor-1338-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Exception sending event to collection .system
   [junit4]   2> java.io.IOException: java.lang.InterruptedException
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:632)
 ~[test/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.SystemLogListener.onEvent(SystemLogListener.java:118)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerListeners.fireListeners(ScheduledTriggers.java:790)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerListeners.fireListeners(ScheduledTriggers.java:766)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:316)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> Caused by: java.lang.InterruptedException
   [junit4]   2>        at 
java.util.concurrent.FutureTask.awaitDone(FutureTask.java:404) ~[?:1.8.0_172]
   [junit4]   2>        at java.util

[...truncated too long message...]

arent_f1_s=PostingsFormat(name=Memory), 
30parent_f1_s=PostingsFormat(name=Memory), 
14parent_f2_s=PostingsFormat(name=MockRandom), 
20parent_f1_s=PostingsFormat(name=MockRandom), 
1parent_f2_s=PostingsFormat(name=MockRandom), 
7grand0_s=PostingsFormat(name=Memory), text_t=PostingsFormat(name=Asserting), 
24parent_f2_s=PostingsFormat(name=Memory), 
44parent_f2_s=Lucene50(blocksize=128), 
34parent_f2_s=PostingsFormat(name=Asserting), 
13parent_f2_s=PostingsFormat(name=Memory), 
type_s=PostingsFormat(name=Asserting), 
23parent_f2_s=PostingsFormat(name=Asserting), 
53parent_f2_s=PostingsFormat(name=Memory), 
43parent_f2_s=PostingsFormat(name=MockRandom), 
10parent_f1_s=Lucene50(blocksize=128), 33parent_f2_s=Lucene50(blocksize=128), 
22parent_f2_s=Lucene50(blocksize=128), 
4child0_s=PostingsFormat(name=MockRandom), 
12parent_f2_s=PostingsFormat(name=Asserting), 
52parent_f2_s=PostingsFormat(name=Asserting), 
42parent_f2_s=PostingsFormat(name=Memory), 
32parent_f2_s=PostingsFormat(name=MockRandom), 
31parent_f1_s=PostingsFormat(name=MockRandom), 
5grand1_s=PostingsFormat(name=Asserting), 
6grand4_s=PostingsFormat(name=MockRandom), 
11parent_f1_s=PostingsFormat(name=Asserting), 
51parent_f1_s=PostingsFormat(name=Asserting), 
54parent_f1_s=Lucene50(blocksize=128), 21parent_f1_s=Lucene50(blocksize=128), 
4grand2_s=PostingsFormat(name=MockRandom), 
7grand3_s=PostingsFormat(name=Asserting), 
41parent_f1_s=PostingsFormat(name=Memory), 
37parent_f1_s=PostingsFormat(name=Asserting), 
40parent_f2_s=Lucene50(blocksize=128), 
50parent_f2_s=PostingsFormat(name=MockRandom), 
47parent_f1_s=Lucene50(blocksize=128), 14parent_f1_s=Lucene50(blocksize=128), 
57parent_f1_s=PostingsFormat(name=MockRandom), 
20parent_f2_s=PostingsFormat(name=Memory), 
34parent_f1_s=PostingsFormat(name=Memory), 
24parent_f1_s=PostingsFormat(name=MockRandom), 
44parent_f1_s=PostingsFormat(name=Asserting), 
30parent_f2_s=PostingsFormat(name=Asserting), 
5parent_f1_s=PostingsFormat(name=Memory), 
6grand0_s=PostingsFormat(name=MockRandom), 
56parent_f2_s=PostingsFormat(name=Asserting), 
46parent_f2_s=PostingsFormat(name=Memory), 
10parent_f2_s=PostingsFormat(name=MockRandom), 
8parent_f1_s=PostingsFormat(name=MockRandom), 
27parent_f2_s=PostingsFormat(name=Asserting), 
2parent_f2_s=PostingsFormat(name=Memory), 4child1_s=Lucene50(blocksize=128), 
2grand1_s=PostingsFormat(name=Memory), 
17parent_f2_s=PostingsFormat(name=Memory), 3child2_s=Lucene50(blocksize=128), 
16parent_f2_s=PostingsFormat(name=MockRandom), 
26parent_f2_s=Lucene50(blocksize=128), 1child0_s=Lucene50(blocksize=128), 
36parent_f2_s=PostingsFormat(name=MockRandom), 
7grand6_s=Lucene50(blocksize=128), 18parent_f1_s=Lucene50(blocksize=128), 
28parent_f1_s=PostingsFormat(name=Asserting), 
5grand0_s=Lucene50(blocksize=128), 6grand5_s=PostingsFormat(name=Memory), 
7grand2_s=Lucene50(blocksize=128), 
48parent_f1_s=PostingsFormat(name=Asserting), 
15parent_f1_s=PostingsFormat(name=Asserting), 
4grand3_s=PostingsFormat(name=Memory), 58parent_f1_s=Lucene50(blocksize=128), 
6parent_f1_s=PostingsFormat(name=Asserting), 
25parent_f1_s=Lucene50(blocksize=128), 
0parent_f1_s=PostingsFormat(name=MockRandom), 
3grand2_s=Lucene50(blocksize=128), 
35parent_f1_s=PostingsFormat(name=MockRandom), 
19parent_f2_s=Lucene50(blocksize=128), 4parent_f2_s=Lucene50(blocksize=128), 
37parent_f2_s=Lucene50(blocksize=128), 
47parent_f2_s=PostingsFormat(name=MockRandom), 
57parent_f2_s=PostingsFormat(name=Memory), 
38parent_f1_s=PostingsFormat(name=Memory), 5grand4_s=Lucene50(blocksize=128), 
6grand1_s=PostingsFormat(name=Memory), 
5parent_f2_s=PostingsFormat(name=MockRandom), 
46parent_f1_s=PostingsFormat(name=MockRandom), 
16parent_f1_s=PostingsFormat(name=Memory), 
56parent_f1_s=PostingsFormat(name=Memory), 
8parent_f2_s=Lucene50(blocksize=128), 
39parent_f2_s=PostingsFormat(name=Memory), 
29parent_f2_s=PostingsFormat(name=Asserting), 
2parent_f1_s=PostingsFormat(name=Asserting), 
4child2_s=PostingsFormat(name=Asserting), rnd_b=PostingsFormat(name=Memory), 
27parent_f1_s=PostingsFormat(name=Memory), 
45parent_f1_s=PostingsFormat(name=Memory), 
17parent_f1_s=PostingsFormat(name=Asserting), 
2grand0_s=PostingsFormat(name=Asserting), 
49parent_f2_s=PostingsFormat(name=Asserting), 
3child1_s=PostingsFormat(name=MockRandom), 
55parent_f1_s=PostingsFormat(name=Asserting), 
59parent_f2_s=Lucene50(blocksize=128), 
7parent_f2_s=PostingsFormat(name=Asserting), 
26parent_f1_s=PostingsFormat(name=Asserting), 
2child0_s=PostingsFormat(name=MockRandom), 
3parent_f1_s=Lucene50(blocksize=128), 36parent_f1_s=Lucene50(blocksize=128)}, 
docValues:{_version_=DocValuesFormat(name=Memory), 
id=DocValuesFormat(name=Asserting), text_t=DocValuesFormat(name=Memory)}, 
maxPointsInLeafNode=181, maxMBSortInHeap=5.142025435293219, 
sim=RandomSimilarity(queryNorm=true): {}, locale=zh-CN, 
timezone=America/Catamarca
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 
1.8.0_172 (64-bit)/cpus=4,threads=1,free=120884656,total=469237760
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrXml, 
ExitableDirectoryReaderTest, RankQueryTest, TestSolrCoreParser, 
DistributedFacetPivotLargeTest, RuleEngineTest, TestUniqueKeyFieldResource, 
SystemLogListenerTest, TestSystemCollAutoCreate, LoggingHandlerTest, 
TestStressUserVersions, BadComponentTest, CurrencyFieldTypeTest, 
TestDocTermOrds, SignatureUpdateProcessorFactoryTest, OverseerTest, 
SolrRrdBackendFactoryTest, TestCSVLoader, TestTrieFacet, TestIntervalFaceting, 
MetricsHandlerTest, DistributedDebugComponentTest, FullHLLTest, GraphQueryTest, 
TestDistribDocBasedVersion, TestComplexPhraseLeadingWildcard, TestJsonFacets, 
TestGraphTermsQParserPlugin, TestTolerantUpdateProcessorCloud, 
TestTolerantSearch, TestCopyFieldCollectionResource, 
OverriddenZkACLAndCredentialsProvidersTest, TestLeaderElectionZkExpiry, 
TestManagedSchemaAPI, TestUnInvertedFieldException, 
DefaultValueUpdateProcessorTest, ZkControllerTest, TestDynamicLoading, 
HdfsRecoveryZkTest, TestScoreJoinQPNoScore, TestComputePlanAction, 
SoftAutoCommitTest, TestMultiValuedNumericRangeQuery, TestSQLHandlerNonCloud, 
TestInfoStreamLogging, TestClusterProperties, PKIAuthenticationIntegrationTest, 
EmbeddedSolrNoSerializeTest, OverseerRolesTest, UpdateParamsTest, 
TestSolrQueryResponse, TestShardHandlerFactory, 
DocumentAnalysisRequestHandlerTest, BasicDistributedZkTest, 
HdfsWriteToMultipleCollectionsTest, DeleteNodeTest, TestStressInPlaceUpdates, 
IndexSchemaTest, TestFilteredDocIdSet, TestReqParamsAPI, 
TestFieldCollectionResource, TestConfigOverlay, DistanceUnitsTest, 
TestRandomRequestDistribution, DocValuesNotIndexedTest, 
TestRandomCollapseQParserPlugin, BufferStoreTest, TestCollectionAPI, 
TestSSLRandomization, TestFunctionQuery, TestNumericTerms32, 
TestLegacyFieldReuse, RestoreTriggerStateTest, 
TestReversedWildcardFilterFactory, ActionThrottleTest, MaxSizeAutoCommitTest, 
MoreLikeThisHandlerTest, DistributedQueryComponentCustomSortTest, 
TestInitQParser, TaggerTest, TestSolrQueryParser, TestNodeLostTrigger, 
BlobRepositoryCloudTest, TestSizeLimitedDistributedMap, 
ClassificationUpdateProcessorIntegrationTest, TestSortByMinMaxFunction, 
DisMaxRequestHandlerTest, TestSolrCloudWithKerberosAlt, EnumFieldTest, 
MinimalSchemaTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, 
TestBinaryResponseWriter, CreateRoutedAliasTest, TestCustomSort, 
TestLRUStatsCache, HighlighterTest, DistributedFacetPivotSmallTest, 
TestSolrCLIRunExample, CircularListTest, TestDistributedSearch, 
TestAnalyzedSuggestions, TestPivotHelperCode, SparseHLLTest, 
TestRawResponseWriter, TestNonDefinedSimilarityFactory, OrderedExecutorTest, 
TestConfigSets, CdcrRequestHandlerTest, SchemaVersionSpecificBehaviorTest, 
TestPullReplica, BlockJoinFacetDistribTest, DistribJoinFromCollectionTest, 
MergeStrategyTest, NotRequiredUniqueKeyTest, TestDistribIDF, 
CloudMLTQParserTest, FacetPivotSmallTest, TestObjectReleaseTracker, 
TestSweetSpotSimilarityFactory, CdcrBootstrapTest, 
TestLegacyNumericRangeQueryBuilder, TestSearchPerf, SolrSlf4jReporterTest, 
PrimitiveFieldTypeTest, TestSortableTextField, CollectionStateFormat2Test, 
DocValuesMissingTest, NodeLostTriggerIntegrationTest, SecurityConfHandlerTest, 
SolrIndexMetricsTest, RequestHandlersTest, LeaderVoteWaitTimeoutTest, 
AnalysisAfterCoreReloadTest, BasicFunctionalityTest, ConvertedLegacyTest, 
SampleTest, SolrInfoBeanTest, SolrTestCaseJ4Test, TestCrossCoreJoin, 
TestCursorMarkWithoutUniqueKey, TestDistributedGrouping, TestGroupingSearch, 
TestRandomDVFaceting, TestEmbeddedSolrServerAdminHandler, 
TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, 
TestJettySolrRunner, AliasIntegrationTest, CleanupOldIndexTest, 
CloudExitableDirectoryReaderTest, ConcurrentCreateRoutedAliasTest, 
ConfigSetsAPITest, ConnectionManagerTest, DeleteStatusTest, 
FullSolrCloudDistribCmdsTest]
   [junit4] Completed [537/819 (3!)] on J1 in 2668.99s, 1 test, 1 error <<< 
FAILURES!

[...truncated 1014 lines...]
   [junit4] JVM J1: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/temp/junit4-J1-20180626_065017_7827010339845398400990.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/heapdumps/java_pid29211.hprof
 ...
   [junit4] Heap dump file created [460370217 bytes in 14.582 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 9439 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:651:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:585:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid29211.hprof

Total time: 394 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to