Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Windows/848/
Java: 64bit/jdk-15-ea+9 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions 
-XX:+UseZGC

2 tests failed.
FAILED:  org.apache.solr.cloud.RollingRestartTest.test

Error Message:
No overseer designate as leader found after restart #1: 127.0.0.1:53803_

Stack Trace:
java.lang.AssertionError: No overseer designate as leader found after restart 
#1: 127.0.0.1:53803_
        at 
__randomizedtesting.SeedInfo.seed([74BFD65BBA9B6DC:8F1FC2BF1555DB24]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at 
org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:101)
        at 
org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:832)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testAutoAddReplicas

Error Message:
Timed out waiting for trigger .auto_add_replicas to fire after simulated 60s 
(real 1200ms).

Stack Trace:
java.io.IOException: Timed out waiting for trigger .auto_add_replicas to fire 
after simulated 60s (real 1200ms).
        at 
__randomizedtesting.SeedInfo.seed([74BFD65BBA9B6DC:8EEB0E19CFA27AF5]:0)
        at 
org.apache.solr.cloud.autoscaling.sim.SimScenario$SimWaitListener.wait(SimScenario.java:693)
        at 
org.apache.solr.cloud.autoscaling.sim.SimScenario$WaitEvent.execute(SimScenario.java:758)
        at 
org.apache.solr.cloud.autoscaling.sim.SimScenario.run(SimScenario.java:1096)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testAutoAddReplicas(TestSimScenario.java:57)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:832)




Build Log:
[...truncated 14087 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
   [junit4]   2> 731844 INFO  
(SUITE-TestSimScenario-seed#[74BFD65BBA9B6DC]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\server\solr\configsets\_default\conf'
   [junit4]   2> 731872 INFO  
(SUITE-TestSimScenario-seed#[74BFD65BBA9B6DC]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.autoscaling.sim.TestSimScenario_74BFD65BBA9B6DC-001\data-dir-93-001
   [junit4]   2> 731872 WARN  
(SUITE-TestSimScenario-seed#[74BFD65BBA9B6DC]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=31 numCloses=31
   [junit4]   2> 731872 INFO  
(SUITE-TestSimScenario-seed#[74BFD65BBA9B6DC]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 731872 INFO  
(SUITE-TestSimScenario-seed#[74BFD65BBA9B6DC]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 731877 INFO  
(SUITE-TestSimScenario-seed#[74BFD65BBA9B6DC]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 731897 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.SolrTestCaseJ4 ###Starting testAutoAddReplicas
   [junit4]   2> 731936 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 1.      CreateCluster   numNodes=2
   [junit4]   2> 731938 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 CreateCluster   numNodes=2
   [junit4]   2> 732197 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 732197 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 732198 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 732198 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 732199 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 732199 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 732200 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 2.      LoadAutoscaling 
json={'cluster-policy'+:+[{'replica'+:+'<3',+'shard'+:+'#EACH',+'collection'+:+'testCollection','node':'#ANY'}]}&defaultWaitFor=10
   [junit4]   2> 732200 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 LoadAutoscaling 
json={'cluster-policy'+:+[{'replica'+:+'<3',+'shard'+:+'#EACH',+'collection'+:+'testCollection','node':'#ANY'}]}&defaultWaitFor=10
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 732202 DEBUG (ScheduledTrigger-2509-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732202 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 732202 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 732202 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 3.      RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 732202 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 732209 DEBUG (ScheduledTrigger-2509-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732212 DEBUG (simCloudManagerPool-2508-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, 
currentVersion=1
   [junit4]   2> 732213 DEBUG (simCloudManagerPool-2508-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 732213 DEBUG (simCloudManagerPool-2508-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 732236 DEBUG (simCloudManagerPool-2508-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 732237 DEBUG (ScheduledTrigger-2509-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732241 DEBUG (simCloudManagerPool-2508-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 732253 DEBUG (simCloudManagerPool-2508-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testCollection, currentVersion=3
   [junit4]   2> 732253 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 4.      WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 732253 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 732255 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 732255 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 732255 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2, shard1]
   [junit4]   2> 732256 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732276 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732278 DEBUG (simCloudManagerPool-2508-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 732278 DEBUG (simCloudManagerPool-2508-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 732278 DEBUG (simCloudManagerPool-2508-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 732278 DEBUG (simCloudManagerPool-2508-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=5): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 732300 DEBUG (ScheduledTrigger-2509-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732300 DEBUG (simCloudManagerPool-2508-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 732300 DEBUG (simCloudManagerPool-2508-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 732323 DEBUG (simCloudManagerPool-2508-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 732324 DEBUG (simCloudManagerPool-2508-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 732324 DEBUG (simCloudManagerPool-2508-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 732324 DEBUG (simCloudManagerPool-2508-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=7): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 732326 DEBUG (ScheduledTrigger-2509-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 732334 DEBUG (simCloudManagerPool-2508-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 732335 DEBUG (simCloudManagerPool-2508-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 732336 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 732336 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 732336 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 5.      SetEventListener        
trigger=.auto_add_replicas&stage=SUCCEEDED
   [junit4]   2> 732336 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 SetEventListener        
trigger=.auto_add_replicas&stage=SUCCEEDED
   [junit4]   2> 732338 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 6.      KillNodes       node=${_random_node_}
   [junit4]   2> 732338 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 KillNodes       
node=127.0.0.1:10000_solr
   [junit4]   2> 732339 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider  -- created marker: 
/autoscaling/nodeLost/127.0.0.1:10000_solr
   [junit4]   2> 732339 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10001_solr
   [junit4]   2> 732339 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 732340 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 732340 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 7.      WaitEvent       
trigger=.auto_add_replicas&wait=60
   [junit4]   2> 732340 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario                 WaitEvent       
trigger=.auto_add_replicas&wait=60
   [junit4]   2> 732348 DEBUG (simCloudManagerPool-2508-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 732348 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 2
   [junit4]   2> 732348 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10000_solr
   [junit4]   2> 732348 DEBUG (simCloudManagerPool-2508-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 732348 DEBUG (simCloudManagerPool-2508-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 732348 INFO  (simCloudManagerPool-2508-thread-7) [     ] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 3723ms
   [junit4]   2> 732390 DEBUG (ScheduledTrigger-2509-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732416 DEBUG (ScheduledTrigger-2509-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732424 DEBUG (simCloudManagerPool-2508-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=11): {"core_node2":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n2",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 732437 DEBUG (ScheduledTrigger-2509-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732460 DEBUG (ScheduledTrigger-2509-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732481 DEBUG (ScheduledTrigger-2509-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732505 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732536 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732584 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 732584 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:10000_solr]
   [junit4]   2> 732584 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 732584 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
.scheduled_maintenance]
   [junit4]   2> 732584 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 732586 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 732586 DEBUG (ScheduledTrigger-2509-thread-4) [     ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 732616 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 732616 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}} with context 
properties: {BEFORE_ACTION=[auto_add_replicas_plan]}
   [junit4]   2> 732624 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10001_solr&inPlaceMove=true&replica=core_node1
   [junit4]   2> 732624 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10001_solr&inPlaceMove=true&replica=core_node4
   [junit4]   2> 732624 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}} with context 
properties: {operations=[{
   [junit4]   2>   
"class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica",
   [junit4]   2>   "method":"GET",
   [junit4]   2>   "params.action":"MOVEREPLICA",
   [junit4]   2>   "params.collection":"testCollection",
   [junit4]   2>   "params.targetNode":"127.0.0.1:10001_solr",
   [junit4]   2>   "params.inPlaceMove":"true",
   [junit4]   2>   "params.replica":"core_node1"}, {
   [junit4]   2>   
"class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica",
   [junit4]   2>   "method":"GET",
   [junit4]   2>   "params.action":"MOVEREPLICA",
   [junit4]   2>   "params.collection":"testCollection",
   [junit4]   2>   "params.targetNode":"127.0.0.1:10001_solr",
   [junit4]   2>   "params.inPlaceMove":"true",
   [junit4]   2>   "params.replica":"core_node4"}], 
AFTER_ACTION=[auto_add_replicas_plan], BEFORE_ACTION=[auto_add_replicas_plan, 
execute_plan]}
   [junit4]   2> 732624 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Executing operation: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10001_solr&inPlaceMove=true&replica=core_node1
   [junit4]   2> 732792 DEBUG (simCloudManagerPool-2508-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node6":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n5",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"down",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 732912 DEBUG (simCloudManagerPool-2508-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=12
   [junit4]   2> 732916 DEBUG (simCloudManagerPool-2508-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 732917 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Executing operation: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10001_solr&inPlaceMove=true&replica=core_node4
   [junit4]   2> 732917 DEBUG (simCloudManagerPool-2508-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=13
   [junit4]   2> 732917 DEBUG (simCloudManagerPool-2508-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 733091 DEBUG (simCloudManagerPool-2508-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node8":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n7",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"down",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 733373 DEBUG (simCloudManagerPool-2508-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=14
   [junit4]   2> 733373 DEBUG (simCloudManagerPool-2508-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 733506 DEBUG (MetricsHistoryHandler-2512-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=15
   [junit4]   2> 733506 DEBUG (MetricsHistoryHandler-2512-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 733584 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 733584 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 733584 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 733584 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 733588 ERROR (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Unexpected Exception while querying status of 
requestId=.auto_add_replicas/10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi/1
   [junit4]   2>           => java.io.IOException: 
java.lang.InterruptedException
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:732)
   [junit4]   2> java.io.IOException: java.lang.InterruptedException
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:732)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:196)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:113)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:326)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
~[?:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) 
~[?:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:832) [?:?]
   [junit4]   2> Caused by: java.lang.InterruptedException
   [junit4]   2>        at 
java.util.concurrent.FutureTask.awaitDone(FutureTask.java:418) ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.get(FutureTask.java:203) ~[?:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:730)
 ~[java/:?]
   [junit4]   2>        ... 9 more
   [junit4]   2> 733589 WARN  (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.SystemLogListener Exception sending event. Collection: .system, 
event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}, exception: 
java.io.IOException: already closed
   [junit4]   2> 733589 WARN  (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Exception executing actions
   [junit4]   2>           => 
org.apache.solr.cloud.autoscaling.TriggerActionException: Error processing 
action for trigger event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:329)
   [junit4]   2> org.apache.solr.cloud.autoscaling.TriggerActionException: 
Error processing action for trigger event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:329)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
~[?:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) 
~[?:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:832) [?:?]
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Unexpected 
exception while processing event: {
   [junit4]   2>   "id":"10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":294732113554500,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[294732113554500],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":294743938929500,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:180)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:326)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Unexpected 
exception executing operation: 
action=MOVEREPLICA&async=.auto_add_replicas/10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi/1&waitForFinalState=true&collection=testCollection&targetNode=127.0.0.1:10001_solr&inPlaceMove=true&replica=core_node4
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:170)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:326)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> Caused by: java.io.IOException: java.lang.InterruptedException
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:732)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:196)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:113)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:326)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> Caused by: java.lang.InterruptedException
   [junit4]   2>        at 
java.util.concurrent.FutureTask.awaitDone(FutureTask.java:418) ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.get(FutureTask.java:203) ~[?:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:730)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:196)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:113)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:326)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> 733589 DEBUG (AutoscalingActionExecutor-2510-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers -- processing took 48635 ms for event 
id=10c0eaaeeac44Tcb40i30mtvbgjm51w4ur1ioi
   [junit4]   2> 733589 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 733589 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 733589 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 733590 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.SolrTestCaseJ4 ###Ending testAutoAddReplicas
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSimScenario 
-Dtests.method=testAutoAddReplicas -Dtests.seed=74BFD65BBA9B6DC 
-Dtests.slow=true -Dtests.locale=en-MG -Dtests.timezone=SystemV/AST4 
-Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   1.71s J1 | TestSimScenario.testAutoAddReplicas <<<
   [junit4]    > Throwable #1: java.io.IOException: Timed out waiting for 
trigger .auto_add_replicas to fire after simulated 60s (real 1200ms).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([74BFD65BBA9B6DC:8EEB0E19CFA27AF5]:0)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.SimScenario$SimWaitListener.wait(SimScenario.java:693)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.SimScenario$WaitEvent.execute(SimScenario.java:758)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.SimScenario.run(SimScenario.java:1096)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testAutoAddReplicas(TestSimScenario.java:57)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    >        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    >        at 
java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4]   2> 733607 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.SolrTestCaseJ4 ###Starting testSuggestions
   [junit4]   2> 733611 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 1.  CreateCluster   numNodes=2
   [junit4]   2> 733611 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             CreateCluster   numNodes=2
   [junit4]   2> 733668 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10002_solr
   [junit4]   2> 733668 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 733668 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 733668 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 733668 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 2.  RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 733668 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 733668 DEBUG (simCloudManagerPool-2514-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, 
currentVersion=1
   [junit4]   2> 733668 DEBUG (simCloudManagerPool-2514-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 733668 DEBUG (simCloudManagerPool-2514-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 733682 DEBUG (simCloudManagerPool-2514-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 733682 DEBUG (simCloudManagerPool-2514-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 733697 DEBUG (simCloudManagerPool-2514-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 733697 DEBUG (simCloudManagerPool-2514-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 733697 DEBUG (simCloudManagerPool-2514-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 733697 DEBUG (simCloudManagerPool-2514-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 733697 DEBUG (simCloudManagerPool-2514-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testCollection, currentVersion=4
   [junit4]   2> 733698 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 3.  WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 733699 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 733708 DEBUG (simCloudManagerPool-2514-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 733709 DEBUG (simCloudManagerPool-2514-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 733709 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 733709 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 733709 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2]
   [junit4]   2> 733709 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 733710 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 733713 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2]
   [junit4]   2> 733716 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2]
   [junit4]   2> 733716 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 733716 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 733720 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2]
   [junit4]   2> 733721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 733721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 733721 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 733723 DEBUG (ScheduledTrigger-2515-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733732 DEBUG (simCloudManagerPool-2514-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 733732 DEBUG (simCloudManagerPool-2514-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 733732 DEBUG (simCloudManagerPool-2514-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 733732 DEBUG (simCloudManagerPool-2514-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=7): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 733744 DEBUG (ScheduledTrigger-2515-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733744 DEBUG (simCloudManagerPool-2514-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 733744 DEBUG (simCloudManagerPool-2514-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 733744 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 733746 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 733746 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 4.  CtxSet  key=myNode&value=${_random_node_}
   [junit4]   2> 733746 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             CtxSet  
key=myNode&value=127.0.0.1:10002_solr
   [junit4]   2> 733746 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 5.  RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 733746 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr
   [junit4]   2> 733748 INFO  (simCloudManagerPool-2514-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 733748 INFO  (simCloudManagerPool-2514-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 733766 DEBUG (ScheduledTrigger-2515-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733766 DEBUG (simCloudManagerPool-2514-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 733770 DEBUG (simCloudManagerPool-2514-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 733770 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 6.  RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 733770 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr
   [junit4]   2> 733780 DEBUG (simCloudManagerPool-2514-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 733788 DEBUG (ScheduledTrigger-2515-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733788 DEBUG (simCloudManagerPool-2514-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 733788 INFO  (simCloudManagerPool-2514-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 733788 INFO  (simCloudManagerPool-2514-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 733800 DEBUG (simCloudManagerPool-2514-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 733815 DEBUG (simCloudManagerPool-2514-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 733816 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 7.  LoopOp  iterations=${iterative}
   [junit4]   2> 733816 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             LoopOp  iterations=0
   [junit4]   2> 733816 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 8.  LoopOp  iterations=${justCalc}
   [junit4]   2> 733816 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             LoopOp  iterations=1
   [junit4]   2> 733816 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 1:
   [junit4]   2> 733816 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions 
   [junit4]   2> 733820 DEBUG (ScheduledTrigger-2515-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733839 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=12
   [junit4]   2> 733840 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 733848 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 733849 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - SaveSnapshot 
path=C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.autoscaling.sim.TestSimScenario_74BFD65BBA9B6DC-001\tempDir-002/snapshot/0
   [junit4]   2> 733849 DEBUG (ScheduledTrigger-2515-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733856 WARN  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimUtils V2 action SET_CLUSTER_PROPERTY_OBJ has no equivalent V1 
action
   [junit4]   2> 733856 WARN  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimUtils V2 action GET_NODES has no equivalent V1 action
   [junit4]   2> 733860 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from 
SimDistribStateManager
   [junit4]   2> 733908 DEBUG (ScheduledTrigger-2515-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733940 DEBUG (ScheduledTrigger-2515-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733972 DEBUG (ScheduledTrigger-2515-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 733974 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 9.  Dump    redact=true
   [junit4]   2> 733974 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             Dump    redact=true
   [junit4]   2> 733976 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from 
SimDistribStateManager
   [junit4]   2> 733990 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 733990 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 733990 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 733990 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 733990 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 733990 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 733990 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 733990 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 1.  CreateCluster   numNodes=2
   [junit4]   2> 733990 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             CreateCluster   numNodes=2
   [junit4]   2> 734008 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10004_solr
   [junit4]   2> 734010 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 734010 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 734010 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 734010 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 2.  RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 734010 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 734011 DEBUG (simCloudManagerPool-2520-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, 
currentVersion=1
   [junit4]   2> 734011 DEBUG (simCloudManagerPool-2520-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 734011 DEBUG (simCloudManagerPool-2520-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 734016 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 734016 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 734017 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 734017 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 734017 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10005_solr]
   [junit4]   2> 734017 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 734017 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 734020 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734021 DEBUG (simCloudManagerPool-2520-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 734021 DEBUG (simCloudManagerPool-2520-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 734024 DEBUG (simCloudManagerPool-2520-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testCollection, currentVersion=3
   [junit4]   2> 734024 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 3.  WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 734024 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 734024 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 734024 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 734024 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2, shard1]
   [junit4]   2> 734040 DEBUG (simCloudManagerPool-2520-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 734040 DEBUG (simCloudManagerPool-2520-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 734040 DEBUG (simCloudManagerPool-2520-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 734040 DEBUG (simCloudManagerPool-2520-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=5): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 734040 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734051 DEBUG (simCloudManagerPool-2520-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 734051 DEBUG (simCloudManagerPool-2520-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 734051 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 734051 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 734051 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.CloudUtil -- shards without leaders: [shard2]
   [junit4]   2> 734063 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734063 DEBUG (simCloudManagerPool-2520-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 734063 DEBUG (simCloudManagerPool-2520-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 734063 DEBUG (simCloudManagerPool-2520-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 734063 DEBUG (simCloudManagerPool-2520-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=8): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 734075 DEBUG (simCloudManagerPool-2520-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 734075 DEBUG (simCloudManagerPool-2520-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 734075 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 734075 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 734075 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 4.  CtxSet  key=myNode&value=${_random_node_}
   [junit4]   2> 734075 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             CtxSet  
key=myNode&value=127.0.0.1:10004_solr
   [junit4]   2> 734075 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 5.  RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 734075 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10004_solr
   [junit4]   2> 734076 INFO  (simCloudManagerPool-2520-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10004_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 734076 INFO  (simCloudManagerPool-2520-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 734084 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734091 DEBUG (simCloudManagerPool-2520-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 734091 DEBUG (simCloudManagerPool-2520-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 734091 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 6.  RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 734091 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10004_solr
   [junit4]   2> 734093 DEBUG (simCloudManagerPool-2520-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 734093 DEBUG (simCloudManagerPool-2520-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 734093 INFO  (simCloudManagerPool-2520-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10004_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 734093 INFO  (simCloudManagerPool-2520-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 734105 DEBUG (simCloudManagerPool-2520-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=12
   [junit4]   2> 734105 DEBUG (simCloudManagerPool-2520-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 734106 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario 7.  LoopOp  iterations=${iterative}
   [junit4]   2> 734106 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario             LoopOp  iterations=10
   [junit4]   2> 734106 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 1:
   [junit4]   2> 734106 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions 
   [junit4]   2> 734106 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=13
   [junit4]   2> 734106 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 734108 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 734108 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions     
   [junit4]   2> 734120 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734140 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734163 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734208 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734231 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734236 DEBUG (simCloudManagerPool-2520-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node10":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n9",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10005_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 734252 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734274 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734295 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734316 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734336 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734354 DEBUG (simCloudManagerPool-2520-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=14
   [junit4]   2> 734355 DEBUG (simCloudManagerPool-2520-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 734355 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest       
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10004_solr
   [junit4]   2> 734356 DEBUG (simCloudManagerPool-2520-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=15
   [junit4]   2> 734356 DEBUG (simCloudManagerPool-2520-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 734356 INFO  (simCloudManagerPool-2520-thread-9) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10004_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 734356 INFO  (simCloudManagerPool-2520-thread-9) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 734361 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734371 DEBUG (simCloudManagerPool-2520-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=16
   [junit4]   2> 734371 DEBUG (simCloudManagerPool-2520-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 16
   [junit4]   2> 734372 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest       
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10004_solr
   [junit4]   2> 734377 DEBUG (simCloudManagerPool-2520-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=17
   [junit4]   2> 734377 DEBUG (simCloudManagerPool-2520-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 17
   [junit4]   2> 734377 INFO  (simCloudManagerPool-2520-thread-10) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10004_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 734378 INFO  (simCloudManagerPool-2520-thread-10) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 734383 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734389 DEBUG (simCloudManagerPool-2520-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=18
   [junit4]   2> 734389 DEBUG (simCloudManagerPool-2520-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 18
   [junit4]   2> 734389 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 2:
   [junit4]   2> 734389 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions 
   [junit4]   2> 734389 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=19
   [junit4]   2> 734389 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 19
   [junit4]   2> 734392 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 734392 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions     
   [junit4]   2> 734404 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734428 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734448 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734471 DEBUG (ScheduledTrigger-2521-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734492 DEBUG (ScheduledTrigger-2521-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734512 DEBUG (simCloudManagerPool-2520-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node16":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n15",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10005_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 734517 DEBUG (ScheduledTrigger-2521-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734544 DEBUG (ScheduledTrigger-2521-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734572 DEBUG (ScheduledTrigger-2521-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734593 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734627 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734629 DEBUG (simCloudManagerPool-2520-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=20
   [junit4]   2> 734629 DEBUG (simCloudManagerPool-2520-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 20
   [junit4]   2> 734629 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest       
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10004_solr
   [junit4]   2> 734648 DEBUG (ScheduledTrigger-2521-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734669 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734672 DEBUG (simCloudManagerPool-2520-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=21
   [junit4]   2> 734672 DEBUG (simCloudManagerPool-2520-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 21
   [junit4]   2> 734672 INFO  (simCloudManagerPool-2520-thread-12) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10004_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 734672 INFO  (simCloudManagerPool-2520-thread-12) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 734692 DEBUG (simCloudManagerPool-2520-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=22
   [junit4]   2> 734692 DEBUG (simCloudManagerPool-2520-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 22
   [junit4]   2> 734692 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest       
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10004_solr
   [junit4]   2> 734696 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734710 DEBUG (simCloudManagerPool-2520-thread-13) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=23
   [junit4]   2> 734710 DEBUG (simCloudManagerPool-2520-thread-13) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 23
   [junit4]   2> 734710 INFO  (simCloudManagerPool-2520-thread-13) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10004_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 734710 INFO  (simCloudManagerPool-2520-thread-13) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 734718 DEBUG (ScheduledTrigger-2521-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 734724 DEBUG (simCloudManagerPool-2520-thread-13) [     ] 
o.a.s.c

[...truncated too long message...]

b0f: rootName = null, domain = solr.jetty, service url = null, agent id = null] 
for registry solr.jetty / com.codahale.metrics.MetricRegistry@37391f77
   [junit4]   2> 1116874 INFO  (closeThreadPool-4144-thread-5) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@3280adfd: rootName = null, 
domain = solr.jetty, service url = null, agent id = null] for registry 
solr.jetty / com.codahale.metrics.MetricRegistry@37391f77
   [junit4]   2> 1116874 INFO  (closeThreadPool-4144-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1116874 INFO  (closeThreadPool-4144-thread-5) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1116878 INFO  (closeThreadPool-4151-thread-1) [     ] 
o.a.s.c.Overseer Overseer (id=72076928660733956-127.0.0.1:53803_-n_0000000848) 
closing
   [junit4]   2> 1116878 INFO  
(OverseerStateUpdate-72076928660733956-127.0.0.1:53803_-n_0000000848) 
[n:127.0.0.1:53803_     ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:53803_
   [junit4]   2> 1116878 INFO  
(OverseerAutoScalingTriggerThread-72076928660733956-127.0.0.1:53803_-n_0000000848)
 [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 1116880 INFO  (closeThreadPool-4151-thread-2) [     ] 
o.a.s.c.Overseer Overseer (id=72076928660733956-127.0.0.1:53803_-n_0000000848) 
closing
   [junit4]   2> 1116978 INFO  (closeThreadPool-4144-thread-2) [     ] 
o.a.s.c.Overseer Overseer (id=72076928660733956-127.0.0.1:53803_-n_0000000848) 
closing
   [junit4]   2> 1116980 INFO  (closeThreadPool-4144-thread-2) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@55184893{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 1116981 INFO  (closeThreadPool-4144-thread-2) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@4aa22c6d{/,null,UNAVAILABLE}
   [junit4]   2> 1116981 INFO  (closeThreadPool-4144-thread-2) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1117081 INFO  (closeThreadPool-4144-thread-5) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@752c59f5{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 1117081 INFO  (closeThreadPool-4144-thread-5) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@76d4f92b{/,null,UNAVAILABLE}
   [junit4]   2> 1117082 INFO  (closeThreadPool-4144-thread-5) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1117083 INFO  
(TEST-RollingRestartTest.test-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1117292 WARN  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        12      /solr/collections/collection1/state.json
   [junit4]   2>        5       /solr/aliases.json
   [junit4]   2>        3       /solr/packages.json
   [junit4]   2>        3       /solr/security.json
   [junit4]   2>        3       /solr/configs/conf1
   [junit4]   2>        2       /solr/collections/collection1/terms/shard1
   [junit4]   2>        2       /solr/collections/collection1/terms/shard2
   [junit4]   2>        2       
/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        26      /solr/clusterstate.json
   [junit4]   2>        12      /solr/collections/control_collection/state.json
   [junit4]   2>        5       /solr/clusterprops.json
   [junit4]   2>        3       
/solr/overseer_elect/election/72076928660733964-127.0.0.1:53937_-n_0000000005
   [junit4]   2>        2       
/solr/overseer_elect/election/72076928660733961-127.0.0.1:53910_-n_0000000001
   [junit4]   2>        2       
/solr/overseer_elect/election/72076928660733956-127.0.0.1:53803_-n_0000000000
   [junit4]   2>        2       /solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        27      /solr/overseer/queue
   [junit4]   2>        21      /solr/overseer/collection-queue-work
   [junit4]   2>        16      /solr/live_nodes
   [junit4]   2>        5       /solr/collections
   [junit4]   2>        3       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        2       /solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2>        2       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1117299 INFO  
(TEST-RollingRestartTest.test-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:53685
   [junit4]   2> 1117299 INFO  
(TEST-RollingRestartTest.test-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53685
   [junit4]   2> 1117299 INFO  
(TEST-RollingRestartTest.test-seed#[74BFD65BBA9B6DC]) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 53685
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RollingRestartTest 
-Dtests.method=test -Dtests.seed=74BFD65BBA9B6DC -Dtests.slow=true 
-Dtests.locale=en-PG -Dtests.timezone=Africa/Conakry -Dtests.asserts=true 
-Dtests.file.encoding=Cp1252
   [junit4] FAILURE 76.2s J0 | RollingRestartTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: No overseer designate 
as leader found after restart #1: 127.0.0.1:53803_
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([74BFD65BBA9B6DC:8F1FC2BF1555DB24]:0)
   [junit4]    >        at 
org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:101)
   [junit4]    >        at 
org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    >        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    >        at 
java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
   [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.RollingRestartTest_74BFD65BBA9B6DC-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84): {}, 
docValues:{}, maxPointsInLeafNode=1696, maxMBSortInHeap=5.097510160568676, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@2cf0d1a0),
 locale=en-PG, timezone=Africa/Conakry
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 15-ea 
(64-bit)/cpus=6,threads=1,free=398458880,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [IndexSizeTriggerTest, 
BlockJoinFacetRandomTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, 
TestSolrCloudWithKerberosAlt, TestTlogReplayVsRecovery, 
OverseerSolrResponseTest, TestJoin, TestScoreJoinQPNoScore, 
CloneFieldUpdateProcessorFactoryTest, DeleteReplicaTest, 
TestNonDefinedSimilarityFactory, BaseCdcrDistributedZkTest, HighlighterTest, 
ManagedSchemaRoundRobinCloudTest, TestAnalyzeInfixSuggestions, 
TestPayloadCheckQParserPlugin, TestConfigsApi, TestGeoJSONResponseWriter, 
CreateCollectionCleanupTest, TestDistributedMissingSort, 
TestDynamicFieldCollectionResource, OutOfBoxZkACLAndCredentialsProvidersTest, 
TestInitQParser, SolrXmlInZkTest, ScheduledTriggerIntegrationTest, 
SolrShardReporterTest, TestSimPolicyCloud, NodeLostTriggerIntegrationTest, 
TestElisionMultitermQuery, CustomHighlightComponentTest, 
SpatialHeatmapFacetsTest, CircularListTest, TestLegacyField, TestRTimerTree, 
CoreAdminRequestStatusTest, UUIDUpdateProcessorFallbackTest, TestSearcherReuse, 
TestSimExtremeIndexing, TestValueSourceCache, TestDFRSimilarityFactory, 
SuggestComponentTest, TestRequestStatusCollectionAPI, AddBlockUpdateTest, 
TestConfigSets, LeaderFailureAfterFreshStartTest, 
HttpPartitionWithTlogReplicasTest, AuditLoggerIntegrationTest, 
SpellCheckCollatorTest, ZkNodePropsTest, TestMinHashQParser, UpdateParamsTest, 
TestHdfsUpdateLog, TaggingAttributeTest, SignatureUpdateProcessorFactoryTest, 
ExecutePlanActionTest, TestRawResponseWriter, 
TestWaitForStateWithJettyShutdowns, NumberUtilsTest, 
ConfigureRecoveryStrategyTest, CloudMLTQParserTest, MoreLikeThisComponentTest, 
PKIAuthenticationIntegrationTest, RollingRestartTest]
   [junit4] Completed [374/901 (2!)] on J0 in 76.39s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 46688 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Windows/848/consoleText

[repro] Revision: 1573d3d2d83c5008dd179736feb7218906830fb0

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops 
-XX:+UnlockExperimentalVMOptions -XX:+UseZGC"

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr\core
[repro]       TestSimScenario
[repro]       RollingRestartTest
[repro] ant compile-test

[...truncated 3445 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 
-Dtests.class="*.TestSimScenario|*.RollingRestartTest" 
-Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops 
-XX:+UnlockExperimentalVMOptions -XX:+UseZGC" -Dtests.seed=74BFD65BBA9B6DC 
-Dtests.slow=true -Dtests.locale=en-MG -Dtests.timezone=SystemV/AST4 
-Dtests.asserts=true -Dtests.file.encoding=Cp1252

[...truncated 117 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.RollingRestartTest
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
[repro] Exiting with code 0

[...truncated 78 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to