Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/27062/
Java: 64bit/jdk-12.0.2 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard

Error Message:
java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to 
the latest znodeVersion

Stack Trace:
java.lang.AssertionError: java.util.concurrent.TimeoutException: 
OverseerTriggerThread never caught up to the latest znodeVersion
        at 
__randomizedtesting.SeedInfo.seed([47C1DE3C293F52EB:9CCB735037CA6E54]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard(TestSimScenario.java:164)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)




Build Log:
[...truncated 12650 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
   [junit4]   2> 170964 INFO  
(SUITE-TestSimScenario-seed#[47C1DE3C293F52EB]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 170964 INFO  
(SUITE-TestSimScenario-seed#[47C1DE3C293F52EB]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 170966 INFO  
(SUITE-TestSimScenario-seed#[47C1DE3C293F52EB]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_47C1DE3C293F52EB-001/data-dir-12-001
   [junit4]   2> 170966 WARN  
(SUITE-TestSimScenario-seed#[47C1DE3C293F52EB]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 170966 INFO  
(SUITE-TestSimScenario-seed#[47C1DE3C293F52EB]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 170966 INFO  
(SUITE-TestSimScenario-seed#[47C1DE3C293F52EB]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 170968 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.SolrTestCaseJ4 ###Starting testAutoAddReplicas
   [junit4]   2> 170974 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 1.     CreateCluster   numNodes=2
   [junit4]   2> 170975 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                CreateCluster   numNodes=2
   [junit4]   2> 170977 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.SolrPaths solr home defaulted to 'solr/' (could not find system 
property or JNDI)
   [junit4]   2> 170988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 170988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 170988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 170988 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 170988 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 170989 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10000_solr]
   [junit4]   2> 170990 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 170991 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 2.     LoadAutoscaling 
json={'cluster-policy'+:+[{'replica'+:+'<3',+'shard'+:+'#EACH',+'collection'+:+'testCollection','node':'#ANY'}]}&defaultWaitFor=10
   [junit4]   2> 170991 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                LoadAutoscaling 
json={'cluster-policy'+:+[{'replica'+:+'<3',+'shard'+:+'#EACH',+'collection'+:+'testCollection','node':'#ANY'}]}&defaultWaitFor=10
   [junit4]   2> 170992 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 170996 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 170996 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 170996 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 170996 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 1
   [junit4]   2> 170997 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 170997 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 170997 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 170997 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 170998 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 3.     RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 170998 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 171001 DEBUG (simCloudManagerPool-3017-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection
   [junit4]   2> 171017 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171032 DEBUG (simCloudManagerPool-3017-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 171033 DEBUG (simCloudManagerPool-3017-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=2): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171037 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171054 DEBUG (simCloudManagerPool-3017-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 171054 DEBUG (simCloudManagerPool-3017-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=4): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171055 DEBUG (simCloudManagerPool-3017-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection
   [junit4]   2> 171055 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 4.     WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171055 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171058 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171065 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 5.     SetEventListener        
trigger=.auto_add_replicas&stage=SUCCEEDED
   [junit4]   2> 171066 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                SetEventListener        
trigger=.auto_add_replicas&stage=SUCCEEDED
   [junit4]   2> 171066 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 6.     KillNodes       node=${_random_node_}
   [junit4]   2> 171067 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                KillNodes       node=127.0.0.1:10001_solr
   [junit4]   2> 171067 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider  -- created marker: 
/autoscaling/nodeLost/127.0.0.1:10001_solr
   [junit4]   2> 171069 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 7.     WaitEvent       
trigger=.auto_add_replicas&wait=60
   [junit4]   2> 171069 DEBUG (simCloudManagerPool-3017-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 171069 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                WaitEvent       
trigger=.auto_add_replicas&wait=60
   [junit4]   2> 171069 INFO  (simCloudManagerPool-3017-thread-6) [     ] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 4271ms
   [junit4]   2> 171078 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 2
   [junit4]   2> 171078 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10001_solr
   [junit4]   2> 171098 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171118 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171138 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171154 DEBUG (simCloudManagerPool-3017-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=7): {"core_node4":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n4",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171158 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171179 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171199 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171219 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171239 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171259 DEBUG (ScheduledTrigger-3018-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171280 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 171280 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:10001_solr]
   [junit4]   2> 171281 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":857034530308051,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[857034530308051],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}}
   [junit4]   2> 171281 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
.scheduled_maintenance]
   [junit4]   2> 171282 DEBUG (ScheduledTrigger-3018-thread-2) [     ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":857034530308051,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[857034530308051],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":857044698712851,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}}
   [junit4]   2> 171283 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":857034530308051,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[857034530308051],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":857044698712851,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}}
   [junit4]   2> 171283 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":857034530308051,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[857034530308051],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":857044698712851,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}} with context 
properties: {BEFORE_ACTION=[auto_add_replicas_plan]}
   [junit4]   2> 171286 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10000_solr&inPlaceMove=true&replica=core_node2
   [junit4]   2> 171286 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10000_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 171286 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":857034530308051,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[857034530308051],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":857044698712851,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}} with context 
properties: {operations=[{
   [junit4]   2>   
"class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica",
   [junit4]   2>   "method":"GET",
   [junit4]   2>   "params.action":"MOVEREPLICA",
   [junit4]   2>   "params.collection":"testCollection",
   [junit4]   2>   "params.targetNode":"127.0.0.1:10000_solr",
   [junit4]   2>   "params.inPlaceMove":"true",
   [junit4]   2>   "params.replica":"core_node2"}, {
   [junit4]   2>   
"class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica",
   [junit4]   2>   "method":"GET",
   [junit4]   2>   "params.action":"MOVEREPLICA",
   [junit4]   2>   "params.collection":"testCollection",
   [junit4]   2>   "params.targetNode":"127.0.0.1:10000_solr",
   [junit4]   2>   "params.inPlaceMove":"true",
   [junit4]   2>   "params.replica":"core_node3"}], 
AFTER_ACTION=[auto_add_replicas_plan], BEFORE_ACTION=[auto_add_replicas_plan, 
execute_plan]}
   [junit4]   2> 171287 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Executing operation: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10000_solr&inPlaceMove=true&replica=core_node2
   [junit4]   2> 171389 DEBUG (simCloudManagerPool-3017-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node6":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n5",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"down",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171501 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Executing operation: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10000_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 171601 DEBUG (simCloudManagerPool-3017-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node8":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n7",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10000_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"down",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171713 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":857034530308051,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[857034530308051],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":857044698712851,
   [junit4]   2>     "nodeNames":["127.0.0.1:10001_solr"]}}
   [junit4]   2> 171713 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
   [junit4]   2> 171713 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 171713 DEBUG (AutoscalingActionExecutor-3019-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers -- processing took 21515 ms for event 
id=30b77e6bd3fd3Twbxtzs5zbw8m02o5ubx3z9db
   [junit4]   2> 171713 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 8.     WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171713 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171713 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 9.     SaveSnapshot    path=${snapshotPath}
   [junit4]   2> 171713 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario                SaveSnapshot    
path=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_47C1DE3C293F52EB-001/tempDir-001/snapshot
   [junit4]   2> 171716 WARN  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimUtils V2 action SET_CLUSTER_PROPERTY_OBJ has no equivalent V1 
action
   [junit4]   2> 171716 WARN  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimUtils V2 action GET_NODES has no equivalent V1 action
   [junit4]   2> 171718 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 23 resources from 
SimDistribStateManager
   [junit4]   2> 171732 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 171732 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 171732 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 171732 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 171732 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 171732 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 171732 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 171734 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - loaded snapshot of 23 resources
   [junit4]   2> 171734 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.SolrTestCaseJ4 ###Ending testAutoAddReplicas
   [junit4]   2> 171736 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.SolrTestCaseJ4 ###Starting testSuggestions
   [junit4]   2> 171737 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 1. CreateCluster   numNodes=2
   [junit4]   2> 171737 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            CreateCluster   numNodes=2
   [junit4]   2> 171738 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10002_solr
   [junit4]   2> 171738 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 171738 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 171738 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 171738 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 171738 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 171739 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 171739 DEBUG (ScheduledTrigger-3024-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171739 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 3. RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 171739 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 171739 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 171739 DEBUG (simCloudManagerPool-3023-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection
   [junit4]   2> 171759 DEBUG (ScheduledTrigger-3024-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171760 DEBUG (simCloudManagerPool-3023-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 171760 DEBUG (simCloudManagerPool-3023-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=2): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171779 DEBUG (ScheduledTrigger-3024-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171781 DEBUG (simCloudManagerPool-3023-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 171781 DEBUG (simCloudManagerPool-3023-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=4): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171781 DEBUG (simCloudManagerPool-3023-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection
   [junit4]   2> 171781 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 4. WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171781 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171791 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 5. CtxSet  key=myNode&value=${_random_node_}
   [junit4]   2> 171791 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            CtxSet  key=myNode&value=127.0.0.1:10003_solr
   [junit4]   2> 171791 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 6. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 171791 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr
   [junit4]   2> 171792 INFO  (simCloudManagerPool-3023-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 171792 INFO  (simCloudManagerPool-3023-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 171799 DEBUG (ScheduledTrigger-3024-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171802 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 7. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 171802 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10003_solr
   [junit4]   2> 171803 INFO  (simCloudManagerPool-3023-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10003_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 171803 INFO  (simCloudManagerPool-3023-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 171813 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 8. LoopOp  iterations=${iterative}
   [junit4]   2> 171813 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            LoopOp  iterations=0
   [junit4]   2> 171813 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 9. LoopOp  iterations=${justCalc}
   [junit4]   2> 171813 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            LoopOp  iterations=1
   [junit4]   2> 171813 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 1 :
   [junit4]   2> 171813 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 171818 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 171818 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - SaveSnapshot        
path=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_47C1DE3C293F52EB-001/tempDir-002/snapshot/0)
   [junit4]   2> 171818 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from 
SimDistribStateManager
   [junit4]   2> 171819 DEBUG (ScheduledTrigger-3024-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171821 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 10.        Dump    redact=true
   [junit4]   2> 171821 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            Dump    redact=true
   [junit4]   2> 171822 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from 
SimDistribStateManager
   [junit4]   2> 171827 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 171827 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2>           => java.lang.InterruptedException
   [junit4]   2>        at 
java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
 ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2090)
 ~[?:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:206)
 ~[java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:835) [?:?]
   [junit4]   2> 171827 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 171827 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 171827 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 171827 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 171827 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 171827 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 1. CreateCluster   numNodes=2
   [junit4]   2> 171827 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            CreateCluster   numNodes=2
   [junit4]   2> 171830 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10004_solr
   [junit4]   2> 171830 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 171830 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 171830 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 171830 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 171831 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10005_solr]
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 171831 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 171831 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171832 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 171832 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 171837 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 3. RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 171837 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 171837 DEBUG (simCloudManagerPool-3029-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection
   [junit4]   2> 171852 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171861 DEBUG (simCloudManagerPool-3029-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 171861 DEBUG (simCloudManagerPool-3029-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=2): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10005_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171872 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171883 DEBUG (simCloudManagerPool-3029-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 171883 DEBUG (simCloudManagerPool-3029-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=4): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10005_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 171883 DEBUG (simCloudManagerPool-3029-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testCollection
   [junit4]   2> 171883 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 4. WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171883 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 171892 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171894 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 5. CtxSet  key=myNode&value=${_random_node_}
   [junit4]   2> 171894 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            CtxSet  key=myNode&value=127.0.0.1:10005_solr
   [junit4]   2> 171894 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 6. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 171894 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr
   [junit4]   2> 171894 INFO  (simCloudManagerPool-3029-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 171895 INFO  (simCloudManagerPool-3029-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 171905 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 7. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 171905 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr
   [junit4]   2> 171906 INFO  (simCloudManagerPool-3029-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 171906 INFO  (simCloudManagerPool-3029-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 171912 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171917 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 8. LoopOp  iterations=${iterative}
   [junit4]   2> 171917 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario            LoopOp  iterations=10
   [junit4]   2> 171917 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 1 :
   [junit4]   2> 171917 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 171918 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 171918 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 171933 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171953 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171973 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 171993 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172013 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172019 DEBUG (simCloudManagerPool-3029-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node10":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n9",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 172033 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172054 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172074 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172094 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172114 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172130 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172131 INFO  (simCloudManagerPool-3029-thread-9) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172131 INFO  (simCloudManagerPool-3029-thread-9) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172134 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172141 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172141 INFO  (simCloudManagerPool-3029-thread-10) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172141 INFO  (simCloudManagerPool-3029-thread-10) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172152 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 2 :
   [junit4]   2> 172152 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 172152 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 172152 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 172154 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172174 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172194 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172214 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172234 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172253 DEBUG (simCloudManagerPool-3029-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node16":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n15",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 172254 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172274 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172294 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172315 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172335 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172355 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172363 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172364 INFO  (simCloudManagerPool-3029-thread-12) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172364 INFO  (simCloudManagerPool-3029-thread-12) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172374 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172374 INFO  (simCloudManagerPool-3029-thread-13) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172374 INFO  (simCloudManagerPool-3029-thread-13) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172375 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172385 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 3 :
   [junit4]   2> 172385 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 172386 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 172386 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 172395 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172415 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172435 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172455 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172475 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172486 DEBUG (simCloudManagerPool-3029-thread-14) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node22":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n21",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10005_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10005_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 172495 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172515 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172535 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172556 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172576 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172596 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172597 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172598 INFO  (simCloudManagerPool-3029-thread-15) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172598 INFO  (simCloudManagerPool-3029-thread-15) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172609 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172610 INFO  (simCloudManagerPool-3029-thread-16) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172610 INFO  (simCloudManagerPool-3029-thread-16) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172616 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172621 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 4 :
   [junit4]   2> 172621 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 172622 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 172622 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 172636 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172656 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172676 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172697 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172717 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172723 DEBUG (simCloudManagerPool-3029-thread-17) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node28":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n27",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10005_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10005_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 172737 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172757 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172777 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172797 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172818 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172833 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172834 INFO  (simCloudManagerPool-3029-thread-18) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172834 INFO  (simCloudManagerPool-3029-thread-18) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172838 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172844 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 172845 INFO  (simCloudManagerPool-3029-thread-19) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 172845 INFO  (simCloudManagerPool-3029-thread-19) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 172855 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 5 :
   [junit4]   2> 172855 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 172855 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 172856 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 172858 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172878 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172898 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172918 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172938 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172956 DEBUG (simCloudManagerPool-3029-thread-20) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node34":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n33",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10005_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10005_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 172958 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172978 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 172998 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173018 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173039 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173059 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173066 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173067 INFO  (simCloudManagerPool-3029-thread-21) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173067 INFO  (simCloudManagerPool-3029-thread-21) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173077 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173078 INFO  (simCloudManagerPool-3029-thread-22) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173078 INFO  (simCloudManagerPool-3029-thread-22) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173079 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173088 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 6 :
   [junit4]   2> 173088 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 173089 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 173089 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 173099 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173119 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173139 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173159 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173179 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173189 DEBUG (simCloudManagerPool-3029-thread-23) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node40":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n39",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10005_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10005_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 173199 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173220 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173240 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173261 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173281 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173300 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173300 INFO  (simCloudManagerPool-3029-thread-24) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173300 INFO  (simCloudManagerPool-3029-thread-24) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173301 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173311 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173311 INFO  (simCloudManagerPool-3029-thread-25) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173311 INFO  (simCloudManagerPool-3029-thread-25) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173321 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173321 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 7 :
   [junit4]   2> 173321 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 173322 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 173322 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 173341 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173361 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173381 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173401 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173422 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173422 DEBUG (simCloudManagerPool-3029-thread-26) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node46":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n45",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10005_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10005_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 173442 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173462 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173482 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173502 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173522 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173533 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173534 INFO  (simCloudManagerPool-3029-thread-27) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173534 INFO  (simCloudManagerPool-3029-thread-27) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173543 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173546 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173548 INFO  (simCloudManagerPool-3029-thread-28) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173548 INFO  (simCloudManagerPool-3029-thread-28) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173560 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 8 :
   [junit4]   2> 173560 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 173563 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 173563 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 173563 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173583 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173604 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173624 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173644 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173664 DEBUG (ScheduledTrigger-3030-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173665 DEBUG (simCloudManagerPool-3029-thread-29) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node52":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n51",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10005_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10005_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 173684 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173705 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173725 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173745 DEBUG (ScheduledTrigger-3030-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173765 DEBUG (ScheduledTrigger-3030-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173776 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173776 INFO  (simCloudManagerPool-3029-thread-30) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173776 INFO  (simCloudManagerPool-3029-thread-30) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173785 DEBUG (ScheduledTrigger-3030-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 173787 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10005_solr)
   [junit4]   2> 173788 INFO  (simCloudManagerPool-3029-thread-31) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10005_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 173788 INFO  (simCloudManagerPool-3029-thread-31) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 173798 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[47C1DE3C293F52EB]) [ 

[...truncated too long message...]

t live nodes: 100
   [junit4]   2> 175717 DEBUG (ScheduledTrigger-3042-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175738 DEBUG (ScheduledTrigger-3042-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175758 DEBUG (ScheduledTrigger-3042-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175778 DEBUG (ScheduledTrigger-3042-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175798 DEBUG (ScheduledTrigger-3042-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175818 DEBUG (ScheduledTrigger-3042-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175839 DEBUG (ScheduledTrigger-3042-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175859 DEBUG (ScheduledTrigger-3042-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175879 DEBUG (ScheduledTrigger-3042-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175899 DEBUG (ScheduledTrigger-3042-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175919 DEBUG (ScheduledTrigger-3042-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175939 DEBUG (ScheduledTrigger-3042-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175960 DEBUG (ScheduledTrigger-3042-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 175980 DEBUG (ScheduledTrigger-3042-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176000 DEBUG (ScheduledTrigger-3042-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176020 DEBUG (ScheduledTrigger-3042-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176040 DEBUG (ScheduledTrigger-3042-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176061 DEBUG (ScheduledTrigger-3042-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176081 DEBUG (ScheduledTrigger-3042-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176101 DEBUG (ScheduledTrigger-3042-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176121 DEBUG (ScheduledTrigger-3042-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176141 DEBUG (ScheduledTrigger-3042-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 176158 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 9.    WaitEvent       trigger=indexSizeTrigger&wait=60
   [junit4]   2> 176158 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario               WaitEvent       
trigger=indexSizeTrigger&wait=60
   [junit4]   2> 176158 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 10.   Assert  
condition=not_null&key=_trigger_event_indexSizeTrigger
   [junit4]   2> 176158 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario               Assert  
condition=not_null&key=_trigger_event_indexSizeTrigger
   [junit4]   2> 176159 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 11.   Assert  
condition=equals&key=_trigger_event_indexSizeTrigger/eventType&expected=INDEXSIZE
   [junit4]   2> 176159 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario               Assert  
condition=equals&key=_trigger_event_indexSizeTrigger/eventType&expected=INDEXSIZE
   [junit4]   2> 176159 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 12.   Assert  
condition=equals&key=_trigger_event_indexSizeTrigger/properties/requestedOps[0]/action&expected=SPLITSHARD
   [junit4]   2> 176159 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario               Assert  
condition=equals&key=_trigger_event_indexSizeTrigger/properties/requestedOps[0]/action&expected=SPLITSHARD
   [junit4]   2> 176159 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario 13.   WaitCollection  
collection=testCollection&shards=6&withInactive=true&requireLeaders=false&replicas=2
   [junit4]   2> 176159 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.s.SimScenario               WaitCollection  
collection=testCollection&shards=6&withInactive=true&requireLeaders=false&replicas=2
   [junit4]   2> 176159 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 176159 DEBUG 
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 176159 DEBUG 
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 176159 DEBUG 
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 176160 DEBUG 
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 176160 DEBUG 
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 176160 DEBUG 
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 176160 INFO  
(TEST-TestSimScenario.testIndexing-seed#[47C1DE3C293F52EB]) [     ] 
o.a.s.SolrTestCaseJ4 ###Ending testIndexing
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimScenario_47C1DE3C293F52EB-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@73d410f4),
 locale=da-GL, timezone=Pacific/Wallis
   [junit4]   2> NOTE: Linux 5.3.0-59-generic amd64/AdoptOpenJDK 12.0.2 
(64-bit)/cpus=16,threads=1,free=213635680,total=416284672
   [junit4]   2> NOTE: All tests run in this JVM: [TestGraphMLResponseWriter, 
SearchRateTriggerTest, CdcrBootstrapTest, TestLuceneIndexBackCompat, 
TestConfigReload, LeaderVoteWaitTimeoutTest, TestCloudConsistency, 
RecoveryAfterSoftCommitTest, TestHashQParserPlugin, IndexSchemaTest, 
XmlInterpolationTest, TestSimScenario]
   [junit4] Completed [133/910 (1!)] on J0 in 5.21s, 4 tests, 1 failure <<< 
FAILURES!

[...truncated 54564 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/27062/consoleText

[repro] Revision: 591d844e806c4887974d887097fe8401f66f7049

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=TestSimScenario 
-Dtests.method=testSplitShard -Dtests.seed=47C1DE3C293F52EB 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=da-GL 
-Dtests.timezone=Pacific/Wallis -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSimScenario
[repro] ant compile-test

[...truncated 2449 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.TestSimScenario" -Dtests.showOutput=onerror 
"-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" 
-Dtests.seed=47C1DE3C293F52EB -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=da-GL -Dtests.timezone=Pacific/Wallis -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

[...truncated 96 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
[repro] Exiting with code 0

[...truncated 43 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to