Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1857/

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster.testAddNode

Error Message:
did not finish processing all events in time: started=1, finished=0

Stack Trace:
java.lang.AssertionError: did not finish processing all events in time: 
started=1, finished=0
        at 
__randomizedtesting.SeedInfo.seed([7D2F3D5486215375:DAC020F7496CDC6D]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster.testAddNode(TestSimLargeCluster.java:341)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:566)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:834)




Build Log:
[...truncated 13756 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimLargeCluster
   [junit4]   2> Creating dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestSimLargeCluster_7D2F3D5486215375-001/init-core-data-001
   [junit4]   2> 1404782 WARN  
(SUITE-TestSimLargeCluster-seed#[7D2F3D5486215375]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 1404782 INFO  
(SUITE-TestSimLargeCluster-seed#[7D2F3D5486215375]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1404783 INFO  
(SUITE-TestSimLargeCluster-seed#[7D2F3D5486215375]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 1404783 INFO  
(SUITE-TestSimLargeCluster-seed#[7D2F3D5486215375]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1404891 INFO  
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testNodeLost
   [junit4]   2> 1405082 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 1405098 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 1405098 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 1405099 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 1405099 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1405134 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 1405136 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 1405136 INFO  
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 1405170 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10043_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 
127.0.0.1:10049_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 
127.0.0.1:10020_solr, 127.0.0.1:10005_solr, 127.0.0.1:10013_solr, 
127.0.0.1:10021_solr, 127.0.0.1:10035_solr, 127.0.0.1:10019_solr, 
127.0.0.1:10027_solr, 127.0.0.1:10022_solr, 127.0.0.1:10039_solr, 
127.0.0.1:10033_solr, 127.0.0.1:10025_solr, 127.0.0.1:10017_solr, 
127.0.0.1:10047_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 
127.0.0.1:10036_solr, 127.0.0.1:10006_solr, 127.0.0.1:10041_solr, 
127.0.0.1:10009_solr, 127.0.0.1:10000_solr, 127.0.0.1:10030_solr, 
127.0.0.1:10014_solr, 127.0.0.1:10003_solr, 127.0.0.1:10011_solr, 
127.0.0.1:10001_solr, 127.0.0.1:10040_solr, 127.0.0.1:10046_solr, 
127.0.0.1:10023_solr, 127.0.0.1:10007_solr, 127.0.0.1:10015_solr, 
127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10038_solr, 
127.0.0.1:10032_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 
127.0.0.1:10002_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 
127.0.0.1:10045_solr, 127.0.0.1:10037_solr, 127.0.0.1:10042_solr, 
127.0.0.1:10029_solr, 127.0.0.1:10048_solr]
   [junit4]   2> 1405190 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 1405190 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1405198 DEBUG (ScheduledTrigger-1529-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 75 and last live nodes: 50
   [junit4]   2> 1405280 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 99 and last live nodes: 75
   [junit4]   2> 1405292 DEBUG (ScheduledTrigger-1529-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 99 and last live nodes: 99
   [junit4]   2> 1405302 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 99
   [junit4]   2> 1405316 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405336 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405352 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405389 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405409 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405425 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405439 DEBUG (simCloudManagerPool-1528-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1405440 DEBUG (simCloudManagerPool-1528-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 1405446 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405462 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1405462 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 1405462 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1405462 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405482 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405498 DEBUG (ScheduledTrigger-1529-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1405498 DEBUG (simCloudManagerPool-1528-thread-4) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1405498 DEBUG (simCloudManagerPool-1528-thread-4) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 1405499 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1405499 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 1405499 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1405499 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection .system, 
currentVersion=1
   [junit4]   2> 1405499 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 1405553 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 1405608 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 1405610 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 1405696 DEBUG (simCloudManagerPool-1528-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 1405766 DEBUG (simCloudManagerPool-1528-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 1405766 DEBUG (simCloudManagerPool-1528-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (.system / shard1)
   [junit4]   2> 1405767 DEBUG (simCloudManagerPool-1528-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for .system / shard1 
(currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":".system_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":".system",
   [junit4]   2>     "node_name":"127.0.0.1:10037_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1405818 DEBUG (simCloudManagerPool-1528-thread-6) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 1405958 DEBUG (simCloudManagerPool-1528-thread-6) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 1405972 DEBUG (MetricsHistoryHandler-1532-thread-1) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 1406009 DEBUG (MetricsHistoryHandler-1532-thread-1) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 1406029 DEBUG (simCloudManagerPool-1528-thread-7) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 1406029 DEBUG (simCloudManagerPool-1528-thread-7) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 1406045 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection .system, 
currentVersion=7
   [junit4]   2> 1406062 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 1406077 DEBUG 
(TEST-TestSimLargeCluster.testNodeLost-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 1406303 DEBUG (simCloudManagerPool-1528-thread-8) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1406303 DEBUG (simCloudManagerPool-1528-thread-8) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 1406305 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 1406305 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger3 - Initial 
livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 
127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 
127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 
127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 
127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 
127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10095_solr, 
127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 
127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 
127.0.0.1:10098_solr, 127.0.0.1:10003_solr, 127.0.0.1:10001_solr, 
127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10071_solr, 
127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 
127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 
127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 
127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 
127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 
127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 
127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 
127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 
127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 
127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 
127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 
127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 
127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 
127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 
127.0.0.1:10000_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 
127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 
127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 
127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 
127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 
127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10002_solr, 
127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 
127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10037_solr, 
127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10056_solr, 
127.0.0.1:10072_solr]
   [junit4]   2> 1406305 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 1406305 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 1406305 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406321 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406341 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406357 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406379 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406394 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406410 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406427 DEBUG (simCloudManagerPool-1528-thread-10) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1406427 DEBUG (simCloudManagerPool-1528-thread-10) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
5
   [junit4]   2> 1406427 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 1406427 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 1406427 DEBUG (Simulated OverseerAutoScalingTriggerThread) [   
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 1406430 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406432 DEBUG (simCloudManagerPool-1528-thread-13) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testNodeLost, 
currentVersion=8
   [junit4]   2> 1406432 DEBUG (simCloudManagerPool-1528-thread-13) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 1406432 DEBUG (simCloudManagerPool-1528-thread-13) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 1406433 DEBUG (simCloudManagerPool-1528-thread-14) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 1406433 DEBUG (simCloudManagerPool-1528-thread-14) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 1406447 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406467 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406483 DEBUG (simCloudManagerPool-1528-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 1406483 DEBUG (simCloudManagerPool-1528-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 1406483 DEBUG (simCloudManagerPool-1528-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard1)
   [junit4]   2> 1406483 DEBUG (simCloudManagerPool-1528-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard1 (currentVersion=11): {"core_node1":{
   [junit4]   2>     "core":"testNodeLost_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10049_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1406483 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406503 DEBUG (simCloudManagerPool-1528-thread-16) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 1406503 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406523 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406539 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406556 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1406613 DEBUG (simCloudManagerPool-1528-thread-16) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 1406629 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=12
   [junit4]   2> 1408100 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408104 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 1408115 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408123 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=13
   [junit4]   2> 1408123 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 1408123 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard19)
   [junit4]   2> 1408123 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard19 (currentVersion=14): {"core_node190":{
   [junit4]   2>     "core":"testNodeLost_shard19_replica_n190",
   [junit4]   2>     "shard":"shard19",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10004_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1408135 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408139 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=14
   [junit4]   2> 1408140 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 1408140 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard20)
   [junit4]   2> 1408140 DEBUG (simCloudManagerPool-1528-thread-17) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard20 (currentVersion=15): {"core_node195":{
   [junit4]   2>     "core":"testNodeLost_shard20_replica_n195",
   [junit4]   2>     "shard":"shard20",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10063_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1408151 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408159 DEBUG (simCloudManagerPool-1528-thread-18) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=15
   [junit4]   2> 1408161 DEBUG (simCloudManagerPool-1528-thread-18) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 1408171 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408188 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408196 DEBUG (simCloudManagerPool-1528-thread-19) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=16
   [junit4]   2> 1408197 DEBUG (simCloudManagerPool-1528-thread-19) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 16
   [junit4]   2> 1408208 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408212 DEBUG (simCloudManagerPool-1528-thread-20) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=17
   [junit4]   2> 1408213 DEBUG (simCloudManagerPool-1528-thread-20) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 17
   [junit4]   2> 1408224 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408232 DEBUG (simCloudManagerPool-1528-thread-21) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=18
   [junit4]   2> 1408233 DEBUG (simCloudManagerPool-1528-thread-21) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 18
   [junit4]   2> 1408244 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408262 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408277 DEBUG (simCloudManagerPool-1528-thread-24) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=19
   [junit4]   2> 1408281 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408293 DEBUG (simCloudManagerPool-1528-thread-24) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 19
   [junit4]   2> 1408297 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408313 DEBUG (simCloudManagerPool-1528-thread-25) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=20
   [junit4]   2> 1408317 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408330 DEBUG (simCloudManagerPool-1528-thread-25) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 20
   [junit4]   2> 1408330 DEBUG (simCloudManagerPool-1528-thread-25) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard2)
   [junit4]   2> 1408330 DEBUG (simCloudManagerPool-1528-thread-25) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard2 (currentVersion=21): {"core_node11":{
   [junit4]   2>     "core":"testNodeLost_shard2_replica_n11",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10048_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1408333 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408350 DEBUG (simCloudManagerPool-1528-thread-26) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=21
   [junit4]   2> 1408354 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408366 DEBUG (simCloudManagerPool-1528-thread-26) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 21
   [junit4]   2> 1408370 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408386 DEBUG (simCloudManagerPool-1528-thread-27) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=22
   [junit4]   2> 1408390 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408403 DEBUG (simCloudManagerPool-1528-thread-27) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 22
   [junit4]   2> 1408423 DEBUG (simCloudManagerPool-1528-thread-28) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=23
   [junit4]   2> 1408427 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408439 DEBUG (simCloudManagerPool-1528-thread-28) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 23
   [junit4]   2> 1408443 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408459 DEBUG (simCloudManagerPool-1528-thread-29) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=24
   [junit4]   2> 1408463 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408479 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408480 DEBUG (simCloudManagerPool-1528-thread-29) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 24
   [junit4]   2> 1408480 DEBUG (MetricsHistoryHandler-1532-thread-1) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=25
   [junit4]   2> 1408516 DEBUG (MetricsHistoryHandler-1532-thread-1) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 25
   [junit4]   2> 1408520 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408532 DEBUG (simCloudManagerPool-1528-thread-30) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=26
   [junit4]   2> 1408532 DEBUG (simCloudManagerPool-1528-thread-30) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 26
   [junit4]   2> 1408552 DEBUG (simCloudManagerPool-1528-thread-31) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=27
   [junit4]   2> 1408589 DEBUG (simCloudManagerPool-1528-thread-31) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 27
   [junit4]   2> 1408644 DEBUG (simCloudManagerPool-1528-thread-32) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=28
   [junit4]   2> 1408653 DEBUG (ScheduledTrigger-1529-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408670 DEBUG (ScheduledTrigger-1529-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408683 DEBUG (ScheduledTrigger-1529-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408698 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408706 DEBUG (simCloudManagerPool-1528-thread-32) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 28
   [junit4]   2> 1408714 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408722 DEBUG (simCloudManagerPool-1528-thread-33) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=29
   [junit4]   2> 1408746 DEBUG (simCloudManagerPool-1528-thread-33) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 29
   [junit4]   2> 1408751 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408771 DEBUG (simCloudManagerPool-1528-thread-34) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=30
   [junit4]   2> 1408771 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408788 DEBUG (simCloudManagerPool-1528-thread-34) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 30
   [junit4]   2> 1408788 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408807 DEBUG (simCloudManagerPool-1528-thread-35) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=31
   [junit4]   2> 1408808 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408824 DEBUG (simCloudManagerPool-1528-thread-35) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 31
   [junit4]   2> 1408824 DEBUG (simCloudManagerPool-1528-thread-35) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard3)
   [junit4]   2> 1408824 DEBUG (simCloudManagerPool-1528-thread-35) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard3 (currentVersion=32): {"core_node21":{
   [junit4]   2>     "core":"testNodeLost_shard3_replica_n21",
   [junit4]   2>     "shard":"shard3",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10045_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1408824 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408844 DEBUG (simCloudManagerPool-1528-thread-36) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=32
   [junit4]   2> 1408844 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408861 DEBUG (simCloudManagerPool-1528-thread-36) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 32
   [junit4]   2> 1408861 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408880 DEBUG (simCloudManagerPool-1528-thread-37) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=33
   [junit4]   2> 1408880 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408897 DEBUG (simCloudManagerPool-1528-thread-37) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 33
   [junit4]   2> 1408897 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408917 DEBUG (simCloudManagerPool-1528-thread-38) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=34
   [junit4]   2> 1408917 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408934 DEBUG (simCloudManagerPool-1528-thread-38) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 34
   [junit4]   2> 1408934 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408953 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1408965 DEBUG (simCloudManagerPool-1528-thread-39) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=35
   [junit4]   2> 1408969 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409003 DEBUG (simCloudManagerPool-1528-thread-39) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 35
   [junit4]   2> 1409022 DEBUG (simCloudManagerPool-1528-thread-40) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=36
   [junit4]   2> 1409026 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409042 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409043 DEBUG (simCloudManagerPool-1528-thread-40) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 36
   [junit4]   2> 1409063 DEBUG (simCloudManagerPool-1528-thread-41) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=37
   [junit4]   2> 1409063 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409079 DEBUG (simCloudManagerPool-1528-thread-41) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 37
   [junit4]   2> 1409079 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409095 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409095 DEBUG (simCloudManagerPool-1528-thread-42) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=38
   [junit4]   2> 1409115 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409116 DEBUG (simCloudManagerPool-1528-thread-42) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 38
   [junit4]   2> 1409132 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409144 DEBUG (simCloudManagerPool-1528-thread-43) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=39
   [junit4]   2> 1409145 DEBUG (simCloudManagerPool-1528-thread-43) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 39
   [junit4]   2> 1409152 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409168 DEBUG (simCloudManagerPool-1528-thread-44) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=40
   [junit4]   2> 1409168 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409189 DEBUG (simCloudManagerPool-1528-thread-44) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 40
   [junit4]   2> 1409189 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409205 DEBUG (simCloudManagerPool-1528-thread-45) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=41
   [junit4]   2> 1409205 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409242 DEBUG (simCloudManagerPool-1528-thread-45) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 41
   [junit4]   2> 1409242 DEBUG (simCloudManagerPool-1528-thread-45) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard4)
   [junit4]   2> 1409242 DEBUG (simCloudManagerPool-1528-thread-45) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard4 (currentVersion=42): {"core_node31":{
   [junit4]   2>     "core":"testNodeLost_shard4_replica_n31",
   [junit4]   2>     "shard":"shard4",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10065_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1409242 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409261 DEBUG (simCloudManagerPool-1528-thread-46) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=42
   [junit4]   2> 1409262 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409278 DEBUG (simCloudManagerPool-1528-thread-46) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 42
   [junit4]   2> 1409278 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409298 DEBUG (simCloudManagerPool-1528-thread-47) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=43
   [junit4]   2> 1409298 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409314 DEBUG (simCloudManagerPool-1528-thread-47) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 43
   [junit4]   2> 1409314 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409334 DEBUG (simCloudManagerPool-1528-thread-48) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=44
   [junit4]   2> 1409334 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409351 DEBUG (simCloudManagerPool-1528-thread-48) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 44
   [junit4]   2> 1409352 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409371 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409383 DEBUG (simCloudManagerPool-1528-thread-49) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=45
   [junit4]   2> 1409387 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409404 DEBUG (simCloudManagerPool-1528-thread-49) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 45
   [junit4]   2> 1409408 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409419 DEBUG (simCloudManagerPool-1528-thread-50) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=46
   [junit4]   2> 1409423 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409440 DEBUG (simCloudManagerPool-1528-thread-50) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 46
   [junit4]   2> 1409444 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409456 DEBUG (simCloudManagerPool-1528-thread-51) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=47
   [junit4]   2> 1409460 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409480 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409493 DEBUG (simCloudManagerPool-1528-thread-51) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 47
   [junit4]   2> 1409496 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409513 DEBUG (simCloudManagerPool-1528-thread-52) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=48
   [junit4]   2> 1409514 DEBUG (simCloudManagerPool-1528-thread-52) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 48
   [junit4]   2> 1409516 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409529 DEBUG (simCloudManagerPool-1528-thread-53) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=49
   [junit4]   2> 1409529 DEBUG (simCloudManagerPool-1528-thread-53) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 49
   [junit4]   2> 1409533 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409553 DEBUG (simCloudManagerPool-1528-thread-54) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=50
   [junit4]   2> 1409553 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409569 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409589 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409605 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409622 DEBUG (simCloudManagerPool-1528-thread-54) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 50
   [junit4]   2> 1409626 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409638 DEBUG (simCloudManagerPool-1528-thread-55) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=51
   [junit4]   2> 1409639 DEBUG (simCloudManagerPool-1528-thread-55) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 51
   [junit4]   2> 1409639 DEBUG (simCloudManagerPool-1528-thread-55) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard5)
   [junit4]   2> 1409639 DEBUG (simCloudManagerPool-1528-thread-55) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard5 (currentVersion=52): {"core_node41":{
   [junit4]   2>     "core":"testNodeLost_shard5_replica_n41",
   [junit4]   2>     "shard":"shard5",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10012_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1409642 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409658 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409658 DEBUG (simCloudManagerPool-1528-thread-56) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=52
   [junit4]   2> 1409659 DEBUG (simCloudManagerPool-1528-thread-56) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 52
   [junit4]   2> 1409675 DEBUG (simCloudManagerPool-1528-thread-57) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=53
   [junit4]   2> 1409675 DEBUG (simCloudManagerPool-1528-thread-57) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 53
   [junit4]   2> 1409678 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409695 DEBUG (simCloudManagerPool-1528-thread-58) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=54
   [junit4]   2> 1409695 DEBUG (simCloudManagerPool-1528-thread-58) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 54
   [junit4]   2> 1409699 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409715 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409728 DEBUG (simCloudManagerPool-1528-thread-59) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=55
   [junit4]   2> 1409728 DEBUG (simCloudManagerPool-1528-thread-59) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 55
   [junit4]   2> 1409735 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409751 DEBUG (simCloudManagerPool-1528-thread-60) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=56
   [junit4]   2> 1409752 DEBUG (simCloudManagerPool-1528-thread-60) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 56
   [junit4]   2> 1409752 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409768 DEBUG (simCloudManagerPool-1528-thread-61) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=57
   [junit4]   2> 1409768 DEBUG (simCloudManagerPool-1528-thread-61) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 57
   [junit4]   2> 1409768 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409788 DEBUG (simCloudManagerPool-1528-thread-62) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=58
   [junit4]   2> 1409788 DEBUG (simCloudManagerPool-1528-thread-62) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 58
   [junit4]   2> 1409789 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409804 DEBUG (simCloudManagerPool-1528-thread-63) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=59
   [junit4]   2> 1409805 DEBUG (simCloudManagerPool-1528-thread-63) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 59
   [junit4]   2> 1409805 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409824 DEBUG (simCloudManagerPool-1528-thread-64) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=60
   [junit4]   2> 1409825 DEBUG (simCloudManagerPool-1528-thread-64) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 60
   [junit4]   2> 1409825 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409840 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409857 DEBUG (simCloudManagerPool-1528-thread-65) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=61
   [junit4]   2> 1409857 DEBUG (simCloudManagerPool-1528-thread-65) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 61
   [junit4]   2> 1409857 DEBUG (simCloudManagerPool-1528-thread-65) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard6)
   [junit4]   2> 1409857 DEBUG (simCloudManagerPool-1528-thread-65) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard6 (currentVersion=62): {"core_node51":{
   [junit4]   2>     "core":"testNodeLost_shard6_replica_n51",
   [junit4]   2>     "shard":"shard6",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10098_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1409861 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409877 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409877 DEBUG (simCloudManagerPool-1528-thread-66) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=62
   [junit4]   2> 1409878 DEBUG (simCloudManagerPool-1528-thread-66) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 62
   [junit4]   2> 1409893 DEBUG (simCloudManagerPool-1528-thread-67) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=63
   [junit4]   2> 1409905 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409922 DEBUG (simCloudManagerPool-1528-thread-67) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 63
   [junit4]   2> 1409939 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409942 DEBUG (simCloudManagerPool-1528-thread-68) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=64
   [junit4]   2> 1409943 DEBUG (simCloudManagerPool-1528-thread-68) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 64
   [junit4]   2> 1409954 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409959 DEBUG (simCloudManagerPool-1528-thread-69) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=65
   [junit4]   2> 1409960 DEBUG (simCloudManagerPool-1528-thread-69) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 65
   [junit4]   2> 1409974 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1409990 DEBUG (simCloudManagerPool-1528-thread-70) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=66
   [junit4]   2> 1409991 DEBUG (simCloudManagerPool-1528-thread-70) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 66
   [junit4]   2> 1409991 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410011 DEBUG (simCloudManagerPool-1528-thread-71) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=67
   [junit4]   2> 1410011 DEBUG (simCloudManagerPool-1528-thread-71) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 67
   [junit4]   2> 1410011 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410031 DEBUG (simCloudManagerPool-1528-thread-72) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=68
   [junit4]   2> 1410031 DEBUG (simCloudManagerPool-1528-thread-72) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 68
   [junit4]   2> 1410032 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410051 DEBUG (simCloudManagerPool-1528-thread-73) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=69
   [junit4]   2> 1410052 DEBUG (simCloudManagerPool-1528-thread-73) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 69
   [junit4]   2> 1410052 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410071 DEBUG (simCloudManagerPool-1528-thread-74) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=70
   [junit4]   2> 1410072 DEBUG (simCloudManagerPool-1528-thread-74) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 70
   [junit4]   2> 1410072 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410088 DEBUG (simCloudManagerPool-1528-thread-75) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=71
   [junit4]   2> 1410088 DEBUG (simCloudManagerPool-1528-thread-75) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 71
   [junit4]   2> 1410088 DEBUG (simCloudManagerPool-1528-thread-75) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard7)
   [junit4]   2> 1410088 DEBUG (simCloudManagerPool-1528-thread-75) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard7 (currentVersion=72): {"core_node61":{
   [junit4]   2>     "core":"testNodeLost_shard7_replica_n61",
   [junit4]   2>     "shard":"shard7",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10056_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1410088 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410104 DEBUG (simCloudManagerPool-1528-thread-76) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=72
   [junit4]   2> 1410104 DEBUG (simCloudManagerPool-1528-thread-76) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 72
   [junit4]   2> 1410105 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410124 DEBUG (simCloudManagerPool-1528-thread-77) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=73
   [junit4]   2> 1410125 DEBUG (simCloudManagerPool-1528-thread-77) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 73
   [junit4]   2> 1410125 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410140 DEBUG (simCloudManagerPool-1528-thread-78) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=74
   [junit4]   2> 1410141 DEBUG (simCloudManagerPool-1528-thread-78) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 74
   [junit4]   2> 1410141 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410161 DEBUG (simCloudManagerPool-1528-thread-79) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=75
   [junit4]   2> 1410161 DEBUG (simCloudManagerPool-1528-thread-79) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 75
   [junit4]   2> 1410161 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410177 DEBUG (simCloudManagerPool-1528-thread-80) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=76
   [junit4]   2> 1410177 DEBUG (simCloudManagerPool-1528-thread-80) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 76
   [junit4]   2> 1410177 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410197 DEBUG (simCloudManagerPool-1528-thread-81) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=77
   [junit4]   2> 1410198 DEBUG (simCloudManagerPool-1528-thread-81) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 77
   [junit4]   2> 1410198 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410213 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410217 DEBUG (simCloudManagerPool-1528-thread-82) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=78
   [junit4]   2> 1410218 DEBUG (simCloudManagerPool-1528-thread-82) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 78
   [junit4]   2> 1410233 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410237 DEBUG (simCloudManagerPool-1528-thread-83) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=79
   [junit4]   2> 1410238 DEBUG (simCloudManagerPool-1528-thread-83) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 79
   [junit4]   2> 1410250 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410254 DEBUG (simCloudManagerPool-1528-thread-84) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=80
   [junit4]   2> 1410254 DEBUG (simCloudManagerPool-1528-thread-84) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 80
   [junit4]   2> 1410271 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410282 DEBUG (simCloudManagerPool-1528-thread-85) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=81
   [junit4]   2> 1410283 DEBUG (simCloudManagerPool-1528-thread-85) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 81
   [junit4]   2> 1410283 DEBUG (simCloudManagerPool-1528-thread-85) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard8)
   [junit4]   2> 1410283 DEBUG (simCloudManagerPool-1528-thread-85) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard8 (currentVersion=82): {"core_node71":{
   [junit4]   2>     "core":"testNodeLost_shard8_replica_n71",
   [junit4]   2>     "shard":"shard8",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10087_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1410286 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410299 DEBUG (simCloudManagerPool-1528-thread-86) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=82
   [junit4]   2> 1410299 DEBUG (simCloudManagerPool-1528-thread-86) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 82
   [junit4]   2> 1410306 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410323 DEBUG (simCloudManagerPool-1528-thread-87) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=83
   [junit4]   2> 1410323 DEBUG (simCloudManagerPool-1528-thread-87) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 83
   [junit4]   2> 1410323 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410343 DEBUG (simCloudManagerPool-1528-thread-88) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=84
   [junit4]   2> 1410344 DEBUG (simCloudManagerPool-1528-thread-88) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 84
   [junit4]   2> 1410344 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410359 DEBUG (simCloudManagerPool-1528-thread-89) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=85
   [junit4]   2> 1410360 DEBUG (simCloudManagerPool-1528-thread-89) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 85
   [junit4]   2> 1410360 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410379 DEBUG (simCloudManagerPool-1528-thread-90) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=86
   [junit4]   2> 1410380 DEBUG (simCloudManagerPool-1528-thread-90) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 86
   [junit4]   2> 1410380 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410395 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410416 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410416 DEBUG (simCloudManagerPool-1528-thread-91) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=87
   [junit4]   2> 1410417 DEBUG (simCloudManagerPool-1528-thread-91) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 87
   [junit4]   2> 1410432 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410432 DEBUG (simCloudManagerPool-1528-thread-92) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=88
   [junit4]   2> 1410433 DEBUG (simCloudManagerPool-1528-thread-92) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 88
   [junit4]   2> 1410452 DEBUG (simCloudManagerPool-1528-thread-93) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=89
   [junit4]   2> 1410453 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410453 DEBUG (simCloudManagerPool-1528-thread-93) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 89
   [junit4]   2> 1410468 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410468 DEBUG (simCloudManagerPool-1528-thread-94) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=90
   [junit4]   2> 1410469 DEBUG (simCloudManagerPool-1528-thread-94) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 90
   [junit4]   2> 1410485 DEBUG (simCloudManagerPool-1528-thread-95) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=91
   [junit4]   2> 1410485 DEBUG (simCloudManagerPool-1528-thread-95) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 91
   [junit4]   2> 1410485 DEBUG (simCloudManagerPool-1528-thread-95) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard9)
   [junit4]   2> 1410485 DEBUG (simCloudManagerPool-1528-thread-95) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard9 (currentVersion=92): {"core_node81":{
   [junit4]   2>     "core":"testNodeLost_shard9_replica_n81",
   [junit4]   2>     "shard":"shard9",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10053_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1410489 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410505 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410517 DEBUG (simCloudManagerPool-1528-thread-96) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=92
   [junit4]   2> 1410518 DEBUG (simCloudManagerPool-1528-thread-96) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 92
   [junit4]   2> 1410525 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410537 DEBUG (simCloudManagerPool-1528-thread-97) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=93
   [junit4]   2> 1410538 DEBUG (simCloudManagerPool-1528-thread-97) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 93
   [junit4]   2> 1410541 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410562 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410562 DEBUG (simCloudManagerPool-1528-thread-98) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=94
   [junit4]   2> 1410563 DEBUG (simCloudManagerPool-1528-thread-98) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 94
   [junit4]   2> 1410578 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410578 DEBUG (simCloudManagerPool-1528-thread-99) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=95
   [junit4]   2> 1410579 DEBUG (simCloudManagerPool-1528-thread-99) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 95
   [junit4]   2> 1410598 DEBUG (simCloudManagerPool-1528-thread-100) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=96
   [junit4]   2> 1410599 DEBUG (simCloudManagerPool-1528-thread-100) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 96
   [junit4]   2> 1410599 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410614 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410614 DEBUG (simCloudManagerPool-1528-thread-101) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=97
   [junit4]   2> 1410615 DEBUG (simCloudManagerPool-1528-thread-101) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 97
   [junit4]   2> 1410635 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410651 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410671 DEBUG (simCloudManagerPool-1528-thread-102) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=98
   [junit4]   2> 1410673 DEBUG (simCloudManagerPool-1528-thread-102) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 98
   [junit4]   2> 1410687 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410687 DEBUG (simCloudManagerPool-1528-thread-103) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=99
   [junit4]   2> 1410688 DEBUG (simCloudManagerPool-1528-thread-103) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 99
   [junit4]   2> 1410708 DEBUG (simCloudManagerPool-1528-thread-104) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=100
   [junit4]   2> 1410709 DEBUG (simCloudManagerPool-1528-thread-104) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 100
   [junit4]   2> 1410720 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410724 DEBUG (simCloudManagerPool-1528-thread-105) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=101
   [junit4]   2> 1410725 DEBUG (simCloudManagerPool-1528-thread-105) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 101
   [junit4]   2> 1410725 DEBUG (simCloudManagerPool-1528-thread-105) [    ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testNodeLost / 
shard10)
   [junit4]   2> 1410725 DEBUG (simCloudManagerPool-1528-thread-105) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testNodeLost / 
shard10 (currentVersion=102): {"core_node91":{
   [junit4]   2>     "core":"testNodeLost_shard10_replica_n91",
   [junit4]   2>     "shard":"shard10",
   [junit4]   2>     "collection":"testNodeLost",
   [junit4]   2>     "node_name":"127.0.0.1:10099_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1410736 DEBUG (ScheduledTrigger-1529-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger3 with 
currently live nodes: 100 and last live nodes: 100
   [junit4]   2> 1410744 DEBUG (simCloudManagerPool-1528-thread-106) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=102
   [junit4]   2> 1410745 DEBUG

[...truncated too long message...]

rd1"}]}}]}}
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:120)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:324)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Unexpected 
exception executing operation: 
action=ADDREPLICA&async=search_rate_trigger/936afca9279f2eTe08w3spwzg64re6josfe66ild/0&waitForFinalState=true&collection=testSearchRate&shard=shard1&node=127.0.0.1:10336_solr&type=NRT
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:110)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:324)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> Caused by: java.io.IOException: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$190/0x00000001003f7440@7ea6660d
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3939f189[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 35]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:728)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:80)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:324)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> Caused by: java.util.concurrent.RejectedExecutionException: 
Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$190/0x00000001003f7440@7ea6660d
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3939f189[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 35]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055)
 ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) 
~[?:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1355) 
~[?:?]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:194)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140)
 ~[?:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:725)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ExecutePlanAction.process(ExecutePlanAction.java:80)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$add$3(ScheduledTriggers.java:324)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> 1690914 DEBUG (AutoscalingActionExecutor-1548-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 7335 ms for event 
id=936afca9279f2eTe08w3spwzg64re6josfe66ild
   [junit4]   2> 1690914 DEBUG 
(TEST-TestSimLargeCluster.testSearchRate-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 1690914 DEBUG 
(TEST-TestSimLargeCluster.testSearchRate-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 1690914 DEBUG 
(TEST-TestSimLargeCluster.testSearchRate-seed#[7D2F3D5486215375]) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 1690915 INFO  
(TEST-TestSimLargeCluster.testSearchRate-seed#[7D2F3D5486215375]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testSearchRate
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestSimLargeCluster_7D2F3D5486215375-001
   [junit4]   2> NOTE: test params are: codec=Lucene80, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@77c40650),
 locale=nnh, timezone=Pacific/Wake
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 11.0.1 
(64-bit)/cpus=4,threads=1,free=121324560,total=372244480
   [junit4]   2> NOTE: All tests run in this JVM: [TestLogWatcher, 
DistributedDebugComponentTest, HdfsRecoveryZkTest, BitVectorTest, BasicZkTest, 
DistribCursorPagingTest, CollectionTooManyReplicasTest, TestRangeQuery, 
TestManagedSynonymFilterFactory, TestInfoStreamLogging, ZkStateReaderTest, 
TestExpandComponent, HdfsWriteToMultipleCollectionsTest, ActionThrottleTest, 
GraphQueryTest, RequestHandlersTest, SolrRequestParserTest, SolrCLIZkUtilsTest, 
V2ApiIntegrationTest, TimeZoneUtilsTest, MBeansHandlerTest, BlockDirectoryTest, 
AssignBackwardCompatibilityTest, InfoHandlerTest, 
SuggestComponentContextFilterQueryTest, TestPullReplica, 
TestPartialUpdateDeduplication, TestUninvertingReader, HealthCheckHandlerTest, 
AtomicUpdatesTest, CopyFieldTest, TestStreamBody, TestIndexSearcher, TestTrie, 
TestLegacyFieldCache, ReplaceNodeNoTargetTest, TestDistributedGrouping, 
TestCloudSearcherWarming, TestReplicationHandlerBackup, 
BaseCdcrDistributedZkTest, DistributedQueryComponentCustomSortTest, 
TestJavabinTupleStreamParser, TestDefaultStatsCache, TestConfigOverlay, 
TestAnalyzeInfixSuggestions, TestSizeLimitedDistributedMap, 
NodeAddedTriggerIntegrationTest, ZkNodePropsTest, RuleEngineTest, 
TestSimpleQParserPlugin, TestSimLargeCluster]
   [junit4] Completed [123/858 (1!)] on J2 in 286.78s, 5 tests, 1 failure, 1 
skipped <<< FAILURES!

[...truncated 49846 lines...]
-ecj-javadoc-lint-src:
    [mkdir] Created dir: /tmp/ecj2041362690
 [ecj-lint] Compiling 69 source files to /tmp/ecj2041362690
 [ecj-lint] invalid Class-Path header in manifest of jar file: 
/home/jenkins/.ivy2/cache/org.restlet.jee/org.restlet/jars/org.restlet-2.3.0.jar
 [ecj-lint] invalid Class-Path header in manifest of jar file: 
/home/jenkins/.ivy2/cache/org.restlet.jee/org.restlet.ext.servlet/jars/org.restlet.ext.servlet-2.3.0.jar
 [ecj-lint] ----------
 [ecj-lint] 1. ERROR in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java
 (at line 28)
 [ecj-lint]     import javax.naming.InitialContext;
 [ecj-lint]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The type javax.naming.InitialContext is not accessible
 [ecj-lint] ----------
 [ecj-lint] 2. ERROR in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java
 (at line 29)
 [ecj-lint]     import javax.naming.NamingException;
 [ecj-lint]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The type javax.naming.NamingException is not accessible
 [ecj-lint] ----------
 [ecj-lint] 3. ERROR in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java
 (at line 182)
 [ecj-lint]     c = getFromJndi(initProps, jndiName);
 [ecj-lint]         ^^^^^^^^^^^
 [ecj-lint] The method getFromJndi(Properties, String) from the type new 
Callable<Connection>(){} refers to the missing type NamingException
 [ecj-lint] ----------
 [ecj-lint] 4. ERROR in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java
 (at line 245)
 [ecj-lint]     private Connection getFromJndi(final Properties initProps, 
final String jndiName) throws NamingException,
 [ecj-lint]                                                                     
                         ^^^^^^^^^^^^^^^
 [ecj-lint] NamingException cannot be resolved to a type
 [ecj-lint] ----------
 [ecj-lint] 5. ERROR in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java
 (at line 249)
 [ecj-lint]     InitialContext ctx =  new InitialContext();
 [ecj-lint]     ^^^^^^^^^^^^^^
 [ecj-lint] InitialContext cannot be resolved to a type
 [ecj-lint] ----------
 [ecj-lint] 6. ERROR in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/JdbcDataSource.java
 (at line 249)
 [ecj-lint]     InitialContext ctx =  new InitialContext();
 [ecj-lint]                               ^^^^^^^^^^^^^^
 [ecj-lint] InitialContext cannot be resolved to a type
 [ecj-lint] ----------
 [ecj-lint] 6 problems (6 errors)

BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:652:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:101:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build.xml:651:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/common-build.xml:479:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:2009:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/lucene/common-build.xml:2048:
 Compile failed; see the compiler error output for details.

Total time: 605 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to