Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-8.x/29/

3 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration:     1) 
Thread[id=183, name=Log4j2-TF-2-AsyncLoggerConfig--2, state=TIMED_WAITING, 
group=TGRP-TestSimTriggerIntegration]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
         at 
com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
         at 
com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
         at 
com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)        
 at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration: 
   1) Thread[id=183, name=Log4j2-TF-2-AsyncLoggerConfig--2, 
state=TIMED_WAITING, group=TGRP-TestSimTriggerIntegration]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at 
com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
        at 
com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
        at 
com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([1C6316640E8476E7]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=183, name=Log4j2-TF-2-AsyncLoggerConfig--2, state=TIMED_WAITING, 
group=TGRP-TestSimTriggerIntegration]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
         at 
com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
         at 
com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
         at 
com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)        
 at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=183, name=Log4j2-TF-2-AsyncLoggerConfig--2, 
state=TIMED_WAITING, group=TGRP-TestSimTriggerIntegration]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at 
com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
        at 
com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
        at 
com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([1C6316640E8476E7]:0)


FAILED:  org.apache.solr.logging.TestLogWatcher.testLog4jWatcher

Error Message:
expected:<-1> but was:<1551006492921>

Stack Trace:
java.lang.AssertionError: expected:<-1> but was:<1551006492921>
        at 
__randomizedtesting.SeedInfo.seed([1C6316640E8476E7:E1F84624F78CC9E9]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.failNotEquals(Assert.java:834)
        at org.junit.Assert.assertEquals(Assert.java:645)
        at org.junit.Assert.assertEquals(Assert.java:631)
        at 
org.apache.solr.logging.TestLogWatcher.testLog4jWatcher(TestLogWatcher.java:52)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13105 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration
   [junit4]   2> 4526 INFO  
(SUITE-TestSimTriggerIntegration-seed#[1C6316640E8476E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestSimTriggerIntegration_1C6316640E8476E7-001/init-core-data-001
   [junit4]   2> 4781 INFO  
(SUITE-TestSimTriggerIntegration-seed#[1C6316640E8476E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 4878 INFO  
(SUITE-TestSimTriggerIntegration-seed#[1C6316640E8476E7]-worker) [    ] 
o.e.j.u.log Logging initialized @4934ms to org.eclipse.jetty.util.log.Slf4jLog
   [junit4]   2> 4893 INFO  
(SUITE-TestSimTriggerIntegration-seed#[1C6316640E8476E7]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 5653 INFO  
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
   [junit4]   2> 5828 INFO  
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 6282 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 6374 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 6395 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 6398 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 6398 INFO  
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics 
history in memory.
   [junit4]   2> 6403 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
1
   [junit4]   2> 6633 DEBUG (simCloudManagerPool-2-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 6772 DEBUG (simCloudManagerPool-2-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 6783 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 0
   [junit4]   2> 6783 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 6794 DEBUG (simCloudManagerPool-2-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 6795 DEBUG (simCloudManagerPool-2-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 6816 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 6826 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 6826 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 2
   [junit4]   2> 6826 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 6827 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 6827 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 6830 DEBUG (ScheduledTrigger-3-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 6838 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 6838 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 6844 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.s.SimClusterStateProvider  -- created marker: 
/autoscaling/nodeLost/127.0.0.1:10000_solr
   [junit4]   2> 6844 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10001_solr
   [junit4]   2> 6846 DEBUG (ScheduledTrigger-3-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 1 and last live nodes: 2
   [junit4]   2> 6846 DEBUG (ScheduledTrigger-3-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10000_solr
   [junit4]   2> 6857 DEBUG (ScheduledTrigger-3-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 2
   [junit4]   2> 6857 DEBUG (ScheduledTrigger-3-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10000_solr
   [junit4]   2> 6867 DEBUG (ScheduledTrigger-3-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 6877 DEBUG (ScheduledTrigger-3-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 6888 DEBUG (ScheduledTrigger-3-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 6898 DEBUG (ScheduledTrigger-3-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 6908 DEBUG (ScheduledTrigger-3-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 6908 DEBUG (ScheduledTrigger-3-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:10000_solr]
   [junit4]   2> 6912 DEBUG (ScheduledTrigger-3-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b210ba18ed6afT6e0yshk2p8p62qjnkpigow7qr",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":12139757837407919,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139757837407919],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 6912 DEBUG (ScheduledTrigger-3-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_lost_trigger]
   [junit4]   2> 6914 DEBUG (ScheduledTrigger-3-thread-2) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b210ba18ed6afT6e0yshk2p8p62qjnkpigow7qr",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":12139757837407919,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139757837407919],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139761173336319,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 6922 DEBUG (AutoscalingActionExecutor-4-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b210ba18ed6afT6e0yshk2p8p62qjnkpigow7qr",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":12139757837407919,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139757837407919],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139761173336319,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 6926 DEBUG (AutoscalingActionExecutor-4-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b210ba18ed6afT6e0yshk2p8p62qjnkpigow7qr",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":12139757837407919,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139757837407919],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139761173336319,
   [junit4]   2>     "nodeNames":["127.0.0.1:10000_solr"]}}
   [junit4]   2> 6929 DEBUG (AutoscalingActionExecutor-4-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 100ms
   [junit4]   2> 6930 DEBUG (AutoscalingActionExecutor-4-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 6938 DEBUG (simCloudManagerPool-2-thread-4) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 6939 DEBUG (simCloudManagerPool-2-thread-4) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 6942 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 6966 DEBUG (AutoscalingActionExecutor-4-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 2184 ms for event 
id=2b210ba18ed6afT6e0yshk2p8p62qjnkpigow7qr
   [junit4]   2> 6966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 6973 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 7020 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 7020 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 7021 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 7022 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 7025 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 7025 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 7025 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 7025 INFO  
(TEST-TestSimTriggerIntegration.testNodeLostTrigger-seed#[1C6316640E8476E7]) [  
  ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
   [junit4]   2> 7066 INFO  
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testEventQueue
   [junit4]   2> 7082 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10002_solr
   [junit4]   2> 7083 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 7083 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 7083 INFO  
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 7084 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 7085 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
1
   [junit4]   2> 7095 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 7095 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 7096 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 7097 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7097 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 7097 DEBUG (ScheduledTrigger-9-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7099 DEBUG (simCloudManagerPool-8-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7100 DEBUG (simCloudManagerPool-8-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 7101 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 7102 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7102 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 7118 DEBUG (ScheduledTrigger-9-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7121 INFO  (simCloudManagerPool-8-thread-3) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestEventQueueAction instantiated
   [junit4]   2> 7121 DEBUG (simCloudManagerPool-8-thread-3) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 7123 DEBUG (simCloudManagerPool-8-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7124 DEBUG (simCloudManagerPool-8-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 7126 INFO  (simCloudManagerPool-8-thread-3) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestEventQueueAction instantiated
   [junit4]   2> 7126 DEBUG (simCloudManagerPool-8-thread-3) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 7126 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 7127 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 - Initial 
livenodes: [127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 7127 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated 
with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestEventQueueAction}],
 enabled=true}
   [junit4]   2> 7128 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7128 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 7129 DEBUG (ScheduledTrigger-9-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 7129 DEBUG (ScheduledTrigger-9-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 7142 DEBUG (ScheduledTrigger-9-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7151 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 7151 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 7162 DEBUG (ScheduledTrigger-9-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7170 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- creating marker: 
/autoscaling/nodeAdded/127.0.0.1:10004_solr
   [junit4]   2> 7171 DEBUG (ScheduledTrigger-9-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 7171 DEBUG (ScheduledTrigger-9-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7171 DEBUG (ScheduledTrigger-9-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10004_solr at time 
12139774066767019
   [junit4]   2> 7182 DEBUG (ScheduledTrigger-9-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 2
   [junit4]   2> 7192 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 7192 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7192 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing 
registered processor for nodes: [127.0.0.1:10004_solr] added at times 
[12139774066767019], now=12139775095794219
   [junit4]   2> 7192 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 7193 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger1]
   [junit4]   2> 7193 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 7194 DEBUG (ScheduledTrigger-9-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Removing new node from tracking: 127.0.0.1:10004_solr
   [junit4]   2> 7195 DEBUG (AutoscalingActionExecutor-10-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 7195 INFO  (AutoscalingActionExecutor-10-thread-1) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration -- event: {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 7195 INFO  
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 7195 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 7195 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 7195 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 7196 DEBUG (AutoscalingActionExecutor-10-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"]}}
   [junit4]   2> 7200 WARN  (AutoscalingActionExecutor-10-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Unhandled exception executing actions
   [junit4]   2>           => org.apache.solr.common.AlreadyClosedException: 
ScheduledTrigger node_added_trigger1 has been closed.
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.dequeue(ScheduledTriggers.java:583)
   [junit4]   2> org.apache.solr.common.AlreadyClosedException: 
ScheduledTrigger node_added_trigger1 has been closed.
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.dequeue(ScheduledTriggers.java:583)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:334)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_191]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_191]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_191]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_191]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
   [junit4]   2> 7200 DEBUG (AutoscalingActionExecutor-10-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 310 ms for event 
id=2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt
   [junit4]   2> 7206 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 7206 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 7206 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 7207 INFO  
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimCloudManager   = killing node 127.0.0.1:10002_solr
   [junit4]   2> 7207 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 7209 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider  -- created marker: 
/autoscaling/nodeLost/127.0.0.1:10002_solr
   [junit4]   2> 7209 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10004_solr
   [junit4]   2> 7216 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 7217 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestEventQueueAction instantiated
   [junit4]   2> 7217 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 7217 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 0
   [junit4]   2> 7217 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 7218 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 7218 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger Adding lost node from marker path: 
127.0.0.1:10002_solr
   [junit4]   2> 7221 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 - Initial 
livenodes: [127.0.0.1:10004_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 7222 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 3
   [junit4]   2> 7222 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10002_solr
   [junit4]   2> 7221 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated 
with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestEventQueueAction}],
 enabled=true}
   [junit4]   2> 7225 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:10004_solr
   [junit4]   2> 7226 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "_dequeue_time_":12139776782474469,
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"],
   [junit4]   2>     "replaying":true}}
   [junit4]   2> 7229 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger1]
   [junit4]   2> 7229 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "_dequeue_time_":12139776782474469,
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"],
   [junit4]   2>     "replaying":true}}
   [junit4]   2> 7230 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7230 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 7231 DEBUG (AutoscalingActionExecutor-15-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "_dequeue_time_":12139776782474469,
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"],
   [junit4]   2>     "replaying":true}}
   [junit4]   2> 7231 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 7231 DEBUG (ScheduledTrigger-14-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 7232 INFO  (AutoscalingActionExecutor-15-thread-1) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration -- event: {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "_dequeue_time_":12139776782474469,
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"],
   [junit4]   2>     "replaying":true}}
   [junit4]   2> 7233 DEBUG (AutoscalingActionExecutor-15-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":12139774066767019,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139774066767019],
   [junit4]   2>     "_dequeue_time_":12139776782474469,
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139775140302019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10004_solr"],
   [junit4]   2>     "replaying":true}}
   [junit4]   2> 7234 DEBUG (AutoscalingActionExecutor-15-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 7234 DEBUG (AutoscalingActionExecutor-15-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 100ms
   [junit4]   2> 7234 DEBUG (AutoscalingActionExecutor-15-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 165 ms for event 
id=2b210f68e734abT6e0yshk2p8p62qjnkpigow7qt
   [junit4]   2> 7318 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 7318 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 7318 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 7319 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 7319 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 7319 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 7319 DEBUG 
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 7319 INFO  
(TEST-TestSimTriggerIntegration.testEventQueue-seed#[1C6316640E8476E7]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testEventQueue
   [junit4]   2> 7325 INFO  
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
   [junit4]   2> 7337 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10005_solr
   [junit4]   2> 7338 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 7338 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
1
   [junit4]   2> 7339 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 7339 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 7340 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 7341 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 7341 INFO  
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics 
history in memory.
   [junit4]   2> 7342 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr]
   [junit4]   2> 7343 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7343 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 7344 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7345 DEBUG (simCloudManagerPool-17-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7346 DEBUG (simCloudManagerPool-17-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 7347 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 7347 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7347 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 7349 DEBUG (simCloudManagerPool-17-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7350 DEBUG (simCloudManagerPool-17-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 7351 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 7352 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 7352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial 
livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr]
   [junit4]   2> 7352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated 
with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 7352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7352 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 7353 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider -- creating marker: 
/autoscaling/nodeAdded/127.0.0.1:10007_solr
   [junit4]   2> 7353 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7353 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7353 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10007_solr at time 
12139783162690869
   [junit4]   2> 7370 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 2
   [junit4]   2> 7373 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7373 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7391 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7394 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7394 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7411 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7414 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7414 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7432 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7435 DEBUG (ScheduledTrigger-18-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7435 DEBUG (ScheduledTrigger-18-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7453 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7455 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7455 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7473 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7476 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7476 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7493 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7496 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7496 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7514 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7516 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7516 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7535 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7537 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7537 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7555 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 7557 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7557 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7557 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing 
registered processor for nodes: [127.0.0.1:10007_solr] added at times 
[12139783162690869], now=12139793368474769
   [junit4]   2> 7558 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b2111870ffd35T6e0yshk2p8p62qjnkpigow7qv",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139783162690869,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139783162690869],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10007_solr"]}}
   [junit4]   2> 7558 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger]
   [junit4]   2> 7560 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b2111870ffd35T6e0yshk2p8p62qjnkpigow7qv",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139783162690869,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139783162690869],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139793413608619,
   [junit4]   2>     "nodeNames":["127.0.0.1:10007_solr"]}}
   [junit4]   2> 7560 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Removing new node from tracking: 127.0.0.1:10007_solr
   [junit4]   2> 7564 DEBUG (AutoscalingActionExecutor-19-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b2111870ffd35T6e0yshk2p8p62qjnkpigow7qv",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139783162690869,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139783162690869],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139793413608619,
   [junit4]   2>     "nodeNames":["127.0.0.1:10007_solr"]}}
   [junit4]   2> 7565 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider -- creating marker: 
/autoscaling/nodeAdded/127.0.0.1:10008_solr
   [junit4]   2> 7566 DEBUG (AutoscalingActionExecutor-19-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b2111870ffd35T6e0yshk2p8p62qjnkpigow7qv",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139783162690869,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139783162690869],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139793413608619,
   [junit4]   2>     "nodeNames":["127.0.0.1:10007_solr"]}}
   [junit4]   2> 7566 DEBUG (AutoscalingActionExecutor-19-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 7566 DEBUG (AutoscalingActionExecutor-19-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 100ms
   [junit4]   2> 7566 DEBUG (AutoscalingActionExecutor-19-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 234 ms for event 
id=2b2111870ffd35T6e0yshk2p8p62qjnkpigow7qv
   [junit4]   2> 7666 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7666 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 3
   [junit4]   2> 7666 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7666 DEBUG (ScheduledTrigger-18-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10008_solr at time 
12139798828171219
   [junit4]   2> 7687 DEBUG (ScheduledTrigger-18-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7687 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7687 DEBUG (ScheduledTrigger-18-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7707 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7707 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7707 DEBUG (ScheduledTrigger-18-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7727 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7727 DEBUG (ScheduledTrigger-18-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7728 DEBUG (ScheduledTrigger-18-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7748 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7749 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7749 DEBUG (ScheduledTrigger-18-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7765 INFO  
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and 
clearing object cache...
   [junit4]   2> 7766 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool 
executor now
   [junit4]   2> 7766 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 7766 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 7767 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread 
pool executor
   [junit4]   2> 7767 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 7767 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 7767 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 7771 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 7772 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 0
   [junit4]   2> 7773 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 7779 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr, 127.0.0.1:10008_solr, 
127.0.0.1:10007_solr]
   [junit4]   2> 7782 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 7782 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial 
livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr, 127.0.0.1:10008_solr, 
127.0.0.1:10007_solr]
   [junit4]   2> 7783 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated 
with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 7783 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7783 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:10007_solr
   [junit4]   2> 7783 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:10008_solr
   [junit4]   2> 7787 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7787 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 7787 DEBUG (ScheduledTrigger-23-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7787 DEBUG (ScheduledTrigger-23-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7803 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7808 DEBUG (ScheduledTrigger-23-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7808 DEBUG (ScheduledTrigger-23-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7824 DEBUG (ScheduledTrigger-23-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7829 DEBUG (ScheduledTrigger-23-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7829 DEBUG (ScheduledTrigger-23-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7845 DEBUG (ScheduledTrigger-23-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7849 DEBUG (ScheduledTrigger-23-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7849 DEBUG (ScheduledTrigger-23-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7865 DEBUG (ScheduledTrigger-23-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 7869 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7869 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 7869 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing 
registered processor for nodes: [127.0.0.1:10008_solr] added at times 
[12139798828171219], now=12139808984150569
   [junit4]   2> 7870 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b21152ccc3fd3T6e0yshk2p8p62qjnkpigow7qw",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139798828171219,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139798828171219],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10008_solr"]}}
   [junit4]   2> 7871 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger]
   [junit4]   2> 7872 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b21152ccc3fd3T6e0yshk2p8p62qjnkpigow7qw",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139798828171219,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139798828171219],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139809079496369,
   [junit4]   2>     "nodeNames":["127.0.0.1:10008_solr"]}}
   [junit4]   2> 7873 DEBUG (ScheduledTrigger-23-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Removing new node from tracking: 127.0.0.1:10008_solr
   [junit4]   2> 7874 DEBUG (AutoscalingActionExecutor-24-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b21152ccc3fd3T6e0yshk2p8p62qjnkpigow7qw",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139798828171219,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139798828171219],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139809079496369,
   [junit4]   2>     "nodeNames":["127.0.0.1:10008_solr"]}}
   [junit4]   2> 7878 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool 
executor now
   [junit4]   2> 7878 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 7878 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 7878 WARN  (AutoscalingActionExecutor-24-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Exception sending event. Collection: .system, 
event: {
   [junit4]   2>   "id":"2b21152ccc3fd3T6e0yshk2p8p62qjnkpigow7qw",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139798828171219,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139798828171219],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139809079496369,
   [junit4]   2>     "nodeNames":["127.0.0.1:10008_solr"]}}, exception: 
java.io.IOException: already closed
   [junit4]   2> 7878 DEBUG (AutoscalingActionExecutor-24-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 226 ms for event 
id=2b21152ccc3fd3T6e0yshk2p8p62qjnkpigow7qw
   [junit4]   2> 7878 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 7879 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread 
pool executor
   [junit4]   2> 7879 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 7879 DEBUG 
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 7879 INFO  
(TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[1C6316640E8476E7])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testEventFromRestoredState
   [junit4]   2> 7886 INFO  
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testListeners
   [junit4]   2> 7894 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10009_solr
   [junit4]   2> 7897 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 7902 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
1
   [junit4]   2> 7903 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 7903 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 7903 INFO  
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 7913 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 7913 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 7915 DEBUG (simCloudManagerPool-26-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7916 DEBUG (simCloudManagerPool-26-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 7916 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10010_solr, 127.0.0.1:10009_solr]
   [junit4]   2> 7917 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7917 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7919 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 7923 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 7930 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7930 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 7935 DEBUG (simCloudManagerPool-26-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7935 DEBUG (simCloudManagerPool-26-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 7936 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 7937 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 7937 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial 
livenodes: [127.0.0.1:10010_solr, 127.0.0.1:10009_solr]
   [junit4]   2> 7937 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated 
with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerAction},
 {name=test1, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestDummyAction}],
 enabled=true}
   [junit4]   2> 7938 DEBUG (ScheduledTrigger-27-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7939 DEBUG (ScheduledTrigger-27-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 7939 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7939 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 7943 DEBUG (ScheduledTrigger-27-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7945 DEBUG (simCloudManagerPool-26-thread-4) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7946 DEBUG (simCloudManagerPool-26-thread-4) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 7948 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 7948 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7948 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 7955 DEBUG (simCloudManagerPool-26-thread-5) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 7956 DEBUG (simCloudManagerPool-26-thread-5) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
5
   [junit4]   2> 7958 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 7958 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 7958 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 7960 DEBUG (ScheduledTrigger-27-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7960 DEBUG (ScheduledTrigger-27-thread-3) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 7965 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 7975 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- creating marker: 
/autoscaling/nodeAdded/127.0.0.1:10011_solr
   [junit4]   2> 7980 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 7980 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 7980 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10011_solr at time 
12139814519419319
   [junit4]   2> 7985 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 2
   [junit4]   2> 8001 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 8001 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 8001 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing 
registered processor for nodes: [127.0.0.1:10011_solr] added at times 
[12139814519419319], now=12139815549198469
   [junit4]   2> 8001 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b2118d411b1b7T6e0yshk2p8p62qjnkpigow7qy",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139814519419319,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139814519419319],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10011_solr"]}}
   [junit4]   2> 8001 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger]
   [junit4]   2> 8002 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b2118d411b1b7T6e0yshk2p8p62qjnkpigow7qy",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139814519419319,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139814519419319],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139815586078369,
   [junit4]   2>     "nodeNames":["127.0.0.1:10011_solr"]}}
   [junit4]   2> 8004 DEBUG (ScheduledTrigger-27-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Removing new node from tracking: 127.0.0.1:10011_solr
   [junit4]   2> 8004 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b2118d411b1b7T6e0yshk2p8p62qjnkpigow7qy",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139814519419319,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139814519419319],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139815586078369,
   [junit4]   2>     "nodeNames":["127.0.0.1:10011_solr"]}}
   [junit4]   2> 8007 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b2118d411b1b7T6e0yshk2p8p62qjnkpigow7qy",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139814519419319,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139814519419319],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139815586078369,
   [junit4]   2>     "nodeNames":["127.0.0.1:10011_solr"]}}
   [junit4]   2> 8009 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- creating marker: 
/autoscaling/nodeAdded/127.0.0.1:10012_solr
   [junit4]   2> 8010 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 100ms
   [junit4]   2> 8010 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 8010 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 286 ms for event 
id=2b2118d411b1b7T6e0yshk2p8p62qjnkpigow7qy
   [junit4]   2> 8110 DEBUG (ScheduledTrigger-27-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 8110 DEBUG (ScheduledTrigger-27-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 3
   [junit4]   2> 8110 DEBUG (ScheduledTrigger-27-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 8110 DEBUG (ScheduledTrigger-27-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10012_solr at time 
12139821022362069
   [junit4]   2> 8131 DEBUG (ScheduledTrigger-27-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 8131 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 8131 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 8131 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing 
registered processor for nodes: [127.0.0.1:10012_solr] added at times 
[12139821022362069], now=12139822069778269
   [junit4]   2> 8131 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139821022362069,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139821022362069],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10012_solr"]}}
   [junit4]   2> 8132 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger]
   [junit4]   2> 8132 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139821022362069,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139821022362069],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139822091077019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10012_solr"]}}
   [junit4]   2> 8132 DEBUG (ScheduledTrigger-27-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Removing new node from tracking: 127.0.0.1:10012_solr
   [junit4]   2> 8133 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139821022362069,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139821022362069],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139822091077019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10012_solr"]}}
   [junit4]   2> 8134 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139821022362069,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139821022362069],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139822091077019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10012_solr"]}}
   [junit4]   2> 8134 WARN  (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Exception executing actions
   [junit4]   2>           => 
org.apache.solr.cloud.autoscaling.TriggerActionException: Error processing 
action for trigger event: {
   [junit4]   2>   "id":"2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz",
   [junit4]   2> org.apache.solr.cloud.autoscaling.TriggerActionException: 
Error processing action for trigger event: {
   [junit4]   2>   "id":"2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":12139821022362069,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[12139821022362069],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":12139822091077019,
   [junit4]   2>     "nodeNames":["127.0.0.1:10012_solr"]}}
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:327)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_191]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_191]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_191]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_191]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
   [junit4]   2> Caused by: java.lang.RuntimeException: failure
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestDummyAction.process(TestSimTriggerIntegration.java:1046)
 ~[test/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:324)
 ~[java/:?]
   [junit4]   2>        ... 6 more
   [junit4]   2> 8134 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 100ms
   [junit4]   2> 8137 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 8137 DEBUG (AutoscalingActionExecutor-28-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 219 ms for event 
id=2b211a57acb9d5T6e0yshk2p8p62qjnkpigow7qz
   [junit4]   2> 8137 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 8138 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 8138 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 8139 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 8142 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 8142 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 8142 DEBUG 
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 8143 INFO  
(TEST-TestSimTriggerIntegration.testListeners-seed#[1C6316640E8476E7]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testListeners
   [junit4]   2> 8157 INFO  
(TEST-TestSimTriggerIntegration.testNodeLostTriggerRestoreState-seed#[1C6316640E8476E7])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTriggerRestoreState
   [junit4]   2> 8168 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTriggerRestoreState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10013_solr
   [junit4]   2> 8168 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 8169 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
1
   [junit4]   2> 8170 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 8170 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] 
o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 8174 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTriggerRestoreState-seed#[1C6316640E8476E7])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 8174 DEBUG 
(TEST-TestSimTriggerIntegration.testNodeLostTriggerRest

[...truncated too long message...]

ve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/null79461813
     [copy] Copying 238 files to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/null79461813
   [delete] Deleting directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/null79461813

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: 
org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath]         confs: [default]
[ivy:cachepath]         found 
org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath]         found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath]         found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath]         found org.apache.httpcomponents#httpclient;4.3.6 in 
public
[ivy:cachepath]         found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath]         found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath]         found commons-codec#commons-codec;1.6 in public
[ivy:cachepath]         found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 74ms :: artifacts dl 4ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for 
further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 248 minutes 17 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2847)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2726)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2707)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3086)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene
                at 
hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at 
hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1072)
                at hudson.FilePath.act(FilePath.java:1061)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2705)
                at 
hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at 
hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1835)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at 
hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3088)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no 
matches found within 10000
        at hudson.FilePath.act(FilePath.java:1074)
        at hudson.FilePath.act(FilePath.java:1061)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2705)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1835)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern 
"**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to