Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/455/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([3F01A234DFA2AC1:B9FC2DAC1212FC8E]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.junit.Assert.assertNull(Assert.java:562)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12357 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> 240933 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/init-core-data-001
   [junit4]   2> 240934 WARN  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=28 numCloses=28
   [junit4]   2> 240934 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 240935 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 240935 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001
   [junit4]   2> 240935 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 240936 INFO  (Thread-432) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 240936 INFO  (Thread-432) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 240939 ERROR (Thread-432) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 241036 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:59429
   [junit4]   2> 241151 INFO  (zkConnectionManagerCallback-411-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241158 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 241158 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 241161 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 241161 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 241161 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 241162 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@47734f1c{/solr,null,AVAILABLE}
   [junit4]   2> 241164 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7e9b2b9a{HTTP/1.1,[http/1.1]}{127.0.0.1:59434}
   [junit4]   2> 241164 INFO  (jetty-launcher-408-thread-1) [    ] 
o.e.j.s.Server Started @243175ms
   [junit4]   2> 241164 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59434}
   [junit4]   2> 241164 ERROR (jetty-launcher-408-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 241165 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 241165 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 241165 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 241165 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:35:34.704411Z
   [junit4]   2> 241166 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 241166 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 241166 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 241167 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@27e09fd{/solr,null,AVAILABLE}
   [junit4]   2> 241167 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@2eab9a6d{HTTP/1.1,[http/1.1]}{127.0.0.1:59435}
   [junit4]   2> 241167 INFO  (jetty-launcher-408-thread-2) [    ] 
o.e.j.s.Server Started @243178ms
   [junit4]   2> 241167 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59435}
   [junit4]   2> 241167 ERROR (jetty-launcher-408-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 241168 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 241168 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 241168 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 241168 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:35:34.707250Z
   [junit4]   2> 241171 INFO  (zkConnectionManagerCallback-415-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241173 INFO  (zkConnectionManagerCallback-413-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241174 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 241174 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 241185 INFO  (jetty-launcher-408-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 241190 INFO  (jetty-launcher-408-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 241191 INFO  (zkConnectionManagerCallback-419-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241199 INFO  (zkConnectionManagerCallback-423-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241200 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1000a6c0c6f0003, likely client has closed socket
   [junit4]   2> 241202 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1000a6c0c6f0004, likely client has closed socket
   [junit4]   2> 241204 INFO  
(zkConnectionManagerCallback-425-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241205 INFO  
(zkConnectionManagerCallback-427-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241417 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 241417 INFO  (jetty-launcher-408-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 241419 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:59435_solr
   [junit4]   2> 241420 INFO  (jetty-launcher-408-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59434_solr
   [junit4]   2> 241421 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.Overseer Overseer 
(id=72069053219274757-127.0.0.1:59435_solr-n_0000000000) starting
   [junit4]   2> 241424 INFO  
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 241425 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 241438 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 241444 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 1
   [junit4]   2> 241447 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:59434_solr]
   [junit4]   2> 241447 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 241447 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 1
   [junit4]   2> 241448 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59435_solr
   [junit4]   2> 241454 INFO  
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 241455 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 241459 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 241463 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 241464 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 2
   [junit4]   2> 241480 INFO  (jetty-launcher-408-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59434.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241492 INFO  (jetty-launcher-408-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59434.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241493 INFO  (jetty-launcher-408-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59434.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241495 INFO  (jetty-launcher-408-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001/node1/.
   [junit4]   2> 241496 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59435.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241504 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59435.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241504 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59435.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241505 INFO  (jetty-launcher-408-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001/node2/.
   [junit4]   2> 241538 INFO  (zkConnectionManagerCallback-433-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241544 INFO  (zkConnectionManagerCallback-437-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241547 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 241548 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59429/solr ready
   [junit4]   2> 241569 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
   [junit4]   2> 241569 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode 
version 2
   [junit4]   2> 241570 DEBUG 
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 2
   [junit4]   2> 241570 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 2
   [junit4]   2> 241574 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 241575 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 241575 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 241598 INFO  (qtp1643791705-2025) [n:127.0.0.1:59434_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 241600 INFO  (qtp904488614-2038) [n:127.0.0.1:59435_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 241600 DEBUG (qtp904488614-2034) [n:127.0.0.1:59435_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 241601 INFO  (qtp904488614-2034) [n:127.0.0.1:59435_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 241602 DEBUG 
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 3
   [junit4]   2> 241610 DEBUG 
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:59435_solr, 127.0.0.1:59434_solr]
   [junit4]   2> 241610 DEBUG 
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS instantiated with properties: {event=nodeAdded, 
waitFor=10, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 241610 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 3
   [junit4]   2> 241613 INFO  
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 241614 INFO  (qtp904488614-2036) [n:127.0.0.1:59435_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 241615 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 241616 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 241616 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 241617 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 241626 INFO  (qtp904488614-2036) [n:127.0.0.1:59435_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=12
   [junit4]   2> 241628 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 241631 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 241631 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 241631 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 241631 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7383e7a6{/solr,null,AVAILABLE}
   [junit4]   2> 241632 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.AbstractConnector Started 
ServerConnector@1e89725f{HTTP/1.1,[http/1.1]}{127.0.0.1:59447}
   [junit4]   2> 241632 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.Server Started @243642ms
   [junit4]   2> 241632 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59447}
   [junit4]   2> 241632 ERROR 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 241632 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ 
version 7.3.0
   [junit4]   2> 241633 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 241633 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 241633 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:35:35.172059Z
   [junit4]   2> 241638 INFO  (zkConnectionManagerCallback-439-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241640 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 241647 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 241652 INFO  (zkConnectionManagerCallback-443-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241658 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1000a6c0c6f000a, likely client has closed socket
   [junit4]   2> 241660 INFO  
(zkConnectionManagerCallback-445-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 241691 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 241694 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 241699 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59447_solr
   [junit4]   2> 241714 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 241727 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 241727 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 241728 INFO  
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 241752 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59447.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241760 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59447.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241760 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59447.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 241761 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001/node3/.
   [junit4]   2> 242626 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 242626 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 242626 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:59447_solr at time 174854919736351
   [junit4]   2> 243631 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 243631 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 243634 INFO  
(OverseerCollectionConfigSetProcessor-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 244642 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 244642 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 245643 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 245643 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 246651 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 246651 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 247659 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 247659 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 248672 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 248672 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 249673 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 249673 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 250678 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 250678 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 251683 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 251684 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 252687 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 252687 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 252687 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS firing registered processor for nodes: 
[127.0.0.1:59447_solr] added at times [174854919736351], now=174864980117369
   [junit4]   2> 252691 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"9f079560cc1fT5pqi9rij36dtzmu0grpli9m98",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":174854919736351,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[174854919736351],
   [junit4]   2>     "nodeNames":["127.0.0.1:59447_solr"]}}
   [junit4]   2> 252693 DEBUG (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_triggerEFRS]
   [junit4]   2> 252696 INFO  (ScheduledTrigger-867-thread-2) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 252699 DEBUG 
(AutoscalingActionExecutor-868-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"9f079560cc1fT5pqi9rij36dtzmu0grpli9m98",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":174854919736351,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[174854919736351],
   [junit4]   2>     "_enqueue_time_":174864986293474,
   [junit4]   2>     "nodeNames":["127.0.0.1:59447_solr"]}}
   [junit4]   2> 252703 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 252707 DEBUG 
(AutoscalingActionExecutor-868-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_triggerEFRS after 5000ms
   [junit4]   2> 252707 DEBUG 
(AutoscalingActionExecutor-868-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 7 
ms for event id=9f079560cc1fT5pqi9rij36dtzmu0grpli9m98
   [junit4]   2> 252707 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 252707 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 252707 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 252711 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@91c54bc{/solr,null,AVAILABLE}
   [junit4]   2> 252712 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.AbstractConnector Started 
ServerConnector@7187bbbc{HTTP/1.1,[http/1.1]}{127.0.0.1:59454}
   [junit4]   2> 252713 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.Server Started @254723ms
   [junit4]   2> 252713 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59454}
   [junit4]   2> 252713 ERROR 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 252725 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ 
version 7.3.0
   [junit4]   2> 252725 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 252725 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 252725 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:35:46.264454Z
   [junit4]   2> 252755 INFO  (zkConnectionManagerCallback-449-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 252758 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 252799 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 252801 INFO  (zkConnectionManagerCallback-453-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 252805 INFO  
(zkConnectionManagerCallback-455-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 252817 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 252824 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 252827 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59454_solr
   [junit4]   2> 252831 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 252831 INFO  
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 252831 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 252832 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 252831 INFO  
(zkCallback-454-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 252885 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59454.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 252894 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59454.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 252894 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59454.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 252897 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001/node4/.
   [junit4]   2> 257719 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 257719 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 257719 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:59454_solr at time 174870012879115
   [junit4]   2> 258886 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 258886 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 259887 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 259887 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 260887 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 260887 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 261888 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 261888 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 262892 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 262892 DEBUG (ScheduledTrigger-867-thread-1) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 262986 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.AbstractConnector Stopped 
ServerConnector@2eab9a6d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 262986 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=83386686
   [junit4]   2> 262987 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node, tag=null
   [junit4]   2> 262987 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2dbd3aad: rootName = 
solr_59435, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@7f607b28
   [junit4]   2> 263002 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm, tag=null
   [junit4]   2> 263002 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4f785783: rootName = 
solr_59435, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@2ee8c2c0
   [junit4]   2> 263014 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 263014 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6d5f2393: rootName = 
solr_59435, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@2ef31444
   [junit4]   2> 263016 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59435_solr
   [junit4]   2> 263018 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 263018 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 263018 INFO  
(zkCallback-454-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 263019 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 263019 INFO  
(zkCallback-424-thread-1-processing-n:127.0.0.1:59435_solr) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 263019 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 263019 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 263019 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.Overseer Overseer 
(id=72069053219274757-127.0.0.1:59435_solr-n_0000000000) closing
   [junit4]   2> 263019 INFO  
(OverseerStateUpdate-72069053219274757-127.0.0.1:59435_solr-n_0000000000) 
[n:127.0.0.1:59435_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:59435_solr
   [junit4]   2> 263020 DEBUG 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 263021 WARN  
(OverseerAutoScalingTriggerThread-72069053219274757-127.0.0.1:59435_solr-n_0000000000)
 [n:127.0.0.1:59435_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 263023 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:59434_solr
   [junit4]   2> 263023 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@27e09fd{/solr,null,UNAVAILABLE}
   [junit4]   2> 263024 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 263025 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.Overseer Overseer 
(id=72069053219274758-127.0.0.1:59434_solr-n_0000000001) starting
   [junit4]   2> 263036 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 263037 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 4
   [junit4]   2> 263038 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:59454_solr, 127.0.0.1:59434_solr, 127.0.0.1:59447_solr]
   [junit4]   2> 263038 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS instantiated with properties: {event=nodeAdded, 
waitFor=10, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 263039 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:59454_solr, 127.0.0.1:59434_solr, 127.0.0.1:59447_solr]
   [junit4]   2> 263039 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 4, lastZnodeVersion -1
   [junit4]   2> 263039 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 4
   [junit4]   2> 263039 INFO  
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 263040 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Adding node from 
marker path: 127.0.0.1:59454_solr
   [junit4]   2> 263042 DEBUG (ScheduledTrigger-888-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 263042 DEBUG (ScheduledTrigger-888-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 263044 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 263045 DEBUG (ScheduledTrigger-888-thread-1) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 264055 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 264056 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 264056 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 265064 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 265064 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 265064 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 266068 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 266068 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 266068 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 267069 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 267069 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 267069 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 268073 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 268073 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 268073 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 268073 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS firing registered processor for nodes: 
[127.0.0.1:59454_solr] added at times [174870012879115], now=174880366915328
   [junit4]   2> 268074 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"9f0b18ffe10bT5pqi9rij36dtzmu0grpli9m9a",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":174870012879115,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[174870012879115],
   [junit4]   2>     "nodeNames":["127.0.0.1:59454_solr"]}}
   [junit4]   2> 268074 DEBUG (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[.auto_add_replicas, node_added_triggerEFRS]
   [junit4]   2> 268076 INFO  (ScheduledTrigger-888-thread-2) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 268076 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"9f0b18ffe10bT5pqi9rij36dtzmu0grpli9m9a",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":174870012879115,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[174870012879115],
   [junit4]   2>     "_enqueue_time_":174880367647934,
   [junit4]   2>     "nodeNames":["127.0.0.1:59454_solr"]}}
   [junit4]   2> 268077 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[3F01A234DFA2AC1]) 
[    ] o.a.s.SolrTestCaseJ4 ###Ending testEventFromRestoredState
   [junit4]   2> 268078 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
.auto_add_replicas after 5000ms
   [junit4]   2> 268078 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_triggerEFRS after 5000ms
   [junit4]   2> 268078 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 1 
ms for event id=9f0b18ffe10bT5pqi9rij36dtzmu0grpli9m9a
   [junit4]   2> 268113 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTriggerRestoreState
   [junit4]   2> 268114 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode 
version 5
   [junit4]   2> 268114 DEBUG 
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 5
   [junit4]   2> 268114 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 5
   [junit4]   2> 268118 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 268118 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 268119 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 268120 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 268121 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 268121 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 268121 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 268122 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@503f649{/solr,null,AVAILABLE}
   [junit4]   2> 268122 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.AbstractConnector Started 
ServerConnector@fd55643{HTTP/1.1,[http/1.1]}{127.0.0.1:59515}
   [junit4]   2> 268123 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.Server Started @270133ms
   [junit4]   2> 268123 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59515}
   [junit4]   2> 268123 ERROR 
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 268128 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ 
version 7.3.0
   [junit4]   2> 268128 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 268128 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 268128 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:36:01.667742Z
   [junit4]   2> 268133 INFO  (zkConnectionManagerCallback-459-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 268135 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 268175 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 268177 INFO  (zkConnectionManagerCallback-463-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 268183 INFO  
(zkConnectionManagerCallback-465-thread-1-processing-n:127.0.0.1:59515_solr) 
[n:127.0.0.1:59515_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 268197 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 268201 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 268205 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59515_solr
   [junit4]   2> 268212 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 268212 INFO  
(zkCallback-454-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 268212 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 268212 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 268213 INFO  
(zkCallback-464-thread-1-processing-n:127.0.0.1:59515_solr) 
[n:127.0.0.1:59515_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 268259 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59515.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 268268 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59515.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 268268 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59515.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 268270 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [n:127.0.0.1:59515_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001/node5/.
   [junit4]   2> 268419 INFO  (qtp1643791705-2030) [n:127.0.0.1:59434_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=1
   [junit4]   2> 268429 INFO  (qtp756144832-2090) [n:127.0.0.1:59447_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 268435 INFO  (qtp229540637-2116) [n:127.0.0.1:59454_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 268439 INFO  (qtp1267208328-2150) [n:127.0.0.1:59515_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 268439 DEBUG (qtp1643791705-2029) [n:127.0.0.1:59434_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 268440 INFO  (qtp1643791705-2029) [n:127.0.0.1:59434_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=27
   [junit4]   2> 268441 DEBUG 
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 6
   [junit4]   2> 268442 DEBUG 
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:59515_solr, 127.0.0.1:59454_solr, 127.0.0.1:59434_solr, 
127.0.0.1:59447_solr]
   [junit4]   2> 268442 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 6
   [junit4]   2> 268442 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.AbstractConnector Stopped 
ServerConnector@fd55643{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 268442 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1209596117
   [junit4]   2> 268443 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node, tag=null
   [junit4]   2> 268443 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4b8bfc6c: rootName = 
solr_59515, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@46d129a2
   [junit4]   2> 268445 INFO  
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 268446 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 268446 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 268447 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_restore_trigger with currently live nodes: 4
   [junit4]   2> 268455 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm, tag=null
   [junit4]   2> 268455 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6ef882df: rootName = 
solr_59515, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@2ee8c2c0
   [junit4]   2> 268464 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 268464 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6b46ac09: rootName = 
solr_59515, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@2ef31444
   [junit4]   2> 268467 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59515_solr
   [junit4]   2> 268468 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 268468 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 268469 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 268469 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 268469 INFO  
(zkCallback-454-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 268469 INFO  
(zkCallback-464-thread-1-processing-n:127.0.0.1:59515_solr) 
[n:127.0.0.1:59515_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 268469 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 268471 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@503f649{/solr,null,UNAVAILABLE}
   [junit4]   2> 268471 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 269451 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_restore_trigger with currently live nodes: 3
   [junit4]   2> 269451 DEBUG (ScheduledTrigger-888-thread-3) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 
127.0.0.1:59515_solr
   [junit4]   2> 269987 INFO  (qtp1643791705-2032) [n:127.0.0.1:59434_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 269991 INFO  (qtp756144832-2094) [n:127.0.0.1:59447_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 269993 INFO  (qtp229540637-2118) [n:127.0.0.1:59454_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 269994 DEBUG (qtp229540637-2120) [n:127.0.0.1:59454_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 269997 INFO  (qtp229540637-2120) [n:127.0.0.1:59454_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=13
   [junit4]   2> 269998 DEBUG 
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 7
   [junit4]   2> 269999 DEBUG 
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:59454_solr, 127.0.0.1:59434_solr, 127.0.0.1:59447_solr]
   [junit4]   2> 269999 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 7
   [junit4]   2> 270000 INFO  
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 270000 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Adding lost node from 
marker path: 127.0.0.1:59515_solr
   [junit4]   2> 270001 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 270001 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_restore_trigger with currently live nodes: 3
   [junit4]   2> 270001 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing 
registered processor for lost nodes: [127.0.0.1:59515_solr]
   [junit4]   2> 270001 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"9f0df4fe50e2T5pqi9rij36dtzmu0grpli9m9c",
   [junit4]   2>   "source":"node_lost_restore_trigger",
   [junit4]   2>   "eventTime":174882293698786,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[174882293698786],
   [junit4]   2>     "nodeNames":["127.0.0.1:59515_solr"]}}
   [junit4]   2> 270001 DEBUG (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_lost_restore_trigger]
   [junit4]   2> 270002 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 270003 INFO  (ScheduledTrigger-888-thread-4) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 270003 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"9f0df4fe50e2T5pqi9rij36dtzmu0grpli9m9c",
   [junit4]   2>   "source":"node_lost_restore_trigger",
   [junit4]   2>   "eventTime":174882293698786,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[174882293698786],
   [junit4]   2>     "_enqueue_time_":174882294986828,
   [junit4]   2>     "nodeNames":["127.0.0.1:59515_solr"]}}
   [junit4]   2> 270003 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[3F01A234DFA2AC1])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTriggerRestoreState
   [junit4]   2> 270008 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_lost_restore_trigger after 5000ms
   [junit4]   2> 270008 DEBUG 
(AutoscalingActionExecutor-889-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 4 
ms for event id=9f0df4fe50e2T5pqi9rij36dtzmu0grpli9m9c
   [junit4]   2> 270046 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testSearchRate
   [junit4]   2> 270047 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 8
   [junit4]   2> 270048 DEBUG 
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 8
   [junit4]   2> 270048 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 8
   [junit4]   2> 270051 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 270051 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 270053 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 270053 DEBUG 
(OverseerAutoScalingTriggerThread-72069053219274758-127.0.0.1:59434_solr-n_0000000001)
 [n:127.0.0.1:59434_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 270055 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 270055 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 270055 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 270055 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@760875cb{/solr,null,AVAILABLE}
   [junit4]   2> 270056 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@74a19488{HTTP/1.1,[http/1.1]}{127.0.0.1:59528}
   [junit4]   2> 270056 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.Server Started @272066ms
   [junit4]   2> 270056 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59528}
   [junit4]   2> 270056 ERROR 
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 270056 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 270057 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 270057 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 270057 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:36:03.596142Z
   [junit4]   2> 270065 INFO  (zkConnectionManagerCallback-469-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 270066 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 270080 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 270084 INFO  (zkConnectionManagerCallback-473-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 270089 INFO  
(zkConnectionManagerCallback-475-thread-1-processing-n:127.0.0.1:59528_solr) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 270100 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 270104 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 270107 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59528_solr
   [junit4]   2> 270115 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 270115 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 270115 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 270115 INFO  
(zkCallback-454-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 270137 INFO  
(zkCallback-474-thread-1-processing-n:127.0.0.1:59528_solr) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 270166 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59528.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 270177 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59528.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 270177 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59528.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 270178 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001/tempDir-001/node6/.
   [junit4]   2> 270226 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 270227 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 270227 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 270228 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 270228 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5dc0b9a5{/solr,null,AVAILABLE}
   [junit4]   2> 270228 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@355256a8{HTTP/1.1,[http/1.1]}{127.0.0.1:59532}
   [junit4]   2> 270228 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.e.j.s.Server Started @272239ms
   [junit4]   2> 270228 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59532}
   [junit4]   2> 270229 ERROR 
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 270229 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 270229 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 270229 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 270229 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-16T07:36:03.768293Z
   [junit4]   2> 270231 INFO  (zkConnectionManagerCallback-479-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 270232 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 270246 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59429/solr
   [junit4]   2> 270248 INFO  (zkConnectionManagerCallback-483-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 270252 INFO  
(zkConnectionManagerCallback-485-thread-1-processing-n:127.0.0.1:59532_solr) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 270265 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 270269 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 270273 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59532_solr
   [junit4]   2> 270276 INFO  (zkCallback-436-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 270276 INFO  
(zkCallback-444-thread-1-processing-n:127.0.0.1:59447_solr) 
[n:127.0.0.1:59447_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 270276 INFO  
(zkCallback-454-thread-1-processing-n:127.0.0.1:59454_solr) 
[n:127.0.0.1:59454_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 270276 INFO  
(zkCallback-426-thread-1-processing-n:127.0.0.1:59434_solr) 
[n:127.0.0.1:59434_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 270276 INFO  
(zkCallback-474-thread-1-processing-n:127.0.0.1:59528_solr) 
[n:127.0.0.1:59528_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 270277 INFO  
(zkCallback-484-thread-1-processing-n:127.0.0.1:59532_solr) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 270312 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59532.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 270320 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59532.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 270320 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59532.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@55f1358a
   [junit4]   2> 270321 INFO  
(TEST-TriggerIntegrationTest.testSearchRate-seed#[3F01A234DFA2AC1]) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.

[...truncated too long message...]

2> 424890 INFO  (jetty-closer-409-thread-3) [    ] o.a.s.m.SolrMetricManager 
Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 424891 INFO  (coreCloseExecutor-1069-thread-1) 
[n:127.0.0.1:59741_solr c:testMetricTrigger s:shard1 r:core_node3 
x:testMetricTrigger_shard1_replica_n1] o.a.s.c.SolrCore 
[testMetricTrigger_shard1_replica_n1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5e140388
   [junit4]   2> 424891 INFO  (coreCloseExecutor-1069-thread-1) 
[n:127.0.0.1:59741_solr c:testMetricTrigger s:shard1 r:core_node3 
x:testMetricTrigger_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.core.testMetricTrigger.shard1.replica_n1, 
tag=1578369928
   [junit4]   2> 424891 INFO  (coreCloseExecutor-1069-thread-1) 
[n:127.0.0.1:59741_solr c:testMetricTrigger s:shard1 r:core_node3 
x:testMetricTrigger_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing 
reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@699def2e: rootName 
= solr_59741, domain = solr.core.testMetricTrigger.shard1.replica_n1, service 
url = null, agent id = null] for registry 
solr.core.testMetricTrigger.shard1.replica_n1 / 
com.codahale.metrics.MetricRegistry@86b3e72
   [junit4]   2> 424892 INFO  
(zkCallback-517-thread-3-processing-n:127.0.0.1:59741_solr) 
[n:127.0.0.1:59741_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (0)
   [junit4]   2> 424892 INFO  
(zkCallback-484-thread-6-processing-n:127.0.0.1:59532_solr) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (0)
   [junit4]   2> 424894 INFO  (jetty-closer-409-thread-9) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 424894 INFO  (jetty-closer-409-thread-4) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 424894 INFO  (jetty-closer-409-thread-7) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 424895 INFO  (jetty-closer-409-thread-2) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 424896 INFO  (jetty-closer-409-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72069053219274775-127.0.0.1:59532_solr-n_0000000006) closing
   [junit4]   2> 424896 INFO  
(OverseerStateUpdate-72069053219274775-127.0.0.1:59532_solr-n_0000000006) 
[n:127.0.0.1:59532_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:59532_solr
   [junit4]   2> 424898 WARN  
(OverseerAutoScalingTriggerThread-72069053219274775-127.0.0.1:59532_solr-n_0000000006)
 [n:127.0.0.1:59532_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 424899 DEBUG (jetty-closer-409-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 424901 INFO  (jetty-closer-409-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5dc0b9a5{/solr,null,UNAVAILABLE}
   [junit4]   2> 424901 INFO  
(zkCallback-517-thread-3-processing-n:127.0.0.1:59741_solr) 
[n:127.0.0.1:59741_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:59741_solr
   [junit4]   2> 424901 INFO  (jetty-closer-409-thread-1) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 424904 INFO  (coreCloseExecutor-1069-thread-1) 
[n:127.0.0.1:59741_solr c:testMetricTrigger s:shard1 r:core_node3 
x:testMetricTrigger_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.testMetricTrigger.shard1.leader, 
tag=1578369928
   [junit4]   2> 424908 INFO  (jetty-closer-409-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@402620ff{/solr,null,UNAVAILABLE}
   [junit4]   2> 424908 INFO  (jetty-closer-409-thread-3) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 426379 WARN  
(zkCallback-619-thread-1-processing-n:127.0.0.1:60098_solr) 
[n:127.0.0.1:60098_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 426379 WARN  
(zkCallback-537-thread-1-processing-n:127.0.0.1:59771_solr) 
[n:127.0.0.1:59771_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 426379 WARN  
(zkCallback-609-thread-1-processing-n:127.0.0.1:60080_solr) 
[n:127.0.0.1:60080_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 426380 INFO  (jetty-closer-409-thread-5) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@8ec8db9{/solr,null,UNAVAILABLE}
   [junit4]   2> 426380 INFO  (jetty-closer-409-thread-5) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 426380 INFO  (jetty-closer-409-thread-12) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@52296bcd{/solr,null,UNAVAILABLE}
   [junit4]   2> 426380 INFO  (jetty-closer-409-thread-12) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 426380 INFO  (jetty-closer-409-thread-11) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@22b8344c{/solr,null,UNAVAILABLE}
   [junit4]   2> 426380 INFO  (jetty-closer-409-thread-11) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 426392 WARN  
(zkCallback-599-thread-2-processing-n:127.0.0.1:59958_solr) 
[n:127.0.0.1:59958_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 426393 INFO  (jetty-closer-409-thread-10) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@738c86c0{/solr,null,UNAVAILABLE}
   [junit4]   2> 426393 INFO  (jetty-closer-409-thread-10) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 426393 INFO  (jetty-closer-409-thread-8) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@548b7768{/solr,null,UNAVAILABLE}
   [junit4]   2> 426393 INFO  (jetty-closer-409-thread-8) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 426395 ERROR 
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 426395 INFO  
(SUITE-TriggerIntegrationTest-seed#[3F01A234DFA2AC1]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:59429 59429
   [junit4]   2> 426398 INFO  (Thread-432) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:59429 59429
   [junit4]   2> 426525 WARN  (Thread-432) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        22      /solr/clusterprops.json
   [junit4]   2>        22      /solr/aliases.json
   [junit4]   2>        21      /solr/security.json
   [junit4]   2>        21      /solr/collections/collection1/terms/shard1
   [junit4]   2>        6       /solr/configs/conf
   [junit4]   2>        2       /solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2>        2       /solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        70      /solr/collections/collection1/state.json
   [junit4]   2>        22      /solr/clusterstate.json
   [junit4]   2>        13      /solr/collections/testMetricTrigger/state.json
   [junit4]   2>        6       /solr/autoscaling.json
   [junit4]   2>        3       
/solr/overseer_elect/election/72069053219274790-127.0.0.1:59771_solr-n_0000000011
   [junit4]   2>        2       
/solr/overseer_elect/election/72069053219274778-127.0.0.1:59536_solr-n_0000000007
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72069053219274763-core_node6-n_0000000002
   [junit4]   2>        2       
/solr/overseer_elect/election/72069053219274787-127.0.0.1:59755_solr-n_0000000010
   [junit4]   2>        2       
/solr/overseer_elect/election/72069053219274766-127.0.0.1:59454_solr-n_0000000003
   [junit4]   2>        2       
/solr/overseer_elect/election/72069053219274775-127.0.0.1:59532_solr-n_0000000006
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72069053219274775-core_node3-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        22      /solr/live_nodes
   [junit4]   2>        22      /solr/collections
   [junit4]   2>        6       /solr/overseer/queue-work
   [junit4]   2>        6       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        6       /solr/overseer/queue
   [junit4]   2>        5       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_3F01A234DFA2AC1-001
   [junit4]   2> Feb 16, 2018 7:38:40 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene70, 
sim=RandomSimilarity(queryNorm=true): {}, locale=sn-ZW, timezone=America/Denver
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 
(64-bit)/cpus=3,threads=1,free=79801536,total=313524224
   [junit4]   2> NOTE: All tests run in this JVM: [TestLegacyField, 
TestScoreJoinQPNoScore, RegexBoostProcessorTest, TestCollectionAPIs, 
TestLocalFSCloudBackupRestore, MetricsConfigTest, CurrencyRangeFacetCloudTest, 
TestPrepRecovery, TestHashPartitioner, DataDrivenBlockJoinTest, 
TestAddFieldRealTimeGet, ChaosMonkeySafeLeaderWithPullReplicasTest, 
DistributedTermsComponentTest, TestDFISimilarityFactory, 
OverseerModifyCollectionTest, SimpleFacetsTest, HdfsBasicDistributedZk2Test, 
TestSolrCoreParser, DistributedSuggestComponentTest, SyncSliceTest, 
TriggerIntegrationTest]
   [junit4] Completed [74/776 (1!)] on J1 in 185.87s, 14 tests, 1 failure <<< 
FAILURES!

[...truncated 43511 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to