Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1352/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([CC844E90A403D1CD:C87AE7829EC95357]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTrigger(TriggerIntegrationTest.java:521)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12274 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/init-core-data-001
   [junit4]   2> 64102 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 64111 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 64113 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 64113 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001
   [junit4]   2> 64113 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 64118 INFO  (Thread-254) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 64118 INFO  (Thread-254) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 64162 ERROR (Thread-254) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 64218 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:37063
   [junit4]   2> 64261 INFO  (zkConnectionManagerCallback-111-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64268 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 64272 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 64326 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 64326 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 64326 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 64334 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@224d589e{/solr,null,AVAILABLE}
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@78ec7da0{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.e.j.s.Server Started @?????ms
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41765}
   [junit4]   2> 64337 ERROR (jetty-launcher-108-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 64337 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:54:36.093750Z
   [junit4]   2> 64390 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 64390 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 64390 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 64402 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3c6e9265{/solr,null,AVAILABLE}
   [junit4]   2> 64403 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@2d558783{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 64403 INFO  (jetty-launcher-108-thread-1) [    ] 
o.e.j.s.Server Started @?????ms
   [junit4]   2> 64403 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=42223}
   [junit4]   2> 64404 ERROR (jetty-launcher-108-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 64404 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 64404 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 64404 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 64404 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:54:36.160202Z
   [junit4]   2> 64423 INFO  (zkConnectionManagerCallback-113-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64440 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 64444 INFO  (zkConnectionManagerCallback-115-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64445 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 64467 INFO  (jetty-launcher-108-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 64503 INFO  (jetty-launcher-108-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 64530 INFO  (zkConnectionManagerCallback-119-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64545 INFO  (zkConnectionManagerCallback-123-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64578 INFO  
(zkConnectionManagerCallback-125-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64662 INFO  
(zkConnectionManagerCallback-127-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 64668 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 64668 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:41765_solr
   [junit4]   2> 64669 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.Overseer Overseer 
(id=72144942799978502-127.0.0.1:41765_solr-n_0000000000) starting
   [junit4]   2> 64727 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41765_solr
   [junit4]   2> 64751 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 64753 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 64757 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:42223_solr
   [junit4]   2> 64765 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 64767 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 1
   [junit4]   2> 64767 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
   [junit4]   2> 64767 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 64767 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 1
   [junit4]   2> 64774 INFO  
(zkCallback-126-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 64778 INFO  
(zkCallback-126-thread-3-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 64806 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 64817 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 64831 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 64831 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 2
   [junit4]   2> 64838 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41765.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 64865 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41765.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 64866 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41765.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 64888 INFO  (jetty-launcher-108-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node2/.
   [junit4]   2> 64941 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42223.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 64992 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42223.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 64993 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42223.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 64994 INFO  (jetty-launcher-108-thread-1) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node1/.
   [junit4]   2> 65094 INFO  (zkConnectionManagerCallback-133-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 65158 INFO  (zkConnectionManagerCallback-137-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 65171 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 65178 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37063/solr ready
   [junit4]   2> 65195 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testCooldown
   [junit4]   2> 65195 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 2
   [junit4]   2> 65196 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 2
   [junit4]   2> 65195 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 65207 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 65208 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 65209 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 65391 INFO  (qtp1626366069-696) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=15
   [junit4]   2> 65488 INFO  (qtp84072073-713) [n:127.0.0.1:42223_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 65489 DEBUG (qtp1626366069-700) [n:127.0.0.1:41765_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 65495 INFO  (qtp1626366069-700) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=227
   [junit4]   2> 65502 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 3
   [junit4]   2> 65504 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:42223_solr, 127.0.0.1:41765_solr]
   [junit4]   2> 65504 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, 
waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 65504 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 3
   [junit4]   2> 65515 INFO  
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 65525 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 65516 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 65529 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 65533 INFO  (qtp1626366069-701) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 65539 INFO  (qtp84072073-711) [n:127.0.0.1:42223_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 65540 DEBUG (qtp1626366069-702) [n:127.0.0.1:41765_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 65542 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 65543 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 4
   [junit4]   2> 65543 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:42223_solr, 127.0.0.1:41765_solr]
   [junit4]   2> 65543 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, 
waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 65543 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 4
   [junit4]   2> 65544 INFO  (qtp1626366069-702) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=44
   [junit4]   2> 65544 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 65544 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 65546 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 65610 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 65610 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 65610 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 65619 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@c59a717{/solr,null,AVAILABLE}
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@20d98d08{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server Started @?????ms
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45993}
   [junit4]   2> 65620 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 65620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:54:37.376720Z
   [junit4]   2> 65650 INFO  (zkConnectionManagerCallback-139-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 65654 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 65708 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 65716 INFO  (zkConnectionManagerCallback-143-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 65766 INFO  
(zkConnectionManagerCallback-145-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 65769 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 65770 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 65795 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45993_solr
   [junit4]   2> 65796 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 65796 INFO  
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 65820 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 65822 INFO  
(zkCallback-144-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 65892 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45993.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 65905 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45993.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 65905 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45993.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 65915 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node3/.
   [junit4]   2> 66546 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 66547 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 66547 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:45993_solr at time 1332838740652872
   [junit4]   2> 67558 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 67558 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 67559 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:45993_solr] added at times [1332838740652872], now=1332839752505099
   [junit4]   2> 67559 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"4bc35b3adf348Tazh3dk4vigh8p4w4fh14p8lg0",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332838740652872,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332838740652872],
   [junit4]   2>     "nodeNames":["127.0.0.1:45993_solr"]}}
   [junit4]   2> 67560 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 67561 INFO  (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 67562 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"4bc35b3adf348Tazh3dk4vigh8p4w4fh14p8lg0",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332838740652872,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332838740652872],
   [junit4]   2>     "_enqueue_time_":1332839753904885,
   [junit4]   2>     "nodeNames":["127.0.0.1:45993_solr"]}}
   [junit4]   2> 67565 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 5000ms
   [junit4]   2> 67565 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 3 
ms for event id=4bc35b3adf348Tazh3dk4vigh8p4w4fh14p8lg0
   [junit4]   2> 68565 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 68566 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 68567 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 68567 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 68567 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1e151467{/solr,null,AVAILABLE}
   [junit4]   2> 68568 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@25a2d54d{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 68568 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server Started @?????ms
   [junit4]   2> 68568 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39299}
   [junit4]   2> 68571 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 68571 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 68571 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 68571 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 68571 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:54:40.327335Z
   [junit4]   2> 68572 INFO  (zkConnectionManagerCallback-149-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 68573 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 68627 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 68650 INFO  (zkConnectionManagerCallback-153-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 68667 INFO  
(zkConnectionManagerCallback-155-thread-1-processing-n:127.0.0.1:39299_solr) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 68671 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 68672 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 68677 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39299_solr
   [junit4]   2> 68679 INFO  
(zkCallback-144-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 68679 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 68679 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 68679 INFO  
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 68706 INFO  
(zkCallback-154-thread-1-processing-n:127.0.0.1:39299_solr) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 68734 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39299.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 68743 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39299.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 68743 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39299.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 68745 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node4/.
   [junit4]   2> 72565 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 72565 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 72565 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:39299_solr at time 1332844759205007
   [junit4]   2> 73566 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 73566 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 73566 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:39299_solr] added at times [1332844759205007], now=1332845760063265
   [junit4]   2> 73566 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"4bc371a69c48fTazh3dk4vigh8p4w4fh14p8lg2",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332844759205007,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332844759205007],
   [junit4]   2>     "nodeNames":["127.0.0.1:39299_solr"]}}
   [junit4]   2> 73566 DEBUG (ScheduledTrigger-174-thread-1) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 73567 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"4bc371a69c48fTazh3dk4vigh8p4w4fh14p8lg2",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332844759205007,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332844759205007],
   [junit4]   2>     "_enqueue_time_":1332845760231562,
   [junit4]   2>     "nodeNames":["127.0.0.1:39299_solr"]}}
   [junit4]   2> 73567 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 5000ms
   [junit4]   2> 73567 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 
ms for event id=4bc371a69c48fTazh3dk4vigh8p4w4fh14p8lg2
   [junit4]   2> 75610 INFO  (qtp868262853-792) [n:127.0.0.1:39299_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=3
   [junit4]   2> 75618 INFO  (qtp1626366069-701) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 75626 INFO  (qtp84072073-712) [n:127.0.0.1:42223_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 75660 INFO  (qtp216365433-769) [n:127.0.0.1:45993_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 75662 DEBUG (qtp868262853-797) [n:127.0.0.1:39299_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 75663 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 5
   [junit4]   2> 75663 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:42223_solr, 127.0.0.1:45993_solr, 127.0.0.1:39299_solr, 
127.0.0.1:41765_solr]
   [junit4]   2> 75663 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, 
waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 75663 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 5
   [junit4]   2> 75663 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Changing value of 
autoscaling property: triggerCooldownPeriodSeconds from: 5 to: 7
   [junit4]   2> 75664 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 75664 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 75664 INFO  (qtp868262853-797) [n:127.0.0.1:39299_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=77
   [junit4]   2> 75667 INFO  (qtp868262853-797) [n:127.0.0.1:39299_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 75670 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 75686 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 75686 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 75686 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 75689 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@77deb29a{/solr,null,AVAILABLE}
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@16f383ba{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server Started @?????ms
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=33325}
   [junit4]   2> 75690 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 75690 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:54:47.446953Z
   [junit4]   2> 75695 INFO  (zkConnectionManagerCallback-159-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 75696 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 75712 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 75722 INFO  (zkConnectionManagerCallback-163-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 75726 INFO  
(zkConnectionManagerCallback-165-thread-1-processing-n:127.0.0.1:33325_solr) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 75730 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 75733 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 75735 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33325_solr
   [junit4]   2> 75736 INFO  
(zkCallback-144-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 75736 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 75736 INFO  
(zkCallback-154-thread-1-processing-n:127.0.0.1:39299_solr) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 75736 INFO  
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 75738 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 75746 INFO  
(zkCallback-164-thread-1-processing-n:127.0.0.1:33325_solr) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 75796 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33325.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 75802 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33325.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 75803 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33325.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 75804 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node5/.
   [junit4]   2> 78567 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 78568 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5
   [junit4]   2> 78568 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:33325_solr at time 1332850761520127
   [junit4]   2> 79570 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 79570 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5
   [junit4]   2> 79570 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:33325_solr] added at times [1332850761520127], now=1332851764193717
   [junit4]   2> 79570 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"4bc38802dd3ffTazh3dk4vigh8p4w4fh14p8lg3",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332850761520127,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332850761520127],
   [junit4]   2>     "nodeNames":["127.0.0.1:33325_solr"]}}
   [junit4]   2> 79570 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 79571 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"4bc38802dd3ffTazh3dk4vigh8p4w4fh14p8lg3",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332850761520127,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332850761520127],
   [junit4]   2>     "_enqueue_time_":1332851764395464,
   [junit4]   2>     "nodeNames":["127.0.0.1:33325_solr"]}}
   [junit4]   2> 79573 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 79585 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 7000ms
   [junit4]   2> 79585 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 13 
ms for event id=4bc38802dd3ffTazh3dk4vigh8p4w4fh14p8lg3
   [junit4]   2> 79614 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 79614 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 79615 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 79618 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6972ead{/solr,null,AVAILABLE}
   [junit4]   2> 79619 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@55e0366b{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 79619 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.e.j.s.Server Started @?????ms
   [junit4]   2> 79619 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45331}
   [junit4]   2> 79620 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 79620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 79620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 79620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 79620 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:54:51.376456Z
   [junit4]   2> 79630 INFO  (zkConnectionManagerCallback-169-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 79631 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 79651 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 79686 INFO  (zkConnectionManagerCallback-173-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 79698 INFO  
(zkConnectionManagerCallback-175-thread-1-processing-n:127.0.0.1:45331_solr) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 79701 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (5)
   [junit4]   2> 79703 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 79713 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45331_solr
   [junit4]   2> 79715 INFO  
(zkCallback-154-thread-1-processing-n:127.0.0.1:39299_solr) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 79715 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 79715 INFO  
(zkCallback-144-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 79715 INFO  
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 79715 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 79715 INFO  
(zkCallback-164-thread-1-processing-n:127.0.0.1:33325_solr) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 79745 INFO  
(zkCallback-174-thread-1-processing-n:127.0.0.1:45331_solr) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 79801 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45331.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 79817 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45331.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 79817 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45331.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 79825 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node6/.
   [junit4]   2> 86585 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 86585 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 6
   [junit4]   2> 86585 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:45331_solr at time 1332858778801604
   [junit4]   2> 87585 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 87586 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 6
   [junit4]   2> 87586 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:45331_solr] added at times [1332858778801604], now=1332859779536240
   [junit4]   2> 87586 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"4bc3a5e0bd5c4Tazh3dk4vigh8p4w4fh14p8lg4",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332858778801604,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332858778801604],
   [junit4]   2>     "nodeNames":["127.0.0.1:45331_solr"]}}
   [junit4]   2> 87586 DEBUG (ScheduledTrigger-174-thread-4) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 87586 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"4bc3a5e0bd5c4Tazh3dk4vigh8p4w4fh14p8lg4",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1332858778801604,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332858778801604],
   [junit4]   2>     "_enqueue_time_":1332859779742202,
   [junit4]   2>     "nodeNames":["127.0.0.1:45331_solr"]}}
   [junit4]   2> 87587 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 7000ms
   [junit4]   2> 87587 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 
ms for event id=4bc3a5e0bd5c4Tazh3dk4vigh8p4w4fh14p8lg4
   [junit4]   2> 89587 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[CC844E90A403D1CD]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testCooldown
   [junit4]   2> 89607 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTriggerRestoreState
   [junit4]   2> 89608 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode 
version 6
   [junit4]   2> 89608 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 6
   [junit4]   2> 89608 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 6
   [junit4]   2> 89609 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 89609 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 89609 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 89610 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T22:27:37+01:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 89610 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 89610 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 89610 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 89611 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@11ca2101{/solr,null,AVAILABLE}
   [junit4]   2> 89611 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.AbstractConnector Started ServerConnector@67881d9c{SSL,[ssl, 
http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 89612 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.Server Started @?????ms
   [junit4]   2> 89612 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45003}
   [junit4]   2> 89612 ERROR 
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 89612 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 7.3.0
   [junit4]   2> 89612 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 89612 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 89612 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-14T00:55:01.368684Z
   [junit4]   2> 89613 INFO  (zkConnectionManagerCallback-179-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 89614 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 89619 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37063/solr
   [junit4]   2> 89620 INFO  (zkConnectionManagerCallback-183-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 89622 INFO  
(zkConnectionManagerCallback-185-thread-1-processing-n:127.0.0.1:45003_solr) 
[n:127.0.0.1:45003_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 89624 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (6)
   [junit4]   2> 89624 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 89625 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45003_solr
   [junit4]   2> 89626 INFO  
(zkCallback-144-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89626 INFO  
(zkCallback-164-thread-1-processing-n:127.0.0.1:33325_solr) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89626 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89626 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 89626 INFO  
(zkCallback-174-thread-1-processing-n:127.0.0.1:45331_solr) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89626 INFO  
(zkCallback-154-thread-1-processing-n:127.0.0.1:39299_solr) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89626 INFO  
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89634 INFO  
(zkCallback-184-thread-1-processing-n:127.0.0.1:45003_solr) 
[n:127.0.0.1:45003_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (6) -> (7)
   [junit4]   2> 89671 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45003.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 89680 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45003.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 89680 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45003.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@47b270bb
   [junit4]   2> 89681 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [n:127.0.0.1:45003_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001/tempDir-001/node7/.
   [junit4]   2> 89765 INFO  (qtp1102660863-819) [n:127.0.0.1:33325_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89771 INFO  (qtp868262853-792) [n:127.0.0.1:39299_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89779 INFO  (qtp1626366069-758) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89784 INFO  (qtp84072073-712) [n:127.0.0.1:42223_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89799 INFO  (qtp1142939949-871) [n:127.0.0.1:45003_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89813 INFO  (qtp628086700-847) [n:127.0.0.1:45331_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89819 INFO  (qtp216365433-770) [n:127.0.0.1:45993_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 89820 DEBUG (qtp1102660863-823) [n:127.0.0.1:33325_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 89820 INFO  (qtp1102660863-823) [n:127.0.0.1:33325_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=61
   [junit4]   2> 89820 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 7
   [junit4]   2> 89821 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:42223_solr, 127.0.0.1:45003_solr, 127.0.0.1:45993_solr, 
127.0.0.1:33325_solr, 127.0.0.1:39299_solr, 127.0.0.1:41765_solr, 
127.0.0.1:45331_solr]
   [junit4]   2> 89821 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 7
   [junit4]   2> 89822 INFO  
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 89822 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 89822 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 89823 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_restore_trigger with currently live nodes: 7
   [junit4]   2> 89823 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@67881d9c{SSL,[ssl, 
http/1.1]}{127.0.0.1:?}
   [junit4]   2> 89823 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=424344626
   [junit4]   2> 89823 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node, tag=null
   [junit4]   2> 89823 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4c4ff87b: rootName = 
solr_45003, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@14403972
   [junit4]   2> 89827 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm, tag=null
   [junit4]   2> 89827 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4cc2d71c: rootName = 
solr_45003, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@19371801
   [junit4]   2> 89830 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 89830 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@23fdf374: rootName = 
solr_45003, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@78b4fd41
   [junit4]   2> 89831 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45003_solr
   [junit4]   2> 89832 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 89832 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:42223_solr) 
[n:127.0.0.1:42223_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(zkCallback-154-thread-1-processing-n:127.0.0.1:39299_solr) 
[n:127.0.0.1:39299_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(zkCallback-144-thread-1-processing-n:127.0.0.1:45993_solr) 
[n:127.0.0.1:45993_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(zkCallback-164-thread-1-processing-n:127.0.0.1:33325_solr) 
[n:127.0.0.1:33325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 89832 INFO  
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(zkCallback-184-thread-1-processing-n:127.0.0.1:45003_solr) 
[n:127.0.0.1:45003_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89832 INFO  
(zkCallback-174-thread-1-processing-n:127.0.0.1:45331_solr) 
[n:127.0.0.1:45331_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (7) -> (6)
   [junit4]   2> 89838 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@11ca2101{/solr,null,UNAVAILABLE}
   [junit4]   2> 89838 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 90823 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_restore_trigger with currently live nodes: 6
   [junit4]   2> 90823 DEBUG (ScheduledTrigger-174-thread-3) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 
127.0.0.1:45003_solr
   [junit4]   2> 91345 INFO  (qtp1102660863-819) [n:127.0.0.1:33325_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91355 INFO  (qtp868262853-792) [n:127.0.0.1:39299_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91358 INFO  (qtp1626366069-696) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91361 INFO  (qtp84072073-713) [n:127.0.0.1:42223_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91366 INFO  (qtp628086700-848) [n:127.0.0.1:45331_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91373 INFO  (qtp216365433-765) [n:127.0.0.1:45993_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91374 DEBUG (qtp1626366069-700) [n:127.0.0.1:41765_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 91374 INFO  (qtp1626366069-700) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=33
   [junit4]   2> 91375 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 8
   [junit4]   2> 91375 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:42223_solr, 127.0.0.1:45993_solr, 127.0.0.1:33325_solr, 
127.0.0.1:39299_solr, 127.0.0.1:41765_solr, 127.0.0.1:45331_solr]
   [junit4]   2> 91375 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 8
   [junit4]   2> 91376 INFO  
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 91376 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Adding lost node from 
marker path: 127.0.0.1:45003_solr
   [junit4]   2> 91376 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 91376 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_restore_trigger with currently live nodes: 6
   [junit4]   2> 91376 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing 
registered processor for lost nodes: [127.0.0.1:45003_solr]
   [junit4]   2> 91376 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"4bc3b7b9b1a7dTazh3dk4vigh8p4w4fh14p8lg5",
   [junit4]   2>   "source":"node_lost_restore_trigger",
   [junit4]   2>   "eventTime":1332863569697405,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332863569697405],
   [junit4]   2>     "nodeNames":["127.0.0.1:45003_solr"]}}
   [junit4]   2> 91376 DEBUG (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_lost_restore_trigger]
   [junit4]   2> 91377 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 91377 INFO  (ScheduledTrigger-174-thread-2) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 91377 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"4bc3b7b9b1a7dTazh3dk4vigh8p4w4fh14p8lg5",
   [junit4]   2>   "source":"node_lost_restore_trigger",
   [junit4]   2>   "eventTime":1332863569697405,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1332863569697405],
   [junit4]   2>     "_enqueue_time_":1332863570398606,
   [junit4]   2>     "nodeNames":["127.0.0.1:45003_solr"]}}
   [junit4]   2> 91377 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[CC844E90A403D1CD])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTriggerRestoreState
   [junit4]   2> 91378 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_lost_restore_trigger after 7000ms
   [junit4]   2> 91378 DEBUG 
(AutoscalingActionExecutor-175-thread-1-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 
ms for event id=4bc3b7b9b1a7dTazh3dk4vigh8p4w4fh14p8lg5
   [junit4]   2> 91396 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[CC844E90A403D1CD]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
   [junit4]   2> 91397 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[CC844E90A403D1CD]) [   
 ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 9
   [junit4]   2> 91397 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 9
   [junit4]   2> 91397 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 9
   [junit4]   2> 91398 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 91398 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 91398 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 9, lastZnodeVersion 9
   [junit4]   2> 91402 INFO  (qtp1102660863-824) [n:127.0.0.1:33325_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91404 INFO  (qtp868262853-797) [n:127.0.0.1:39299_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91406 INFO  (qtp1626366069-701) [n:127.0.0.1:41765_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91408 INFO  (qtp84072073-707) [n:127.0.0.1:42223_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91410 INFO  (qtp628086700-849) [n:127.0.0.1:45331_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91414 INFO  (qtp216365433-769) [n:127.0.0.1:45993_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 91415 DEBUG (qtp1102660863-825) [n:127.0.0.1:33325_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 91415 INFO  (qtp1102660863-825) [n:127.0.0.1:33325_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=16
   [junit4]   2> 91416 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 10
   [junit4]   2> 91416 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:42223_solr, 127.0.0.1:45993_solr, 127.0.0.1:33325_solr, 
127.0.0.1:39299_solr, 127.0.0.1:41765_solr, 127.0.0.1:45331_solr]
   [junit4]   2> 91416 DEBUG 
(zkCallback-126-thread-2-processing-n:127.0.0.1:41765_solr) 
[n:127.0.0.1:41765_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, 
actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
 enabled=true}
   [junit4]   2> 91416 DEBUG 
(OverseerAutoScalingTriggerThread-72144942799978502-127.0.0.1:41765_solr-n_0000000000)
 [n:127.0.0.1:41765_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
upd

[...truncated too long message...]

e.j.s.ServletContextHandler@15845839{/solr,null,UNAVAILABLE}
   [junit4]   2> 284836 INFO  (jetty-closer-109-thread-2) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284838 INFO  (coreCloseExecutor-403-thread-1) 
[n:127.0.0.1:46149_solr c:collection1 s:shard1 r:core_node4 
x:collection1_shard1_replica_n3] o.a.s.c.SolrCore 
[collection1_shard1_replica_n3]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@68f7997b
   [junit4]   2> 284839 INFO  (jetty-closer-109-thread-11) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284839 INFO  (coreCloseExecutor-403-thread-1) 
[n:127.0.0.1:46149_solr c:collection1 s:shard1 r:core_node4 
x:collection1_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.core.collection1.shard1.replica_n3, tag=1761057147
   [junit4]   2> 284839 INFO  (coreCloseExecutor-403-thread-1) 
[n:127.0.0.1:46149_solr c:collection1 s:shard1 r:core_node4 
x:collection1_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@30cac631: rootName = 
solr_46149, domain = solr.core.collection1.shard1.replica_n3, service url = 
null, agent id = null] for registry solr.core.collection1.shard1.replica_n3 / 
com.codahale.metrics.MetricRegistry@306440d8
   [junit4]   2> 284841 INFO  (jetty-closer-109-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6972ead{/solr,null,UNAVAILABLE}
   [junit4]   2> 284841 INFO  (jetty-closer-109-thread-1) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284841 INFO  
(zkCallback-218-thread-2-processing-n:127.0.0.1:43991_solr) 
[n:127.0.0.1:43991_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:43991_solr
   [junit4]   2> 284842 INFO  (coreCloseExecutor-396-thread-1) 
[n:127.0.0.1:43991_solr c:collection1 s:shard1 r:core_node6 
x:collection1_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1043878719
   [junit4]   2> 284847 INFO  (jetty-closer-109-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7e879e73{/solr,null,UNAVAILABLE}
   [junit4]   2> 284847 INFO  (jetty-closer-109-thread-3) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284847 INFO  
(zkCallback-238-thread-1-processing-n:127.0.0.1:46149_solr) 
[n:127.0.0.1:46149_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:46149_solr
   [junit4]   2> 284857 INFO  (coreCloseExecutor-398-thread-1) 
[n:127.0.0.1:39595_solr c:collection1 s:shard1 r:core_node16 
x:collection1_shard1_replica_n15] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1779839377
   [junit4]   2> 284857 INFO  (coreCloseExecutor-397-thread-1) 
[n:127.0.0.1:42793_solr c:collection1 s:shard1 r:core_node10 
x:collection1_shard1_replica_n9] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1109993673
   [junit4]   2> 284863 INFO  (jetty-closer-109-thread-9) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@53d07cf4{/solr,null,UNAVAILABLE}
   [junit4]   2> 284863 INFO  (jetty-closer-109-thread-9) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284865 INFO  (jetty-closer-109-thread-6) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1ac68a08{/solr,null,UNAVAILABLE}
   [junit4]   2> 284866 INFO  (jetty-closer-109-thread-6) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284866 INFO  (coreCloseExecutor-402-thread-1) 
[n:127.0.0.1:36793_solr c:collection1 s:shard1 r:core_node2 
x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1629250472
   [junit4]   2> 284868 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1004f7177ef003f, likely client has closed socket
   [junit4]   2> 284868 INFO  (jetty-closer-109-thread-13) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@44f6c72e{/solr,null,UNAVAILABLE}
   [junit4]   2> 284868 INFO  (jetty-closer-109-thread-13) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284869 INFO  (coreCloseExecutor-399-thread-2) 
[n:127.0.0.1:38327_solr c:collection1 s:shard1 r:core_node14 
x:collection1_shard1_replica_n13] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=2041742420
   [junit4]   2> 284869 INFO  (coreCloseExecutor-399-thread-1) 
[n:127.0.0.1:38327_solr c:collection1 s:shard1 r:core_node12 
x:collection1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1417976666
   [junit4]   2> 284870 INFO  (coreCloseExecutor-403-thread-1) 
[n:127.0.0.1:46149_solr c:collection1 s:shard1 r:core_node4 
x:collection1_shard1_replica_n3] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1761057147
   [junit4]   2> 284873 INFO  
(zkCallback-288-thread-2-processing-n:127.0.0.1:38327_solr) 
[n:127.0.0.1:38327_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:38327_solr
   [junit4]   2> 284873 INFO  (jetty-closer-109-thread-5) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2f24759a{/solr,null,UNAVAILABLE}
   [junit4]   2> 284873 INFO  (jetty-closer-109-thread-5) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 284875 INFO  (jetty-closer-109-thread-10) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@fe728d3{/solr,null,UNAVAILABLE}
   [junit4]   2> 284875 INFO  (jetty-closer-109-thread-10) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 286294 WARN  
(zkCallback-268-thread-2-processing-n:127.0.0.1:42265_solr) 
[n:127.0.0.1:42265_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 286303 INFO  (jetty-closer-109-thread-8) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6d9b1018{/solr,null,UNAVAILABLE}
   [junit4]   2> 286303 INFO  (jetty-closer-109-thread-8) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 286304 ERROR 
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 286304 INFO  
(SUITE-TriggerIntegrationTest-seed#[CC844E90A403D1CD]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:37063 37063
   [junit4]   2> 292376 INFO  (Thread-254) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:37063 37063
   [junit4]   2> 292376 WARN  (Thread-254) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        38      /solr/collections/collection1/terms/shard1
   [junit4]   2>        22      /solr/aliases.json
   [junit4]   2>        21      /solr/security.json
   [junit4]   2>        11      /solr/configs/conf
   [junit4]   2>        10      /solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2>        2       /solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        108     /solr/collections/collection1/state.json
   [junit4]   2>        49      /solr/collections/testMetricTrigger/state.json
   [junit4]   2>        22      /solr/clusterprops.json
   [junit4]   2>        22      /solr/clusterstate.json
   [junit4]   2>        6       /solr/autoscaling.json
   [junit4]   2>        4       
/solr/overseer_elect/election/72144942799978516-127.0.0.1:45331_solr-n_0000000005
   [junit4]   2>        3       
/solr/overseer_elect/election/72144942799978550-127.0.0.1:38327_solr-n_0000000016
   [junit4]   2>        3       
/solr/overseer_elect/election/72144942799978538-127.0.0.1:39595_solr-n_0000000012
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard1/election/72144942799978559-core_node2-n_0000000001
   [junit4]   2>        2       
/solr/overseer_elect/election/72144942799978535-127.0.0.1:46149_solr-n_0000000011
   [junit4]   2>        2       
/solr/overseer_elect/election/72144942799978529-127.0.0.1:43991_solr-n_0000000009
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72144942799978529-core_node6-n_0000000002
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72144942799978535-core_node4-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        22      /solr/live_nodes
   [junit4]   2>        22      /solr/collections
   [junit4]   2>        6       /solr/overseer/queue-work
   [junit4]   2>        6       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        6       /solr/overseer/queue
   [junit4]   2>        6       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2>        2       /solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_CC844E90A403D1CD-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, 
sim=RandomSimilarity(queryNorm=false): {}, locale=ar-ER, 
timezone=America/Kentucky/Monticello
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 9.0.4 
(64-bit)/cpus=8,threads=1,free=308686904,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [RequiredFieldsTest, 
HdfsNNFailoverTest, BaseCdcrDistributedZkTest, DistribJoinFromCollectionTest, 
TestCursorMarkWithoutUniqueKey, TestPKIAuthenticationPlugin, 
TriggerIntegrationTest]
   [junit4] Completed [55/775 (1!)] on J1 in 228.34s, 14 tests, 1 failure <<< 
FAILURES!

[...truncated 43703 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to