Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6148/
Java: 64bit/jdk-12.0.2 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.autoscaling.NodeLostTriggerIntegrationTest.testNodeLostTrigger

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
        at 
__randomizedtesting.SeedInfo.seed([51E268A6EE1EA94C:551CC1B4D4D42BD6]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.autoscaling.NodeLostTriggerIntegrationTest.testNodeLostTrigger(NodeLostTriggerIntegrationTest.java:275)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)




Build Log:
[...truncated 13953 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.NodeLostTriggerIntegrationTest
   [junit4]   2> 898032 INFO  
(SUITE-NodeLostTriggerIntegrationTest-seed#[51E268A6EE1EA94C]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 898033 INFO  
(SUITE-NodeLostTriggerIntegrationTest-seed#[51E268A6EE1EA94C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/data-dir-100-001
   [junit4]   2> 898034 WARN  
(SUITE-NodeLostTriggerIntegrationTest-seed#[51E268A6EE1EA94C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
   [junit4]   2> 898034 INFO  
(SUITE-NodeLostTriggerIntegrationTest-seed#[51E268A6EE1EA94C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 898034 INFO  
(SUITE-NodeLostTriggerIntegrationTest-seed#[51E268A6EE1EA94C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 898034 INFO  
(SUITE-NodeLostTriggerIntegrationTest-seed#[51E268A6EE1EA94C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 898037 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
   [junit4]   2> 898038 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/tempDir-001
   [junit4]   2> 898038 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 898039 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 898039 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 898140 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer start zk server on port: 63092
   [junit4]   2> 898140 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:63092
   [junit4]   2> 898140 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63092
   [junit4]   2> 898140 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63092
   [junit4]   2> 898154 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898173 INFO  (zkConnectionManagerCallback-6278-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898173 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898186 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898192 INFO  (zkConnectionManagerCallback-6280-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898192 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898193 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898199 INFO  (zkConnectionManagerCallback-6282-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898200 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 898318 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 898319 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 898319 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 898319 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 898329 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 898329 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 898329 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 898334 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7e9f3388{/solr,null,AVAILABLE}
   [junit4]   2> 898336 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@5b74ad1d{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63097}
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.s.Server Started @898385ms
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63097}
   [junit4]   2> 898337 ERROR (jetty-launcher-6283-thread-4) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 898337 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 898338 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 898338 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 898338 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:50:38.904253Z
   [junit4]   2> 898339 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@f807520{/solr,null,AVAILABLE}
   [junit4]   2> 898340 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@33837f1e{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63098}
   [junit4]   2> 898340 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898340 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.s.Server Started @898389ms
   [junit4]   2> 898341 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63098}
   [junit4]   2> 898341 ERROR (jetty-launcher-6283-thread-1) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 898341 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 898341 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 898341 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 898341 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 898341 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:50:38.907440Z
   [junit4]   2> 898342 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898344 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 898344 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 898344 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 898347 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 898347 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 898347 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 898348 INFO  (zkConnectionManagerCallback-6285-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898348 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898349 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@39e187fe{/solr,null,AVAILABLE}
   [junit4]   2> 898350 INFO  (zkConnectionManagerCallback-6287-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898350 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898350 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3f33325d{/solr,null,AVAILABLE}
   [junit4]   2> 898351 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 898352 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@728ebfc5{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63101}
   [junit4]   2> 898352 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.s.Server Started @898400ms
   [junit4]   2> 898352 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63101}
   [junit4]   2> 898352 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 898352 ERROR (jetty-launcher-6283-thread-3) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 898353 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 898353 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 898353 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 898353 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 898353 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:50:38.919411Z
   [junit4]   2> 898355 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898358 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@329c614{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63102}
   [junit4]   2> 898358 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.s.Server Started @898406ms
   [junit4]   2> 898358 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63102}
   [junit4]   2> 898358 ERROR (jetty-launcher-6283-thread-2) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 898358 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 898359 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 898359 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 898359 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 898359 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:50:38.925050Z
   [junit4]   2> 898361 INFO  (zkConnectionManagerCallback-6289-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898361 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898363 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 898368 INFO  (zkConnectionManagerCallback-6291-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898369 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 898467 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 898469 WARN  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@62634e32[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898469 WARN  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@62634e32[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898471 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 898484 WARN  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@67ce1682[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898484 WARN  (jetty-launcher-6283-thread-4) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@67ce1682[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898485 INFO  (jetty-launcher-6283-thread-4) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63092/solr
   [junit4]   2> 898487 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 898495 INFO  (zkConnectionManagerCallback-6302-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898495 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 898566 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 898579 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 898582 WARN  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@71279fac[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898582 WARN  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@71279fac[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898598 WARN  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@1d3b81b8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898598 WARN  (jetty-launcher-6283-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@1d3b81b8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898599 INFO  (jetty-launcher-6283-thread-1) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63092/solr
   [junit4]   2> 898606 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 898608 INFO  (zkConnectionManagerCallback-6313-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898618 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 898683 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 898684 WARN  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@6f6056df[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898684 WARN  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@6f6056df[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898693 WARN  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@553a7961[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898693 WARN  (jetty-launcher-6283-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@553a7961[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898694 INFO  (jetty-launcher-6283-thread-2) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63092/solr
   [junit4]   2> 898696 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 898701 INFO  (zkConnectionManagerCallback-6324-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898701 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 898785 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 898789 WARN  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@1db5fd7b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898789 WARN  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@1db5fd7b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898808 WARN  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@20164f4a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898808 WARN  (jetty-launcher-6283-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@20164f4a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 898813 INFO  (jetty-launcher-6283-thread-3) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63092/solr
   [junit4]   2> 898817 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 898823 INFO  (zkConnectionManagerCallback-6339-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 898823 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 902111 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:63098_solr
   [junit4]   2> 902113 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.Overseer Overseer 
(id=72086534028460040-127.0.0.1:63098_solr-n_0000000000) starting
   [junit4]   2> 902128 INFO  
(OverseerStateUpdate-72086534028460040-127.0.0.1:63098_solr-n_0000000000) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:63098_solr
   [junit4]   2> 902128 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63098_solr
   [junit4]   2> 902128 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 902131 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with 
znode version 1
   [junit4]   2> 902131 INFO  
(OverseerStateUpdate-72086534028460040-127.0.0.1:63098_solr-n_0000000000) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 902131 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion 0
   [junit4]   2> 902131 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 1
   [junit4]   2> 902136 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 902136 WARN  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 902144 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:63098_solr]
   [junit4]   2> 902145 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / 
nodeAdded markers
   [junit4]   2> 902147 DEBUG (ScheduledTrigger-6346-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 902147 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion 1
   [junit4]   2> 902156 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 902208 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63098.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 902217 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63098.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 902217 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63098.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 902217 INFO  (jetty-launcher-6283-thread-1) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/tempDir-001/node1
   [junit4]   2> 903154 DEBUG (ScheduledTrigger-6346-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 904159 DEBUG (ScheduledTrigger-6346-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 905160 DEBUG (ScheduledTrigger-6346-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 906162 DEBUG (ScheduledTrigger-6346-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 907167 DEBUG (ScheduledTrigger-6346-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 907393 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 907409 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:63097_solr as DOWN
   [junit4]   2> 907410 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 1000 transient cores
   [junit4]   2> 907411 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63097_solr
   [junit4]   2> 907414 INFO  (zkCallback-6312-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 907414 INFO  (zkCallback-6301-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 907417 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 907417 WARN  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 907437 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 907463 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63097.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 907476 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63097.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 907476 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63097.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 907478 INFO  (jetty-launcher-6283-thread-4) 
[n:127.0.0.1:63097_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/tempDir-001/node4
   [junit4]   2> 908168 DEBUG (ScheduledTrigger-6346-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 1
   [junit4]   2> 909173 DEBUG (ScheduledTrigger-6346-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 910174 DEBUG (ScheduledTrigger-6346-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 911175 DEBUG (ScheduledTrigger-6346-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 912175 DEBUG (ScheduledTrigger-6346-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 912973 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 913000 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 913007 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:63101_solr as DOWN
   [junit4]   2> 913012 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 1000 transient cores
   [junit4]   2> 913012 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63101_solr
   [junit4]   2> 913019 INFO  (zkCallback-6301-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 913019 INFO  (zkCallback-6323-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 913019 INFO  (zkCallback-6312-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 913021 INFO  (zkCallback-6338-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 913035 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 913036 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:63102_solr as DOWN
   [junit4]   2> 913036 WARN  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 913045 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 1000 transient cores
   [junit4]   2> 913045 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63102_solr
   [junit4]   2> 913066 INFO  (zkCallback-6312-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 913066 INFO  (zkCallback-6301-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 913066 INFO  (zkCallback-6323-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 913067 INFO  (zkCallback-6338-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 913076 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 913077 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 913078 WARN  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 913112 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 913147 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63102.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 913172 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63101.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 913179 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63102.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 913179 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63102.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 913181 INFO  (jetty-launcher-6283-thread-2) 
[n:127.0.0.1:63102_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/tempDir-001/node2
   [junit4]   2> 913185 DEBUG (ScheduledTrigger-6346-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 2
   [junit4]   2> 913195 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63101.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 913196 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_63101.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1863d2fe
   [junit4]   2> 913199 INFO  (jetty-launcher-6283-thread-3) 
[n:127.0.0.1:63101_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/tempDir-001/node3
   [junit4]   2> 913217 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=4
   [junit4]   2> 913219 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 913222 INFO  (zkConnectionManagerCallback-6376-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 913222 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 913226 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 913229 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:63092/solr ready
   [junit4]   2> 913247 INFO  (qtp1437817307-9926) [n:127.0.0.1:63097_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 913254 INFO  (qtp1437817307-9925) [n:127.0.0.1:63097_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913257 INFO  (qtp1027905222-9924) [n:127.0.0.1:63098_solr     
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 
transient cores
   [junit4]   2> 913257 INFO  (qtp1027905222-9924) [n:127.0.0.1:63098_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913260 INFO  (qtp2085183036-9937) [n:127.0.0.1:63101_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913263 INFO  (qtp233716185-9946) [n:127.0.0.1:63102_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913263 DEBUG (qtp1437817307-9927) [n:127.0.0.1:63097_solr     
] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 913265 INFO  (qtp1437817307-9927) [n:127.0.0.1:63097_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=15
   [junit4]   2> 913267 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .scheduled_maintenance
   [junit4]   2> 913267 DEBUG (zkCallback-6312-thread-1) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 913269 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 2
   [junit4]   2> 913274 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 913283 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.a.NodeLostTriggerIntegrationTest /autoscaling.json reset, new 
znode version 3
   [junit4]   2> 913284 DEBUG (zkCallback-6312-thread-1) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 913291 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:63097_solr, 127.0.0.1:63101_solr, 127.0.0.1:63102_solr, 
127.0.0.1:63098_solr]
   [junit4]   2> 913293 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / 
nodeAdded markers
   [junit4]   2> 913295 INFO  (qtp1437817307-9928) [n:127.0.0.1:63097_solr     
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 913296 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, 
lastZnodeVersion 2
   [junit4]   2> 913296 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 3
   [junit4]   2> 913297 WARN  (ScheduledTrigger-6346-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger ran but was already closed
   [junit4]   2> 913309 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / 
nodeAdded markers
   [junit4]   2> 913312 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, 
lastZnodeVersion 3
   [junit4]   2> 913332 INFO  (qtp1437817307-9928) [n:127.0.0.1:63097_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=36
   [junit4]   2> 913339 INFO  (qtp1437817307-9927) [n:127.0.0.1:63097_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913341 INFO  (qtp1027905222-9934) [n:127.0.0.1:63098_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913343 INFO  (qtp2085183036-9939) [n:127.0.0.1:63101_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913345 INFO  (qtp233716185-9946) [n:127.0.0.1:63102_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=0
   [junit4]   2> 913346 DEBUG (qtp233716185-9948) [n:127.0.0.1:63102_solr     ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 913353 INFO  (qtp233716185-9948) [n:127.0.0.1:63102_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=18
   [junit4]   2> 913356 DEBUG (zkCallback-6312-thread-2) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 913356 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 4
   [junit4]   2> 913367 INFO  
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.NodeLostTriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 913368 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger - Initial 
livenodes: [127.0.0.1:63097_solr, 127.0.0.1:63101_solr, 127.0.0.1:63102_solr, 
127.0.0.1:63098_solr]
   [junit4]   2> 913370 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=949699892
   [junit4]   2> 913370 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63101_solr
   [junit4]   2> 913370 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / 
nodeAdded markers
   [junit4]   2> 913377 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 913377 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkController Publish node=127.0.0.1:63101_solr as DOWN
   [junit4]   2> 913379 DEBUG 
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, 
lastZnodeVersion 4
   [junit4]   2> 913382 DEBUG (ScheduledTrigger-6346-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 913391 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node tag=null
   [junit4]   2> 913391 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1eac0198: rootName = 
solr_63101, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@4d918f25
   [junit4]   2> 913405 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm tag=null
   [junit4]   2> 913405 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@156526d: rootName = 
solr_63101, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@5b3a69e0
   [junit4]   2> 913413 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty tag=null
   [junit4]   2> 913414 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1d9da2a: rootName = 
solr_63101, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@4efd0d24
   [junit4]   2> 913415 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster tag=null
   [junit4]   2> 913525 INFO  (zkCallback-6323-thread-2) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 913525 INFO  (zkCallback-6375-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 913526 INFO  (zkCallback-6301-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 913526 INFO  (zkCallback-6312-thread-2) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 913530 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@728ebfc5{HTTP/1.1, 
(http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 913549 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@39e187fe{/solr,null,UNAVAILABLE}
   [junit4]   2> 913549 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 913551 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 63101
   [junit4]   2> 918098 INFO  
(OverseerCollectionConfigSetProcessor-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [n:127.0.0.1:63098_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 926725 DEBUG (ScheduledTrigger-6346-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 3 and last live nodes: 4
   [junit4]   2> 926725 DEBUG (ScheduledTrigger-6346-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:63101_solr
   [junit4]   2> 933680 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=829953829
   [junit4]   2> 933680 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63097_solr
   [junit4]   2> 933680 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1488930477
   [junit4]   2> 933680 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63102_solr
   [junit4]   2> 933680 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1605845589
   [junit4]   2> 933681 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:63098_solr
   [junit4]   2> 933681 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 933681 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 933681 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.c.ZkController Publish node=127.0.0.1:63102_solr as DOWN
   [junit4]   2> 933681 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.c.ZkController Publish node=127.0.0.1:63097_solr as DOWN
   [junit4]   2> 933682 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 933682 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.c.ZkController Publish node=127.0.0.1:63098_solr as DOWN
   [junit4]   2> 933689 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 933689 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@5d49b46d: rootName = 
solr_63097, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@7b6eb5a9
   [junit4]   2> 933690 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 933690 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2c0bd456: rootName = 
solr_63098, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@4d726fdc
   [junit4]   2> 933690 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 933690 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2001dace: rootName = 
solr_63102, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@3cc43506
   [junit4]   2> 933798 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 933798 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@10cc08a0: rootName = 
solr_63097, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@5b3a69e0
   [junit4]   2> 933803 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 933803 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2e7e986a: rootName = 
solr_63098, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@5b3a69e0
   [junit4]   2> 933813 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 933813 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@73aea23b: rootName = 
solr_63102, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@5b3a69e0
   [junit4]   2> 933879 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 933879 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@26a18cf9: rootName = 
solr_63097, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@4efd0d24
   [junit4]   2> 933879 INFO  (jetty-closer-6382-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 933880 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 933880 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1f4995f4: rootName = 
solr_63098, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@4efd0d24
   [junit4]   2> 933880 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 933880 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 933880 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@93e1bca: rootName = 
solr_63102, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@4efd0d24
   [junit4]   2> 933881 INFO  (jetty-closer-6382-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 933890 INFO  (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.Overseer Overseer 
(id=72086534028460040-127.0.0.1:63098_solr-n_0000000000) closing
   [junit4]   2> 933890 INFO  
(OverseerStateUpdate-72086534028460040-127.0.0.1:63098_solr-n_0000000000) 
[n:127.0.0.1:63098_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:63098_solr
   [junit4]   2> 933891 INFO  
(OverseerAutoScalingTriggerThread-72086534028460040-127.0.0.1:63098_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 933891 INFO  (zkCallback-6323-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 933891 INFO  (zkCallback-6312-thread-2) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 933894 DEBUG (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 933894 DEBUG (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 933895 DEBUG (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 933895 DEBUG (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 933896 DEBUG (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 933896 DEBUG (closeThreadPool-6396-thread-2) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 933897 INFO  (closeThreadPool-6396-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72086534028460040-127.0.0.1:63098_solr-n_0000000000) closing
   [junit4]   2> 934003 INFO  (jetty-closer-6382-thread-2) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@5b74ad1d{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 934004 INFO  (jetty-closer-6382-thread-2) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7e9f3388{/solr,null,UNAVAILABLE}
   [junit4]   2> 934004 INFO  (jetty-closer-6382-thread-2) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 934103 INFO  (jetty-closer-6382-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72086534028460040-127.0.0.1:63098_solr-n_0000000000) closing
   [junit4]   2> 934106 INFO  (jetty-closer-6382-thread-1) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@33837f1e{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 934106 INFO  (jetty-closer-6382-thread-1) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@f807520{/solr,null,UNAVAILABLE}
   [junit4]   2> 934107 INFO  (jetty-closer-6382-thread-1) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 934217 INFO  (jetty-closer-6382-thread-3) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@329c614{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 934217 INFO  (jetty-closer-6382-thread-3) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3f33325d{/solr,null,UNAVAILABLE}
   [junit4]   2> 934217 INFO  (jetty-closer-6382-thread-3) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 934222 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 934435 WARN  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/aliases.json
   [junit4]   2>        5       /solr/clusterprops.json
   [junit4]   2>        4       /solr/packages.json
   [junit4]   2>        4       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/autoscaling.json
   [junit4]   2>        2       
/solr/overseer_elect/election/72086534028460039-127.0.0.1:63097_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        22      /solr/live_nodes
   [junit4]   2>        11      /solr/overseer/queue
   [junit4]   2>        5       /solr/collections
   [junit4]   2>        4       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 
   [junit4]   2> 934443 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:63092
   [junit4]   2> 934443 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63092
   [junit4]   2> 934444 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63092
   [junit4]   2> 934444 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTrigger-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=NodeLostTriggerIntegrationTest -Dtests.method=testNodeLostTrigger 
-Dtests.seed=51E268A6EE1EA94C -Dtests.slow=true -Dtests.locale=to 
-Dtests.timezone=Asia/Taipei -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 36.4s J3 | 
NodeLostTriggerIntegrationTest.testNodeLostTrigger <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: The trigger did not 
fire at all
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([51E268A6EE1EA94C:551CC1B4D4D42BD6]:0)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.NodeLostTriggerIntegrationTest.testNodeLostTrigger(NodeLostTriggerIntegrationTest.java:275)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    >        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    >        at 
java.base/java.lang.reflect.Method.invoke(Method.java:567)
   [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:835)
   [junit4]   2> 934451 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTriggerRestoreState
   [junit4]   2> 934452 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001/tempDir-002
   [junit4]   2> 934452 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 934453 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 934453 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 934553 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer start zk server on port: 63325
   [junit4]   2> 934553 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:63325
   [junit4]   2> 934553 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63325
   [junit4]   2> 934553 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63325
   [junit4]   2> 934556 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934563 INFO  (zkConnectionManagerCallback-6399-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934563 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934569 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934575 INFO  (zkConnectionManagerCallback-6401-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934575 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934576 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934581 INFO  (zkConnectionManagerCallback-6403-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934581 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934692 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 934692 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 934692 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 934693 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 934693 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 934694 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
   [junit4]   2> 934697 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 934697 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 934697 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 934698 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@64441894{/solr,null,AVAILABLE}
   [junit4]   2> 934699 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@3a16a144{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63332}
   [junit4]   2> 934699 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.s.Server Started @934747ms
   [junit4]   2> 934699 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63332}
   [junit4]   2> 934700 ERROR (jetty-launcher-6404-thread-2) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 934700 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 934700 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 934700 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 934700 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 934700 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:51:15.266592Z
   [junit4]   2> 934702 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 934702 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 934703 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 934703 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934704 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 934704 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 934704 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 934707 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2dc0a68d{/solr,null,AVAILABLE}
   [junit4]   2> 934708 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@47fe5509{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63335}
   [junit4]   2> 934708 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.s.Server Started @934756ms
   [junit4]   2> 934708 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@a1313dc{/solr,null,AVAILABLE}
   [junit4]   2> 934708 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63335}
   [junit4]   2> 934708 ERROR (jetty-launcher-6404-thread-4) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 934708 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 934709 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 934709 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 934709 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 934709 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:51:15.275076Z
   [junit4]   2> 934709 INFO  (zkConnectionManagerCallback-6406-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@54a39354{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63336}
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.s.Server Started @934758ms
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63336}
   [junit4]   2> 934710 ERROR (jetty-launcher-6404-thread-1) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 934710 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:51:15.276894Z
   [junit4]   2> 934712 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 934716 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934716 INFO  (zkConnectionManagerCallback-6408-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934716 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934718 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 934718 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 934718 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 934719 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934719 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 934720 INFO  (zkConnectionManagerCallback-6410-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934720 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934721 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 934724 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1fc37d04{/solr,null,AVAILABLE}
   [junit4]   2> 934726 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@67fbd55e{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:63339}
   [junit4]   2> 934726 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.s.Server Started @934774ms
   [junit4]   2> 934726 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=63339}
   [junit4]   2> 934727 ERROR (jetty-launcher-6404-thread-3) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 934727 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 934727 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 934727 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 934727 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 934728 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-11T13:51:15.294005Z
   [junit4]   2> 934729 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 934737 INFO  (zkConnectionManagerCallback-6412-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934737 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 934824 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 934826 WARN  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@692a15cb[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934826 WARN  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@692a15cb[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934830 WARN  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@610995af[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934830 WARN  (jetty-launcher-6404-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@610995af[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934830 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 934831 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 934831 INFO  (jetty-launcher-6404-thread-2) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63325/solr
   [junit4]   2> 934834 INFO  (jetty-launcher-6404-thread-2) 
[n:127.0.0.1:63332_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 934835 WARN  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@7c747d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934835 WARN  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@7c747d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934839 WARN  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@10f68586[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934839 WARN  (jetty-launcher-6404-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@10f68586[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934841 INFO  (zkConnectionManagerCallback-6429-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934841 INFO  (jetty-launcher-6404-thread-1) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63325/solr
   [junit4]   2> 934841 INFO  (jetty-launcher-6404-thread-2) 
[n:127.0.0.1:63332_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 934842 INFO  (jetty-launcher-6404-thread-1) 
[n:127.0.0.1:63336_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 934849 INFO  (zkConnectionManagerCallback-6434-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934849 INFO  (jetty-launcher-6404-thread-1) 
[n:127.0.0.1:63336_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 934931 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 934932 WARN  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@55d398a4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934932 WARN  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@55d398a4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934935 WARN  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@532b5fe1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934935 WARN  (jetty-launcher-6404-thread-4) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@532b5fe1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 934936 INFO  (jetty-launcher-6404-thread-4) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63325/solr
   [junit4]   2> 934937 INFO  (jetty-launcher-6404-thread-4) 
[n:127.0.0.1:63335_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 934940 INFO  (zkConnectionManagerCallback-6445-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 934941 INFO  (jetty-launcher-6404-thread-4) 
[n:127.0.0.1:63335_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 935041 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 935043 WARN  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@45e6495b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 935043 WARN  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@45e6495b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 935046 WARN  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@689c9251[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 935046 WARN  (jetty-launcher-6404-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@689c9251[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 935047 INFO  (jetty-launcher-6404-thread-3) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63325/solr
   [junit4]   2> 935048 INFO  (jetty-launcher-6404-thread-3) 
[n:127.0.0.1:63339_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 935052 INFO  (zkC

[...truncated too long message...]

.0.0.1:63332_solr-n_0000000000) closing
   [junit4]   2> 939902 INFO  
(OverseerStateUpdate-72086536416133127-127.0.0.1:63332_solr-n_0000000000) 
[n:127.0.0.1:63332_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:63332_solr
   [junit4]   2> 939902 INFO  
(OverseerAutoScalingTriggerThread-72086536416133127-127.0.0.1:63332_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 939903 DEBUG (closeThreadPool-6542-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 939903 DEBUG (closeThreadPool-6542-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 939903 DEBUG (closeThreadPool-6542-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 939906 INFO  (jetty-closer-6524-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 939906 INFO  (jetty-closer-6524-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@71e6ebe5: rootName = 
solr_63335, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@4efd0d24
   [junit4]   2> 939906 INFO  (jetty-closer-6524-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 939907 INFO  (jetty-closer-6524-thread-4) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@52a3d534: rootName = 
solr_63339, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@4efd0d24
   [junit4]   2> 939907 DEBUG (closeThreadPool-6542-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 939907 DEBUG (closeThreadPool-6542-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 939909 INFO  (jetty-closer-6524-thread-4) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 939924 DEBUG (closeThreadPool-6542-thread-1) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 939924 INFO  (closeThreadPool-6542-thread-2) [     ] 
o.a.s.c.Overseer Overseer 
(id=72086536416133127-127.0.0.1:63332_solr-n_0000000000) closing
   [junit4]   2> 940033 INFO  (zkCallback-6444-thread-2) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
   [junit4]   2> 940042 INFO  (jetty-closer-6524-thread-4) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@67fbd55e{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 940044 INFO  (jetty-closer-6524-thread-4) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1fc37d04{/solr,null,UNAVAILABLE}
   [junit4]   2> 940044 INFO  (jetty-closer-6524-thread-4) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 940140 INFO  (jetty-closer-6524-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72086536416133127-127.0.0.1:63332_solr-n_0000000000) closing
   [junit4]   2> 940157 INFO  (jetty-closer-6524-thread-1) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@3a16a144{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 940158 INFO  (jetty-closer-6524-thread-1) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@64441894{/solr,null,UNAVAILABLE}
   [junit4]   2> 940158 INFO  (jetty-closer-6524-thread-1) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 940251 INFO  (jetty-closer-6524-thread-3) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@47fe5509{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 940252 INFO  (jetty-closer-6524-thread-3) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2dc0a68d{/solr,null,UNAVAILABLE}
   [junit4]   2> 940252 INFO  (jetty-closer-6524-thread-3) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 940262 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 940484 WARN  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        6       /solr/aliases.json
   [junit4]   2>        6       /solr/clusterprops.json
   [junit4]   2>        5       /solr/packages.json
   [junit4]   2>        5       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/autoscaling.json
   [junit4]   2>        2       
/solr/overseer_elect/election/72086536416133127-127.0.0.1:63332_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        34      /solr/live_nodes
   [junit4]   2>        11      /solr/overseer/queue
   [junit4]   2>        6       /solr/collections
   [junit4]   2>        2       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        2       
/solr/autoscaling/events/node_lost_restore_trigger
   [junit4]   2> 
   [junit4]   2> 940494 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:63325
   [junit4]   2> 940494 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63325
   [junit4]   2> 940494 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63325
   [junit4]   2> 940496 INFO  
(TEST-NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState-seed#[51E268A6EE1EA94C])
 [     ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTriggerRestoreState
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.NodeLostTriggerIntegrationTest_51E268A6EE1EA94C-001
   [junit4]   2> Jun 11, 2020 1:51:21 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene86): {}, 
docValues:{}, maxPointsInLeafNode=1759, maxMBSortInHeap=7.008508192529043, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4b602d0c),
 locale=to, timezone=Asia/Taipei
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 12.0.2 
(64-bit)/cpus=6,threads=1,free=135656152,total=270630912
   [junit4]   2> NOTE: All tests run in this JVM: [DebugComponentTest, 
SolrIndexMetricsTest, VMParamsZkACLAndCredentialsProvidersTest, 
UniqFieldsUpdateProcessorFactoryTest, TermVectorComponentTest, 
TestSimPolicyCloud, SplitShardTest, DistribDocExpirationUpdateProcessorTest, 
ExternalFileFieldSortTest, SpellCheckComponentTest, SearchHandlerTest, 
TestCloudPseudoReturnFields, IndexSizeEstimatorTest, TestConfigSetProperties, 
TestFiltering, ZkStateReaderTest, TestSubQueryTransformer, TestWriterPerf, 
TestCursorMarkWithoutUniqueKey, TestRestoreCore, ConnectionManagerTest, 
ZkDynamicConfigTest, AnalysisErrorHandlingTest, SolrIndexSearcherTest, 
FieldAnalysisRequestHandlerTest, SharedFSAutoReplicaFailoverTest, 
TestCloudConsistency, TestWaitForStateWithJettyShutdowns, TestRandomFlRTGCloud, 
PrimitiveFieldTypeTest, DeleteNodeTest, TestDistributedTracing, 
TestRequestStatusCollectionAPI, TestSimExtremeIndexing, 
SolrLogAuditLoggerPluginTest, TestPerFieldSimilarityWithDefaultOverride, 
TestBadConfig, RoutingToNodesWithPropertiesTest, TestNumericTokenStream, 
TestDelegationWithHadoopAuth, TestPrepRecovery, VersionInfoTest, 
IndexSizeTriggerTest, ExecutePlanActionTest, PeerSyncReplicationTest, 
TestSchemaField, DateRangeFieldTest, TestCloudManagedSchema, 
TestSolrCoreSnapshots, ChaosMonkeyNothingIsSafeTest, TestCollapseQParserPlugin, 
TestSimClusterStateProvider, CleanupOldIndexTest, SolrLogPostToolTest, 
ScheduledTriggerIntegrationTest, TestManagedSchema, NumberUtilsTest, 
OverseerSolrResponseUnsafeSerializationTest, TestFieldCollectionResource, 
BaseCdcrDistributedZkTest, CollectionPropsTest, XCJFQueryTest, 
DistributedFacetPivotLongTailTest, TestExactSharedStatsCache, 
NodeLostTriggerIntegrationTest]
   [junit4] Completed [338/910 (1!)] on J3 in 43.07s, 2 tests, 1 failure <<< 
FAILURES!

[...truncated 53977 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6148/consoleText

[repro] Revision: 07a203628ea46308612f4bb60686c313a6e4d75e

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line:  ant test  -Dtestcase=NodeLostTriggerIntegrationTest 
-Dtests.method=testNodeLostTrigger -Dtests.seed=51E268A6EE1EA94C 
-Dtests.slow=true -Dtests.locale=to -Dtests.timezone=Asia/Taipei 
-Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       NodeLostTriggerIntegrationTest
[repro] ant compile-test

[...truncated 3154 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.NodeLostTriggerIntegrationTest" -Dtests.showOutput=onerror 
"-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=51E268A6EE1EA94C 
-Dtests.slow=true -Dtests.locale=to -Dtests.timezone=Asia/Taipei 
-Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 86 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: 
org.apache.solr.cloud.autoscaling.NodeLostTriggerIntegrationTest
[repro] Exiting with code 0

[...truncated 73 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to