Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5064/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader

Error Message:
Timeout occurred while waiting response from server at: 
http://127.0.0.1:59918/solr/pull_replica_error_handling_test_cant_connect_to_leader_shard1_replica_p2

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occurred while 
waiting response from server at: 
http://127.0.0.1:59918/solr/pull_replica_error_handling_test_cant_connect_to_leader_shard1_replica_p2
        at 
__randomizedtesting.SeedInfo.seed([90B0A31D87774E12:1EBCC36DF26FCA38]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:987)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:1002)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.assertNumDocs(TestPullReplicaErrorHandling.java:248)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.assertNumDocs(TestPullReplicaErrorHandling.java:258)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader(TestPullReplicaErrorHandling.java:202)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at 
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at 
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at 
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at 
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at 
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
        at 
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
        ... 47 more




Build Log:
[...truncated 12809 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4]   2> 315008 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/init-core-data-001
   [junit4]   2> 315009 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 315022 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
 w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 315027 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001
   [junit4]   2> 315027 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 315028 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 315028 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 315133 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:59870
   [junit4]   2> 315133 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59870
   [junit4]   2> 315133 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 59870
   [junit4]   2> 315156 INFO  (zkConnectionManagerCallback-1108-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315162 INFO  (zkConnectionManagerCallback-1110-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315166 INFO  (zkConnectionManagerCallback-1112-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315170 WARN  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 315171 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 315171 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 315171 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 315179 WARN  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 315179 WARN  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 315179 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 315179 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 315179 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 315179 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 315179 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 315180 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 315180 WARN  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 315180 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 315180 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 315180 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 315181 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 315182 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 315182 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 315182 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@48d671ae{/solr,null,AVAILABLE}
   [junit4]   2> 315185 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 315185 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 315185 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 315187 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 315187 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 315187 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 315188 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3d4319c9{/solr,null,AVAILABLE}
   [junit4]   2> 315190 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 315190 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 315190 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 315191 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2e8bf50e{/solr,null,AVAILABLE}
   [junit4]   2> 315192 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@3c876685{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59876}
   [junit4]   2> 315192 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.s.Server Started @315273ms
   [junit4]   2> 315192 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5081e3ea{/solr,null,AVAILABLE}
   [junit4]   2> 315192 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59876}
   [junit4]   2> 315193 ERROR (jetty-launcher-1113-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@454b7953{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59875}
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.s.Server Started @315273ms
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59875}
   [junit4]   2> 315193 ERROR (jetty-launcher-1113-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@63e2d7dc{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59877}
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.s.Server Started @315274ms
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59877}
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:11.353Z
   [junit4]   2> 315193 ERROR (jetty-launcher-1113-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 315193 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@5de64d34{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59878}
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.s.Server Started @315275ms
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59878}
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:11.354Z
   [junit4]   2> 315194 ERROR (jetty-launcher-1113-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 315194 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:11.354Z
   [junit4]   2> 315195 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 315195 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 315195 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 315195 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:11.355Z
   [junit4]   2> 315201 INFO  (zkConnectionManagerCallback-1115-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315202 INFO  (zkConnectionManagerCallback-1119-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315202 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 315203 INFO  (zkConnectionManagerCallback-1117-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315203 INFO  (zkConnectionManagerCallback-1121-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315204 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 315207 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 315208 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 315235 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1006fd223100004, likely client has closed socket
   [junit4]   2> 315237 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1006fd223100005, likely client has closed socket
   [junit4]   2> 315371 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 315378 WARN  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@25d4c44d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315398 WARN  (jetty-launcher-1113-thread-2) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@5de63b39[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315400 INFO  (jetty-launcher-1113-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 315402 INFO  (zkConnectionManagerCallback-1127-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315407 INFO  (zkConnectionManagerCallback-1129-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315409 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 315423 WARN  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@54cc26dc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315449 WARN  (jetty-launcher-1113-thread-1) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@157515f8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315451 INFO  (jetty-launcher-1113-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 315456 INFO  (zkConnectionManagerCallback-1137-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315481 INFO  (zkConnectionManagerCallback-1139-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315509 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:59878_solr
   [junit4]   2> 315510 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.Overseer Overseer 
(id=72180542359994378-127.0.0.1:59878_solr-n_0000000000) starting
   [junit4]   2> 315528 INFO  (zkConnectionManagerCallback-1146-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315535 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:59870/solr ready
   [junit4]   2> 315536 INFO  
(OverseerStateUpdate-72180542359994378-127.0.0.1:59878_solr-n_0000000000) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:59878_solr
   [junit4]   2> 315544 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59878_solr
   [junit4]   2> 315548 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 315548 INFO  (zkCallback-1145-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 315629 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 315634 WARN  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@7312ede5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315646 WARN  (jetty-launcher-1113-thread-3) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@7215e22c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315656 INFO  (jetty-launcher-1113-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 315672 INFO  (zkConnectionManagerCallback-1152-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315678 INFO  (zkConnectionManagerCallback-1154-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315696 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 315702 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:59875_solr as DOWN
   [junit4]   2> 315704 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 315705 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59875_solr
   [junit4]   2> 315707 INFO  (zkCallback-1145-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 315707 INFO  (zkCallback-1153-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 315707 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 315754 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 315757 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 315762 WARN  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@30b74e26[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315777 INFO  (zkConnectionManagerCallback-1164-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315787 WARN  (jetty-launcher-1113-thread-4) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@176b6b1f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 315788 INFO  (jetty-launcher-1113-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 315791 INFO  (zkConnectionManagerCallback-1168-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315797 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 315801 INFO  (zkConnectionManagerCallback-1170-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315802 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:59870/solr ready
   [junit4]   2> 315804 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 315810 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 315810 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 315816 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:59876_solr as DOWN
   [junit4]   2> 315817 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 315817 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59876_solr
   [junit4]   2> 315820 INFO  (zkCallback-1153-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 315820 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 315820 INFO  (zkCallback-1163-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 315821 INFO  (zkCallback-1145-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 315821 INFO  (zkCallback-1169-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 315821 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 315821 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:59877_solr as DOWN
   [junit4]   2> 315823 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 315823 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59877_solr
   [junit4]   2> 315830 INFO  (zkCallback-1163-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 315830 INFO  (zkCallback-1145-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 315830 INFO  (zkCallback-1153-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 315831 INFO  (zkCallback-1169-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 315831 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 315831 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 315928 INFO  (zkConnectionManagerCallback-1178-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315933 INFO  (zkConnectionManagerCallback-1183-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 315933 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 315940 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 315940 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:59870/solr ready
   [junit4]   2> 315940 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 315942 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:59870/solr ready
   [junit4]   2> 315942 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 316013 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59875.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316054 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59878.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316067 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59878.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316067 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59878.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316073 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59876.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316083 INFO  (jetty-launcher-1113-thread-1) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node1/.
   [junit4]   2> 316086 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59877.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316107 WARN  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.m.r.j.JmxMetricsReporter Unable to register 
gauge
   [junit4]   2>           => javax.management.InstanceNotFoundException: 
solr_59876:dom1=solr,dom2=jvm,name0=buffers,name1=direct,name=MemoryUsed
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
   [junit4]   2> javax.management.InstanceNotFoundException: 
solr_59876:dom1=solr,dom2=jvm,name0=buffers,name1=direct,name=MemoryUsed
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) 
~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:531)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:569)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:742)
 ~[java/:?]
   [junit4]   2>        at java.util.HashMap.forEach(HashMap.java:1289) 
~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:732)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:110)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:916)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:843)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:601) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:252)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:172) 
~[java/:?]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:136) 
~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750)
 ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) 
~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) 
~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) 
~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) 
~[?:1.8.0_172]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:744) 
~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1449)
 ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1513)
 ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1158)
 ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:995)
 ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:467)
 ~[jetty-servlet-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:381)
 ~[java/:?]
   [junit4]   2>        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
 ~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
 ~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:544)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:483)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:451)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:437)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:272)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 316108 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59875.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316108 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59875.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316118 INFO  (jetty-launcher-1113-thread-3) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node3/.
   [junit4]   2> 316145 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59877.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316146 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59877.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316147 INFO  (jetty-launcher-1113-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node2/.
   [junit4]   2> 316151 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59876.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316163 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59876.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 316165 INFO  (jetty-launcher-1113-thread-4) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node4/.
   [junit4]   2> 316502 INFO  (zkConnectionManagerCallback-1190-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 316505 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 316507 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59870/solr ready
   [junit4]   2> 316553 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=475511833
   [junit4]   2> 316553 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59878_solr
   [junit4]   2> 316554 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 316554 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:59878_solr as DOWN
   [junit4]   2> 316557 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 316558 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 316563 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@44f225e5: rootName = 
solr_59878, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@17709be3
   [junit4]   2> 316570 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 316570 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@3b823dff: rootName = 
solr_59878, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@b0c7e05
   [junit4]   2> 316574 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 316574 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@145e9c6f: rootName = 
solr_59878, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@7e06ff6e
   [junit4]   2> 316574 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 316576 INFO  (closeThreadPool-1193-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994378-127.0.0.1:59878_solr-n_0000000000) closing
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7d0ac854[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 316576 INFO  
(OverseerStateUpdate-72180542359994378-127.0.0.1:59878_solr-n_0000000000) 
[n:127.0.0.1:59878_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:59878_solr
   [junit4]   2> 316576 INFO  
(OverseerAutoScalingTriggerThread-72180542359994378-127.0.0.1:59878_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@70dbaef5[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 316598 INFO  (zkCallback-1163-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316598 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316598 INFO  (zkCallback-1169-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316600 INFO  (zkCallback-1153-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59875_solr
   [junit4]   2> 316600 INFO  (zkCallback-1153-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316603 INFO  (zkCallback-1182-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316603 INFO  (closeThreadPool-1193-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994378-127.0.0.1:59878_solr-n_0000000000) closing
   [junit4]   2> 316603 INFO  (zkCallback-1177-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316607 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994378-127.0.0.1:59878_solr-n_0000000000) closing
   [junit4]   2> 316607 INFO  (zkCallback-1153-thread-1) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.Overseer Overseer 
(id=72180542359994381-127.0.0.1:59875_solr-n_0000000001) starting
   [junit4]   2> 316607 INFO  (zkCallback-1189-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 316610 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@5de64d34{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 316611 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5081e3ea{/solr,null,UNAVAILABLE}
   [junit4]   2> 316614 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 316616 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 316616 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 316617 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 316617 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 316619 INFO  
(OverseerStateUpdate-72180542359994381-127.0.0.1:59875_solr-n_0000000001) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:59875_solr
   [junit4]   2> 316624 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 316624 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 316624 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 316624 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@59e7aacc{/solr,null,AVAILABLE}
   [junit4]   2> 316632 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@5c0e56b3{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59897}
   [junit4]   2> 316633 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.Server Started @316713ms
   [junit4]   2> 316633 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59896}
   [junit4]   2> 316633 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 316633 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 316633 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 316634 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 316634 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 316634 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:12.794Z
   [junit4]   2> 316641 INFO  (zkConnectionManagerCallback-1195-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 316646 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 316792 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 316795 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@54fa0139[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 316800 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@413ed44b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 316801 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 316805 INFO  (zkConnectionManagerCallback-1201-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 316810 INFO  (zkConnectionManagerCallback-1203-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 316821 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 316831 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:59896_solr as DOWN
   [junit4]   2> 316834 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 316834 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59896_solr
   [junit4]   2> 316838 INFO  (zkCallback-1163-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316838 INFO  (zkCallback-1189-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316838 INFO  (zkCallback-1169-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316838 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316839 INFO  (zkCallback-1153-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316841 INFO  (zkCallback-1182-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316841 INFO  (zkCallback-1202-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316842 INFO  (zkCallback-1177-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 316933 INFO  (zkConnectionManagerCallback-1210-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 316938 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 316940 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:59870/solr ready
   [junit4]   2> 316941 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 316997 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59896.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 317014 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59896.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 317015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_59896.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 317016 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) 
[n:127.0.0.1:59896_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node1/.
   [junit4]   2> 317177 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:59897/solr. Proxy: http://127.0.0.1:59896/solr
   [junit4]   2> 317177 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=51680377
   [junit4]   2> 317178 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59875_solr
   [junit4]   2> 317179 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 317179 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:59875_solr as DOWN
   [junit4]   2> 317190 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 317191 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@255247f6: rootName = 
solr_59875, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@141b76f3
   [junit4]   2> 317204 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 317204 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4a555db6: rootName = 
solr_59875, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@b0c7e05
   [junit4]   2> 317208 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 317208 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@535d8bc8: rootName = 
solr_59875, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@7e06ff6e
   [junit4]   2> 317208 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@39a71f39[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3760e67d[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 317213 INFO  (closeThreadPool-1214-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994381-127.0.0.1:59875_solr-n_0000000001) closing
   [junit4]   2> 317214 INFO  
(OverseerStateUpdate-72180542359994381-127.0.0.1:59875_solr-n_0000000001) 
[n:127.0.0.1:59875_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:59875_solr
   [junit4]   2> 317214 INFO  
(OverseerAutoScalingTriggerThread-72180542359994381-127.0.0.1:59875_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 317226 INFO  (closeThreadPool-1214-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994381-127.0.0.1:59875_solr-n_0000000001) closing
   [junit4]   2> 317232 INFO  (zkCallback-1189-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317232 INFO  (zkCallback-1169-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317232 INFO  (zkCallback-1177-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317232 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317232 INFO  (zkCallback-1182-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317232 INFO  (zkCallback-1169-thread-2) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59876_solr
   [junit4]   2> 317233 INFO  (zkCallback-1202-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317233 INFO  (zkCallback-1209-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 317234 INFO  (zkCallback-1169-thread-2) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.Overseer Overseer 
(id=72180542359994384-127.0.0.1:59876_solr-n_0000000002) starting
   [junit4]   2> 317235 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994381-127.0.0.1:59875_solr-n_0000000001) closing
   [junit4]   2> 317241 INFO  
(OverseerStateUpdate-72180542359994384-127.0.0.1:59876_solr-n_0000000002) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:59876_solr
   [junit4]   2> 317265 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@454b7953{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 317268 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@48d671ae{/solr,null,UNAVAILABLE}
   [junit4]   2> 317268 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 317270 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 317270 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 317271 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 317275 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 317277 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 317277 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 317277 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 317277 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2d76dff1{/solr,null,AVAILABLE}
   [junit4]   2> 317279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@5a27f68e{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59910}
   [junit4]   2> 317279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.Server Started @317360ms
   [junit4]   2> 317279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59907}
   [junit4]   2> 317279 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 317279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 317280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 317280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 317280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 317280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:13.440Z
   [junit4]   2> 317284 INFO  (zkConnectionManagerCallback-1216-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 317285 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 317500 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 317507 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@33b15d15[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 317611 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@23593d90[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 317613 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 317616 INFO  (zkConnectionManagerCallback-1222-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 317621 INFO  (zkConnectionManagerCallback-1224-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 317631 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 317639 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:59907_solr as DOWN
   [junit4]   2> 317641 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 317641 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59907_solr
   [junit4]   2> 317645 INFO  (zkCallback-1177-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1182-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1202-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1189-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1209-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1169-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317645 INFO  (zkCallback-1223-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 317736 INFO  (zkConnectionManagerCallback-1231-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 317740 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 317742 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59870/solr ready
   [junit4]   2> 317742 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 317808 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59907.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 317827 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59907.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 317827 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59907.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 317829 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node3/.
   [junit4]   2> 317955 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:59910/solr. Proxy: http://127.0.0.1:59907/solr
   [junit4]   2> 317956 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1442147552
   [junit4]   2> 317956 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59876_solr
   [junit4]   2> 317957 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 317957 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:59876_solr as DOWN
   [junit4]   2> 317964 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 317967 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1372c247: rootName = 
solr_59876, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@1df22641
   [junit4]   2> 317974 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 317975 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@71c787ab: rootName = 
solr_59876, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@b0c7e05
   [junit4]   2> 317979 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 317979 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6bcdc346: rootName = 
solr_59876, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@7e06ff6e
   [junit4]   2> 317979 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3319a615[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3dde4e06[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 317982 INFO  (closeThreadPool-1235-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994384-127.0.0.1:59876_solr-n_0000000002) closing
   [junit4]   2> 317982 INFO  
(OverseerStateUpdate-72180542359994384-127.0.0.1:59876_solr-n_0000000002) 
[n:127.0.0.1:59876_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:59876_solr
   [junit4]   2> 317986 INFO  
(OverseerAutoScalingTriggerThread-72180542359994384-127.0.0.1:59876_solr-n_0000000002)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 318005 INFO  (closeThreadPool-1235-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994384-127.0.0.1:59876_solr-n_0000000002) closing
   [junit4]   2> 318009 INFO  (zkCallback-1128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318010 INFO  (zkCallback-1223-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318010 INFO  (zkCallback-1189-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318010 INFO  (zkCallback-1177-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318010 INFO  (zkCallback-1128-thread-2) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59877_solr
   [junit4]   2> 318010 INFO  (zkCallback-1230-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318012 INFO  (zkCallback-1128-thread-2) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.Overseer Overseer 
(id=72180542359994376-127.0.0.1:59877_solr-n_0000000003) starting
   [junit4]   2> 318016 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72180542359994384-127.0.0.1:59876_solr-n_0000000002) closing
   [junit4]   2> 318017 INFO  (zkCallback-1202-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318018 INFO  (zkCallback-1209-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 318018 INFO  
(OverseerStateUpdate-72180542359994376-127.0.0.1:59877_solr-n_0000000003) 
[n:127.0.0.1:59877_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:59877_solr
   [junit4]   2> 318044 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@3c876685{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 318044 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3d4319c9{/solr,null,UNAVAILABLE}
   [junit4]   2> 318045 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 318046 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 318055 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 318055 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 318055 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 318057 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 318057 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 318057 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 318057 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7af3ebbf{/solr,null,AVAILABLE}
   [junit4]   2> 318059 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@2234535c{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:59919}
   [junit4]   2> 318059 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.s.Server Started @318140ms
   [junit4]   2> 318059 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=59918}
   [junit4]   2> 318060 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 318060 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 318060 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
9.0.0
   [junit4]   2> 318060 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 318060 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 318060 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-02-24T18:04:14.220Z
   [junit4]   2> 318063 INFO  (zkConnectionManagerCallback-1237-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 318064 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 318253 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 318255 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@732ea568[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 318262 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@5be40bc4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 318263 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59870/solr
   [junit4]   2> 318266 INFO  (zkConnectionManagerCallback-1243-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 318271 INFO  (zkConnectionManagerCallback-1245-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 318283 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 318291 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:59918_solr as DOWN
   [junit4]   2> 318292 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 318292 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59918_solr
   [junit4]   2> 318295 INFO  (zkCallback-1189-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318295 INFO  (zkCallback-1202-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318295 INFO  (zkCallback-1209-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318295 INFO  (zkCallback-1128-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318296 INFO  (zkCallback-1223-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318296 INFO  (zkCallback-1177-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318296 INFO  (zkCallback-1244-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318296 INFO  (zkCallback-1230-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 318381 INFO  (zkConnectionManagerCallback-1252-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 318384 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 318386 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59870/solr ready
   [junit4]   2> 318386 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 318430 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59918.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 318443 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59918.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 318443 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59918.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ccfd10e
   [junit4]   2> 318444 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_90B0A31D87774E12-001/tempDir-001/node4/.
   [junit4]   2> 318621 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:59919/solr. Proxy: http://127.0.0.1:59918/solr
   [junit4]   2> 318625 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=277418291
   [junit4]   2> 318625 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:59877_solr
   [junit4]   2> 318626 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 318627 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:59877_solr as DOWN
   [junit4]   2> 318632 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 318633 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2e7ffe30: rootName = 
solr_59877, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@5154fcd5
   [junit4]   2> 318648 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 318651 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@24e1f915: rootName = 
solr_59877, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@b0c7e05
   [junit4]   2> 318655 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 318655 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@40ebb4a1: rootName = 
solr_59877, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@7e06ff6e
   [junit4]   2> 318655 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[90B0A31D87774E12]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@8d2d2eb[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7795f4e3[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 318657 INFO  (closeThreadPool-1256-thread-1) [    ] 
o.a.s.c.Overseer Overseer (id=72180542359994376-127.0.0.1:59877_solr-n_00000000

[...truncated too long message...]

tp://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: 
org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath]         confs: [default]
[ivy:cachepath]         found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 28ms :: artifacts dl 1ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
        ---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 90B0A31D87774E12
    [mkdir] Created dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says 今日は! Master seed: 90B0A31D87774E12
   [junit4] Executing 5 suites with 2 JVMs.
   [junit4] 
   [junit4] Started J1 PID([email protected]).
   [junit4] Started J0 PID([email protected]).
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      19.1s J0 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] OK      9.90s J0 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      4.88s J0 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] Completed [1/5] on J0 in 63.04s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      19.2s J1 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] OK      10.6s J1 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      5.73s J1 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] Completed [2/5] on J1 in 66.02s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      5.18s J0 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] OK      8.02s J0 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      4.25s J0 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] Completed [3/5] on J0 in 22.71s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      6.14s J1 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] OK      7.33s J1 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      4.44s J1 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] Completed [4/5] on J1 in 22.70s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      12.2s J0 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] OK      7.00s J0 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      4.55s J0 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] Completed [5/5] on J0 in 27.78s, 3 tests
   [junit4] 
   [junit4] JVM J0:     3.34 ..   119.44 =   116.10s
   [junit4] JVM J1:     3.34 ..    94.43 =    91.10s
   [junit4] Execution time total: 1 minute 59 seconds
   [junit4] Tests summary: 5 suites, 15 tests
   [junit4] Could not remove temporary path: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0 
(java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1 
(java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 257.49s | org.apache.solr.search.facet.TestJsonFacets
[junit4:tophints] 230.62s | org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4:tophints] 206.78s | 
org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
[junit4:tophints] 183.03s | org.apache.solr.cloud.BasicDistributedZkTest
[junit4:tophints] 118.73s | org.apache.solr.update.SoftAutoCommitTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 2 minutes 3 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestPullReplicaErrorHandling
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2802)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2681)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2662)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3041)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to MacOSX VBOX
                at 
hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1743)
                at 
hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:957)
                at hudson.FilePath.act(FilePath.java:1068)
                at hudson.FilePath.act(FilePath.java:1057)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2660)
                at 
hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at 
hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1841)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at 
hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3043)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no 
matches found within 10000
        at hudson.FilePath.act(FilePath.java:1070)
        at hudson.FilePath.act(FilePath.java:1057)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2660)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1841)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern 
"**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=52097627f8a5e5c8e0771d826ea0f5936411a251, 
workspace=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX
[WARNINGS] Computing warning deltas based on reference build #5063
Recording test results
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to