Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/4596/
Java: 64bit/jdk1.8.0_201 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast

Error Message:
Request should fail after trying all replica nodes once

Stack Trace:
junit.framework.AssertionFailedError: Request should fail after trying all 
replica nodes once
        at 
__randomizedtesting.SeedInfo.seed([2C1E2B559B26CA29:FFC302FF3C17A355]:0)
        at 
org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2744)
        at 
org.apache.solr.cloud.TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast(TestQueryingOnDownCollection.java:92)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14611 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestQueryingOnDownCollection
   [junit4]   2> 519201 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 519201 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 519201 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/data-dir-41-001
   [junit4]   2> 519201 WARN  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 519201 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 519202 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 519204 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001
   [junit4]   2> 519204 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 519205 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 519205 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 519205 WARN  (ZkTestServer Run Thread) [     ] 
o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 519305 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer start zk server on port: 33983
   [junit4]   2> 519305 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:33983
   [junit4]   2> 519305 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:33983
   [junit4]   2> 519305 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 33983
   [junit4]   2> 519324 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519347 INFO  (zkConnectionManagerCallback-4492-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519347 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519358 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519368 INFO  (zkConnectionManagerCallback-4494-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519368 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519372 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519372 INFO  (zkConnectionManagerCallback-4496-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519372 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519490 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, 
break even is size 23
   [junit4]   2> 519490 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, 
break even is size 23
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 1.8.0_201-b09
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 1.8.0_201-b09
   [junit4]   2> 519490 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, 
break even is size 23
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 519490 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 1.8.0_201-b09
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 519492 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 519493 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 519493 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@321c6554{/solr,null,AVAILABLE}
   [junit4]   2> 519496 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4e47742c{/solr,null,AVAILABLE}
   [junit4]   2> 519498 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3a6e6bac{/solr,null,AVAILABLE}
   [junit4]   2> 519499 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@7532fe08{SSL, (ssl, 
http/1.1)}{127.0.0.1:41763}
   [junit4]   2> 519499 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.s.Server Started @519530ms
   [junit4]   2> 519499 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41763}
   [junit4]   2> 519500 ERROR (jetty-launcher-4497-thread-1) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.7.0
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-10-04T21:38:11.535Z
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@28810a36{SSL, (ssl, 
http/1.1)}{127.0.0.1:43551}
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.s.Server Started @519531ms
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=43551}
   [junit4]   2> 519500 ERROR (jetty-launcher-4497-thread-2) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.7.0
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr
   [junit4]   2> 519500 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-10-04T21:38:11.535Z
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@67a4abc3{SSL, (ssl, 
http/1.1)}{127.0.0.1:46849}
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.s.Server Started @519531ms
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=46849}
   [junit4]   2> 519501 ERROR (jetty-launcher-4497-thread-3) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.7.0
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr
   [junit4]   2> 519501 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-10-04T21:38:11.536Z
   [junit4]   2> 519508 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519508 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519518 INFO  (zkConnectionManagerCallback-4499-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519518 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519518 INFO  (zkConnectionManagerCallback-4501-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519519 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519519 INFO  (zkConnectionManagerCallback-4503-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519519 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519519 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 519519 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 519519 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 519525 WARN  
(jetty-launcher-4497-thread-3-SendThread(127.0.0.1:33983)) [     ] 
o.a.z.ClientCnxn An exception was thrown while closing send thread for session 
0x1003f0a379f0005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional 
data from server sessionid 0x1003f0a379f0005, likely server has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable 
to read additional data from server sessionid 0x1003f0a379f0005, likely server 
has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 
~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
 ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) 
[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 519685 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 519685 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport 
since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 519686 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@712dffd2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519686 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@712dffd2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519688 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport 
since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 519688 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@7ac57f1c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519689 WARN  (jetty-launcher-4497-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@7ac57f1c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519689 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33983/solr
   [junit4]   2> 519690 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519691 INFO  (zkConnectionManagerCallback-4513-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519691 INFO  (jetty-launcher-4497-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519784 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 519784 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport 
since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 519787 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@5f7d5882[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519787 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@5f7d5882[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519789 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport 
since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 519789 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@42e0cf30[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519789 WARN  (jetty-launcher-4497-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@42e0cf30[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519790 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33983/solr
   [junit4]   2> 519791 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519791 INFO  (zkConnectionManagerCallback-4523-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519791 INFO  (jetty-launcher-4497-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519888 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 519888 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport 
since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 519889 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@25f5daf3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519889 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@25f5daf3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519890 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport 
since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 519891 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@3b5688f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519891 WARN  (jetty-launcher-4497-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@3b5688f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 519891 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33983/solr
   [junit4]   2> 519892 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 519893 INFO  (zkConnectionManagerCallback-4533-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519893 INFO  (jetty-launcher-4497-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 519926 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 519927 INFO  (zkConnectionManagerCallback-4535-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 519927 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 519993 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:46849_solr
   [junit4]   2> 519993 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.Overseer Overseer 
(id=72126907153317897-127.0.0.1:46849_solr-n_0000000000) starting
   [junit4]   2> 519995 INFO  
(OverseerStateUpdate-72126907153317897-127.0.0.1:46849_solr-n_0000000000) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:46849_solr
   [junit4]   2> 519995 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46849_solr
   [junit4]   2> 519996 INFO  (zkCallback-4534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 519997 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 519997 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.CoreContainer Initializing authorization 
plugin: solr.RuleBasedAuthorizationPlugin
   [junit4]   2> 519997 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.CoreContainer Initializing authentication 
plugin: solr.BasicAuthPlugin
   [junit4]   2> 519997 WARN  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.CoreContainer Solr authentication is 
enabled, but SSL is off.  Consider enabling SSL to protect user credentials and 
data with encryption.
   [junit4]   2> 520004 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 520026 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 520027 INFO  (zkConnectionManagerCallback-4548-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 520027 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 520028 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46849.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520032 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46849.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520032 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46849.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520032 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 520033 INFO  (jetty-launcher-4497-thread-3) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node3
   [junit4]   2> 520036 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:41763_solr as DOWN
   [junit4]   2> 520037 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 520037 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41763_solr
   [junit4]   2> 520037 INFO  (zkCallback-4534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 520038 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 520038 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.CoreContainer Initializing authorization 
plugin: solr.RuleBasedAuthorizationPlugin
   [junit4]   2> 520038 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.CoreContainer Initializing authentication 
plugin: solr.BasicAuthPlugin
   [junit4]   2> 520038 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 520038 WARN  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.CoreContainer Solr authentication is 
enabled, but SSL is off.  Consider enabling SSL to protect user credentials and 
data with encryption.
   [junit4]   2> 520047 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 520062 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41763.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520067 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41763.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520067 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41763.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520068 INFO  (jetty-launcher-4497-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node1
   [junit4]   2> 520126 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 520127 INFO  (zkConnectionManagerCallback-4559-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 520127 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 520129 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 520131 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:43551_solr as DOWN
   [junit4]   2> 520131 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 520131 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:43551_solr
   [junit4]   2> 520131 INFO  (zkCallback-4534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520131 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520131 INFO  (zkCallback-4558-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 520132 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 520132 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.CoreContainer Initializing authorization 
plugin: solr.RuleBasedAuthorizationPlugin
   [junit4]   2> 520132 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.CoreContainer Initializing authentication 
plugin: solr.BasicAuthPlugin
   [junit4]   2> 520132 WARN  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.CoreContainer Solr authentication is 
enabled, but SSL is off.  Consider enabling SSL to protect user credentials and 
data with encryption.
   [junit4]   2> 520137 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 520146 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43551.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520150 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43551.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520150 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43551.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520151 INFO  (jetty-launcher-4497-thread-2) 
[n:127.0.0.1:43551_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node2
   [junit4]   2> 520160 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
   [junit4]   2> 520161 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 520162 INFO  (zkConnectionManagerCallback-4572-thread-1) [     
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 520162 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 520163 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 520163 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33983/solr ready
   [junit4]   2> 520185 INFO  
(TEST-TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast-seed#[2C1E2B559B26CA29])
 [     ] o.a.s.SolrTestCaseJ4 ###Starting 
testQueryToDownCollectionShouldFailFast
   [junit4]   2> 520197 INFO  (qtp986193178-8099) [n:127.0.0.1:41763_solr     ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf&name=infected&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 520200 INFO  
(OverseerThreadFactory-4542-thread-1-processing-n:127.0.0.1:46849_solr) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
infected
   [junit4]   2> 520304 INFO  
(OverseerStateUpdate-72126907153317897-127.0.0.1:46849_solr-n_0000000000) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"infected",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"infected_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41763/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:41763_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 520305 INFO  
(OverseerStateUpdate-72126907153317897-127.0.0.1:46849_solr-n_0000000000) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"infected",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"infected_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:46849/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:46849_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 520537 INFO  (qtp677272195-8110) [n:127.0.0.1:46849_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/key 
params={omitHeader=true&wt=json} status=0 QTime=0
   [junit4]   2> 520537 INFO  (qtp986193178-8105) [     ] 
o.a.s.s.PKIAuthenticationPlugin New Key obtained from  node: 
127.0.0.1:46849_solr / 
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAqGPLxDIMaqhGLIBMa5vAxW6ajn8WNhnH0AtnT+OfS2oOuaGpc59pbbGRQOr40kOgBUS1DdNLYuiFRWa1MRSOdbcNeu1AYEqC9rDUHVvwH/gWS+Cxyo796cTIyib/j9Bfz/TH7SKh76n/Y6IDo+IoghOtG8QJFMOVFpGfbmdPdAV5i6L5uuIdz07iJeqTXvmfLsoOkZjAqQxURJbN0Vp1M1YlgB6t8hHSbFaKOo1yZc292bsDdAhR6Z2poefwIaskyI//R9Wu/wVFVaWDx85VJK9fNMMCkWzaPIibZL7bJ98TM9vnqF90xxeqL7i2OwIxWD7z0vgoJL8Vcf0zB5flmwIDAQAB
   [junit4]   2> 520538 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr    
x:infected_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=infected_shard1_replica_n1&action=CREATE&numShards=2&collection=infected&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 520539 INFO  (qtp677272195-8111) [n:127.0.0.1:46849_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/key 
params={omitHeader=true&wt=json} status=0 QTime=0
   [junit4]   2> 520540 INFO  (qtp677272195-8106) [     ] 
o.a.s.s.PKIAuthenticationPlugin New Key obtained from  node: 
127.0.0.1:46849_solr / 
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAqGPLxDIMaqhGLIBMa5vAxW6ajn8WNhnH0AtnT+OfS2oOuaGpc59pbbGRQOr40kOgBUS1DdNLYuiFRWa1MRSOdbcNeu1AYEqC9rDUHVvwH/gWS+Cxyo796cTIyib/j9Bfz/TH7SKh76n/Y6IDo+IoghOtG8QJFMOVFpGfbmdPdAV5i6L5uuIdz07iJeqTXvmfLsoOkZjAqQxURJbN0Vp1M1YlgB6t8hHSbFaKOo1yZc292bsDdAhR6Z2poefwIaskyI//R9Wu/wVFVaWDx85VJK9fNMMCkWzaPIibZL7bJ98TM9vnqF90xxeqL7i2OwIxWD7z0vgoJL8Vcf0zB5flmwIDAQAB
   [junit4]   2> 520540 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr    
x:infected_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=infected_shard2_replica_n2&action=CREATE&numShards=2&collection=infected&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 520541 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr    
x:infected_shard2_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 520556 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 520556 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 520579 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 520581 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 520581 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.CoreContainer Creating SolrCore 'infected_shard1_replica_n1' using 
configuration from configset conf, trusted=true
   [junit4]   2> 520581 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41763.solr.core.infected.shard1.replica_n1' (registry 
'solr.core.infected.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520582 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.SolrCore [[infected_shard1_replica_n1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node1/infected_shard1_replica_n1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node1/infected_shard1_replica_n1/data/]
   [junit4]   2> 520587 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 520589 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 520589 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.CoreContainer Creating SolrCore 'infected_shard2_replica_n2' using 
configuration from configset conf, trusted=true
   [junit4]   2> 520589 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46849.solr.core.infected.shard2.replica_n2' (registry 
'solr.core.infected.shard2.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1f8e1729
   [junit4]   2> 520590 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.SolrCore [[infected_shard2_replica_n2] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node3/infected_shard2_replica_n2],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001/tempDir-001/node3/infected_shard2_replica_n2/data/]
   [junit4]   2> 520621 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 520621 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 520621 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 520622 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 520622 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 520622 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 520623 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 520623 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 520624 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 520624 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 520625 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 520625 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 520625 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1679658836463452160
   [junit4]   2> 520625 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 520625 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 520625 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1679658836463452160
   [junit4]   2> 520626 INFO  
(searcherExecutor-4574-thread-1-processing-n:127.0.0.1:41763_solr 
x:infected_shard1_replica_n1 c:infected s:shard1 r:core_node3) 
[n:127.0.0.1:41763_solr c:infected s:shard1 r:core_node3 
x:infected_shard1_replica_n1 ] o.a.s.c.SolrCore [infected_shard1_replica_n1]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 520627 INFO  
(searcherExecutor-4576-thread-1-processing-n:127.0.0.1:46849_solr 
x:infected_shard2_replica_n2 c:infected s:shard2 r:core_node4) 
[n:127.0.0.1:46849_solr c:infected s:shard2 r:core_node4 
x:infected_shard2_replica_n2 ] o.a.s.c.SolrCore [infected_shard2_replica_n2]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 520628 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/infected/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 520628 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/infected/leaders/shard1
   [junit4]   2> 520628 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/infected/terms/shard2 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 520628 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/infected/leaders/shard2
   [junit4]   2> 520630 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 520630 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 520630 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:41763/solr/infected_shard1_replica_n1/
   [junit4]   2> 520630 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 520630 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 520630 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 520630 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:46849/solr/infected_shard2_replica_n2/
   [junit4]   2> 520630 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.SyncStrategy https://127.0.0.1:41763/solr/infected_shard1_replica_n1/ 
has no replicas
   [junit4]   2> 520630 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/infected/leaders/shard1/leader after winning as 
/collections/infected/leader_elect/shard1/election/72126907153317898-core_node3-n_0000000000
   [junit4]   2> 520630 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 520630 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.SyncStrategy https://127.0.0.1:46849/solr/infected_shard2_replica_n2/ 
has no replicas
   [junit4]   2> 520630 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/infected/leaders/shard2/leader after winning as 
/collections/infected/leader_elect/shard2/election/72126907153317897-core_node4-n_0000000000
   [junit4]   2> 520631 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:41763/solr/infected_shard1_replica_n1/ shard1
   [junit4]   2> 520632 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:46849/solr/infected_shard2_replica_n2/ shard2
   [junit4]   2> 520733 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520733 INFO  (zkCallback-4534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520733 INFO  (zkCallback-4534-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520733 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 520734 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 520739 INFO  (zkCallback-4534-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520739 INFO  (zkCallback-4547-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520739 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520740 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=infected_shard1_replica_n1&action=CREATE&numShards=2&collection=infected&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=202
   [junit4]   2> 520740 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=infected_shard2_replica_n2&action=CREATE&numShards=2&collection=infected&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=199
   [junit4]   2> 520747 INFO  (qtp986193178-8099) [n:127.0.0.1:41763_solr     ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
45 seconds. Check all shard replicas
   [junit4]   2> 520847 INFO  (zkCallback-4547-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520847 INFO  (zkCallback-4534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520847 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520847 INFO  (zkCallback-4534-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520847 INFO  (zkCallback-4534-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520847 INFO  (qtp986193178-8099) [n:127.0.0.1:41763_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={collection.configName=conf&name=infected&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=650
   [junit4]   2> 520860 INFO  (zkCallback-4547-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520860 INFO  (zkCallback-4547-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520870 INFO  (zkCallback-4534-thread-4) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 520902 INFO  (qtp1736172178-8127) [n:127.0.0.1:43551_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/key 
params={omitHeader=true&wt=json} status=0 QTime=0
   [junit4]   2> 520903 INFO  (qtp677272195-8110) [n:127.0.0.1:46849_solr     ] 
o.a.s.s.PKIAuthenticationPlugin New Key obtained from  node: 
127.0.0.1:43551_solr / 
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAgh6KTicCt9DjoeaZwiNUaCdP5aR2Plr6gmiSz3WquPzPibgMPaC1EnlX/YYjqkZ2Vf9NdQt7MK2aOgUyyzisrZkiz+yKarMl0piALtVRkogYTVZPq+FvviIuATPxKGN7530JZbybkmSbUb6n+kZoPqp/yRvbATKZUN5nSZzYRbUK/QKR9DgnVIH6dQBY9zOBpFukwD/d5pcXOhTpbX2APrZuxMSL4/MMqSlCx8mlyrc/TvPcv2DuVTZVR37E5iID0eUA6QmjmjmqitrMFuKcw5qW8tmB/MJgFwJ8tQNFDjSdDJnTS4Aeu+pXg3CNSGhmzIp4gIotF1suQK0mdk+tPwIDAQAB
   [junit4]   2> 520917 INFO  (qtp1736172178-8129) [n:127.0.0.1:43551_solr     
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/key 
params={omitHeader=true&wt=json} status=0 QTime=0
   [junit4]   2> 520917 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr     ] 
o.a.s.s.PKIAuthenticationPlugin New Key obtained from  node: 
127.0.0.1:43551_solr / 
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAgh6KTicCt9DjoeaZwiNUaCdP5aR2Plr6gmiSz3WquPzPibgMPaC1EnlX/YYjqkZ2Vf9NdQt7MK2aOgUyyzisrZkiz+yKarMl0piALtVRkogYTVZPq+FvviIuATPxKGN7530JZbybkmSbUb6n+kZoPqp/yRvbATKZUN5nSZzYRbUK/QKR9DgnVIH6dQBY9zOBpFukwD/d5pcXOhTpbX2APrZuxMSL4/MMqSlCx8mlyrc/TvPcv2DuVTZVR37E5iID0eUA6QmjmjmqitrMFuKcw5qW8tmB/MJgFwJ8tQNFDjSdDJnTS4Aeu+pXg3CNSGhmzIp4gIotF1suQK0mdk+tPwIDAQAB
   [junit4]   2> 520923 INFO  (qtp677272195-8110) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/infected/terms/shard2 to Terms{values={core_node4=1}, version=1}
   [junit4]   2> 520923 INFO  (qtp677272195-8110) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.p.LogUpdateProcessorFactory [infected_shard2_replica_n2]  webapp=/solr 
path=/update params={_stateVer_=infected:3&wt=javabin&version=2}{add=[2 
(1679658836767539200), 3 (1679658836768587776), 5 (1679658836768587777), 6 
(1679658836768587778), 7 (1679658836768587779), 9 (1679658836768587780), 17 
(1679658836768587781), 18 (1679658836768587782), 19 (1679658836768587783), 21 
(1679658836768587784), ... (44 adds)]} 0 19
   [junit4]   2> 520928 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/infected/terms/shard1 to Terms{values={core_node3=1}, version=1}
   [junit4]   2> 520928 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.p.LogUpdateProcessorFactory [infected_shard1_replica_n1]  webapp=/solr 
path=/update params={_stateVer_=infected:3&wt=javabin&version=2}{add=[0 
(1679658836770684928), 1 (1679658836771733504), 4 (1679658836771733505), 8 
(1679658836771733506), 10 (1679658836771733507), 11 (1679658836771733508), 12 
(1679658836773830656), 13 (1679658836773830657), 14 (1679658836773830658), 15 
(1679658836773830659), ... (56 adds)]} 0 10
   [junit4]   2> 520956 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/key 
params={omitHeader=true&wt=json} status=0 QTime=0
   [junit4]   2> 520957 INFO  (qtp677272195-8111) [n:127.0.0.1:46849_solr     ] 
o.a.s.s.PKIAuthenticationPlugin New Key obtained from  node: 
127.0.0.1:41763_solr / 
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAq6p7YhhiWOiq6dq35gLVuJxoWcGs4gyBnY3k/ZsR4Dy/8IMTZ13QFGopeYTKj5mdYulv9mmrCkuVj/sojgpbYzCTOXVBBoPp0mR/i+PY5aKWhmvh4jrC/63aq5Wv5n9xBWjgSFD4UKSfQqETthnbi7NCwrP7dS18Kmvo1IbpQ0McCUnyN3/BkgsJ78wcdboy+Tz80WYcgbBvcSPCF6WwAAT/vwBUrL5R/SGkyafvRiPtqxOF3hpSHw8e9Ca3FW7V1QnjsxaNCBHrujFVJsjfomtQ9VBNFq2rvFfEbfuJ7xpTp8HDA0o5v5BAa5ypcMJRl2pd0yHT7CPQY2IkQIGHOQIDAQAB
   [junit4]   2> 520985 INFO  
(searcherExecutor-4576-thread-1-processing-n:127.0.0.1:46849_solr 
x:infected_shard2_replica_n2 c:infected s:shard2 r:core_node4) 
[n:127.0.0.1:46849_solr c:infected s:shard2 r:core_node4 
x:infected_shard2_replica_n2 ] o.a.s.c.SolrCore [infected_shard2_replica_n2]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 520985 INFO  (qtp677272195-8111) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.u.p.LogUpdateProcessorFactory [infected_shard2_replica_n2]  webapp=/solr 
path=/update 
params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:41763/solr/infected_shard1_replica_n1/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 27
   [junit4]   2> 521007 INFO  
(searcherExecutor-4574-thread-1-processing-n:127.0.0.1:41763_solr 
x:infected_shard1_replica_n1 c:infected s:shard1 r:core_node3) 
[n:127.0.0.1:41763_solr c:infected s:shard1 r:core_node3 
x:infected_shard1_replica_n1 ] o.a.s.c.SolrCore [infected_shard1_replica_n1]  
Registered new searcher autowarm time: 0 ms
   [junit4]   2> 521007 INFO  (qtp986193178-8099) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.u.p.LogUpdateProcessorFactory [infected_shard1_replica_n1]  webapp=/solr 
path=/update 
params={_stateVer_=infected:3&commit=true&wt=javabin&version=2}{commit=} 0 77
   [junit4]   2> 521008 INFO  (zkCallback-4547-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521008 INFO  (zkCallback-4547-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521008 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521009 INFO  (zkCallback-4547-thread-4) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521012 INFO  (zkCallback-4534-thread-4) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521012 INFO  (zkCallback-4534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521012 INFO  (zkCallback-4534-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521012 INFO  (zkCallback-4534-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/collections/infected/state.json] 
for collection [infected] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 521017 INFO  (qtp677272195-8106) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.S.Request [infected_shard2_replica_n2]  webapp=/solr path=/select 
params={df=text&distrib=false&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=https://127.0.0.1:46849/solr/infected_shard2_replica_n2/&rows=0&rid=127.0.0.1-24871&version=2&q=*:*&omitHeader=false&NOW=1601847493048&isShard=true&wt=javabin}
 hits=44 status=0 QTime=0
   [junit4]   2> 521019 INFO  (qtp986193178-8105) [n:127.0.0.1:41763_solr 
c:infected s:shard1 r:core_node3 x:infected_shard1_replica_n1 ] 
o.a.s.c.S.Request [infected_shard1_replica_n1]  webapp=/solr path=/select 
params={df=text&distrib=false&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=https://127.0.0.1:41763/solr/infected_shard1_replica_n1/&rows=0&rid=127.0.0.1-24871&version=2&q=*:*&omitHeader=false&NOW=1601847493048&isShard=true&wt=javabin}
 hits=56 status=0 QTime=0
   [junit4]   2> 521019 INFO  (qtp677272195-8111) [n:127.0.0.1:46849_solr 
c:infected s:shard2 r:core_node4 x:infected_shard2_replica_n2 ] 
o.a.s.c.S.Request [infected_shard2_replica_n2]  webapp=/solr path=/select 
params={q=*:*&rows=0&wt=javabin&version=2} rid=127.0.0.1-24871 hits=100 
status=0 QTime=6
   [junit4]   2> 521020 INFO  
(TEST-TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast-seed#[2C1E2B559B26CA29])
 [     ] o.a.s.SolrTestCaseJ4 ###Ending testQueryToDownCollectionShouldFailFast
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestQueryingOnDownCollection 
-Dtests.method=testQueryToDownCollectionShouldFailFast 
-Dtests.seed=2C1E2B559B26CA29 -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=ar-QA -Dtests.timezone=CAT -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.86s J2 | 
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast <<<
   [junit4]    > Throwable #1: junit.framework.AssertionFailedError: Request 
should fail after trying all replica nodes once
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2C1E2B559B26CA29:FFC302FF3C17A355]:0)
   [junit4]    >        at 
org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2744)
   [junit4]    >        at 
org.apache.solr.cloud.TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast(TestQueryingOnDownCollection.java:92)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 521024 WARN  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker-SendThread(127.0.0.1:33983))
 [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for 
session 0x1003f0a379f000c.
   [junit4]   2>           => EndOfStreamException: Unable to read additional 
data from server sessionid 0x1003f0a379f000c, likely server has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable 
to read additional data from server sessionid 0x1003f0a379f000c, likely server 
has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 
~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
 ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) 
[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 521125 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1633376576
   [junit4]   2> 521125 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1606231844
   [junit4]   2> 521125 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46849_solr
   [junit4]   2> 521125 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41763_solr
   [junit4]   2> 521126 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 521126 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 521126 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.c.ZkController Publish node=127.0.0.1:46849_solr as DOWN
   [junit4]   2> 521126 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.c.ZkController Publish node=127.0.0.1:41763_solr as DOWN
   [junit4]   2> 521127 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=740467719
   [junit4]   2> 521127 INFO  (coreCloseExecutor-4593-thread-1) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.SolrCore [infected_shard2_replica_n2]  
CLOSING SolrCore org.apache.solr.core.SolrCore@5fc6aead
   [junit4]   2> 521127 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:43551_solr
   [junit4]   2> 521127 INFO  (coreCloseExecutor-4594-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.c.SolrCore [infected_shard1_replica_n1]  
CLOSING SolrCore org.apache.solr.core.SolrCore@374bfbc7
   [junit4]   2> 521127 INFO  (coreCloseExecutor-4593-thread-1) 
[n:127.0.0.1:46849_solr     ] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.core.infected.shard2.replica_n2 
tag=SolrCore@5fc6aead
   [junit4]   2> 521127 INFO  (coreCloseExecutor-4594-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.core.infected.shard1.replica_n1 
tag=SolrCore@374bfbc7
   [junit4]   2> 521127 INFO  (coreCloseExecutor-4594-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4432cb71: rootName = 
solr_41763, domain = solr.core.infected.shard1.replica_n1, service url = null, 
agent id = null] for registry 
solr.core.infected.shard1.replica_n1/com.codahale.metrics.MetricRegistry@2ec4bf52
   [junit4]   2> 521127 INFO  (coreCloseExecutor-4593-thread-1) 
[n:127.0.0.1:46849_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@dae60c4: rootName = 
solr_46849, domain = solr.core.infected.shard2.replica_n2, service url = null, 
agent id = null] for registry 
solr.core.infected.shard2.replica_n2/com.codahale.metrics.MetricRegistry@5c68e9a
   [junit4]   2> 521128 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 521128 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.c.ZkController Publish node=127.0.0.1:43551_solr as DOWN
   [junit4]   2> 521129 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 521129 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4911005: rootName = 
solr_43551, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@2b298d73
   [junit4]   2> 521136 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 521136 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@49a66889: rootName = 
solr_43551, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@62cb4ff7
   [junit4]   2> 521138 INFO  (coreCloseExecutor-4593-thread-1) 
[n:127.0.0.1:46849_solr     ] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.infected.shard2.leader 
tag=SolrCore@5fc6aead
   [junit4]   2> 521138 INFO  (coreCloseExecutor-4594-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.infected.shard1.leader 
tag=SolrCore@374bfbc7
   [junit4]   2> 521139 INFO  (coreCloseExecutor-4594-thread-1) 
[n:127.0.0.1:41763_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on 
IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 521139 INFO  (coreCloseExecutor-4593-thread-1) 
[n:127.0.0.1:46849_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on 
IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 521139 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 521139 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@48925a5: rootName = 
solr_43551, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@3de21652
   [junit4]   2> 521139 INFO  (jetty-closer-4585-thread-3) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 521147 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 521147 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 521147 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6d3d8fb6: rootName = 
solr_41763, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@1442ccd0
   [junit4]   2> 521147 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@5d150676: rootName = 
solr_46849, domain = solr.node, service url = null, agent id = null] for 
registry solr.node/com.codahale.metrics.MetricRegistry@30f115f8
   [junit4]   2> 521147 INFO  (zkCallback-4547-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 521147 INFO  (zkCallback-4534-thread-3) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 521151 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 521151 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@42d9ec37: rootName = 
solr_41763, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@62cb4ff7
   [junit4]   2> 521151 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 521151 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2928d380: rootName = 
solr_46849, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm/com.codahale.metrics.MetricRegistry@62cb4ff7
   [junit4]   2> 521152 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 521152 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1094757c: rootName = 
solr_41763, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@3de21652
   [junit4]   2> 521152 INFO  (jetty-closer-4585-thread-2) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 521153 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 521153 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2bba257b: rootName = 
solr_46849, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty/com.codahale.metrics.MetricRegistry@3de21652
   [junit4]   2> 521154 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 521154 INFO  (closeThreadPool-4602-thread-2) [     ] 
o.a.s.c.Overseer Overseer 
(id=72126907153317897-127.0.0.1:46849_solr-n_0000000000) closing
   [junit4]   2> 521154 INFO  (zkCallback-4534-thread-3) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 521158 INFO  
(OverseerStateUpdate-72126907153317897-127.0.0.1:46849_solr-n_0000000000) 
[n:127.0.0.1:46849_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:46849_solr
   [junit4]   2> 521164 INFO  
(OverseerAutoScalingTriggerThread-72126907153317897-127.0.0.1:46849_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 521165 INFO  (closeThreadPool-4602-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72126907153317897-127.0.0.1:46849_solr-n_0000000000) closing
   [junit4]   2> 521248 INFO  (jetty-closer-4585-thread-3) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@28810a36{SSL, (ssl, 
http/1.1)}{127.0.0.1:0}
   [junit4]   2> 521248 INFO  (jetty-closer-4585-thread-3) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3a6e6bac{/solr,null,UNAVAILABLE}
   [junit4]   2> 521249 INFO  (jetty-closer-4585-thread-3) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 521347 INFO  (jetty-closer-4585-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72126907153317897-127.0.0.1:46849_solr-n_0000000000) closing
   [junit4]   2> 521352 INFO  (jetty-closer-4585-thread-1) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@67a4abc3{SSL, (ssl, 
http/1.1)}{127.0.0.1:0}
   [junit4]   2> 521352 INFO  (jetty-closer-4585-thread-1) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@321c6554{/solr,null,UNAVAILABLE}
   [junit4]   2> 521352 INFO  (jetty-closer-4585-thread-1) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 521449 INFO  (jetty-closer-4585-thread-2) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@7532fe08{SSL, (ssl, 
http/1.1)}{127.0.0.1:0}
   [junit4]   2> 521449 INFO  (jetty-closer-4585-thread-2) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@4e47742c{/solr,null,UNAVAILABLE}
   [junit4]   2> 521449 INFO  (jetty-closer-4585-thread-2) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 521450 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 521450 WARN  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker-SendThread(127.0.0.1:33983))
 [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for 
session 0x1003f0a379f0000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional 
data from server sessionid 0x1003f0a379f0000, likely server has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable 
to read additional data from server sessionid 0x1003f0a379f0000, likely server 
has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 
~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
 ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) 
[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 521660 WARN  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2>        3       /solr/packages.json
   [junit4]   2>        3       /solr/collections/infected/terms/shard2
   [junit4]   2>        3       /solr/collections/infected/terms/shard1
   [junit4]   2>        3       /solr/security.json
   [junit4]   2>        2       /solr/configs/conf
   [junit4]   2>        2       /solr/collections/infected/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        30      /solr/collections/infected/state.json
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2>        4       /solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        16      /solr/overseer/queue
   [junit4]   2>        13      /solr/live_nodes
   [junit4]   2>        8       /solr/collections
   [junit4]   2>        5       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 521662 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:33983
   [junit4]   2> 521662 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:33983
   [junit4]   2> 521662 INFO  
(SUITE-TestQueryingOnDownCollection-seed#[2C1E2B559B26CA29]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 33983
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestQueryingOnDownCollection_2C1E2B559B26CA29-001
   [junit4]   2> Oct 04, 2020 9:38:13 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): 
{_root_=PostingsFormat(name=Asserting), 
id=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, 
maxPointsInLeafNode=485, maxMBSortInHeap=7.671168109080268, 
sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=ar-QA, timezone=CAT
   [junit4]   2> NOTE: Linux 5.4.0-48-generic amd64/Oracle Corporation 
1.8.0_201 (64-bit)/cpus=16,threads=1,free=178225800,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: 
[ScheduledTriggerIntegrationTest, TestJoin, NumberUtilsTest, TestLFUCache, 
TestManagedSchemaAPI, DeleteLastCustomShardedReplicaTest, 
ConcurrentCreateRoutedAliasTest, TestSearcherReuse, TestMultiWordSynonyms, 
DistribDocExpirationUpdateProcessorTest, ForceLeaderWithTlogReplicasTest, 
NodeAddedTriggerTest, TestFuzzyAnalyzedSuggestions, 
TlogReplayBufferedWhileIndexingTest, TestSolrConfigHandler, 
BigEndianAscendingWordDeserializerTest, TestQueryTypes, 
HdfsChaosMonkeyNothingIsSafeTest, JSONWriterTest, 
AutoAddReplicasPlanActionTest, SpellingQueryConverterTest, 
TestSimDistribStateManager, BasicAuthStandaloneTest, 
TestEmbeddedSolrServerConstructors, IndexSizeTriggerMixedBoundsTest, 
TestCoreDiscovery, TestConfig, SuggesterWFSTTest, HLLUtilTest, 
TestCloudConsistency, TestUnifiedSolrHighlighter, TestSimNodeAddedTrigger, 
LeaderElectionIntegrationTest, TestNumericTerms64, TestLockTree, 
TestTolerantUpdateProcessorCloud, TestDelegationWithHadoopAuth, 
LegacyCloudClusterPropTest, ClusterStateMockUtilTest, TestRemoteStreaming, 
TestStressLucene, TestConfigSetsAPIZkFailure, TestSchemalessBufferedUpdates, 
TriggerCooldownIntegrationTest, TestSQLHandler, OutputWriterTest, 
TestTermsQParserPlugin, MetricsHandlerTest, TestQueryingOnDownCollection]
   [junit4] Completed [353/920 (1!)] on J2 in 3.01s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 54237 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/4596/consoleText

[repro] Revision: c7693f1c9da2f371a6b5eb5d72a845aebd35c603

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] Repro line:  ant test  -Dtestcase=TestQueryingOnDownCollection 
-Dtests.method=testQueryToDownCollectionShouldFailFast 
-Dtests.seed=2C1E2B559B26CA29 -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=ar-QA -Dtests.timezone=CAT -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestQueryingOnDownCollection
[repro] ant compile-test

[...truncated 3449 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.TestQueryingOnDownCollection" -Dtests.showOutput=onerror 
"-Dargs=-XX:-UseCompressedOops -XX:+UseConcMarkSweepGC" 
-Dtests.seed=2C1E2B559B26CA29 -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=ar-QA -Dtests.timezone=CAT -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[...truncated 76 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.TestQueryingOnDownCollection
[repro] Exiting with code 0

[...truncated 63 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to