Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6185/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.AssignBackwardCompatibilityTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.AssignBackwardCompatibilityTest:     1) Thread[id=98, 
name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-AssignBackwardCompatibilityTest]         at 
[email protected]/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.AssignBackwardCompatibilityTest: 
   1) Thread[id=98, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-AssignBackwardCompatibilityTest]
        at [email protected]/java.lang.Thread.sleep(Native Method)
        at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
        at __randomizedtesting.SeedInfo.seed([EC4B4A0E150CF02F]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.core.snapshots.TestSolrCloudSnapshots

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.core.snapshots.TestSolrCloudSnapshots:     1) Thread[id=53, 
name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSolrCloudSnapshots]    
     at [email protected]/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.core.snapshots.TestSolrCloudSnapshots: 
   1) Thread[id=53, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudSnapshots]
        at [email protected]/java.lang.Thread.sleep(Native Method)
        at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
        at __randomizedtesting.SeedInfo.seed([EC4B4A0E150CF02F]:0)




Build Log:
[...truncated 12125 lines...]
   [junit4] Suite: org.apache.solr.core.snapshots.TestSolrCloudSnapshots
   [junit4]   2> 13051 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 13051 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/data-dir-3-001
   [junit4]   2> 13052 WARN  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 13052 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 13053 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None") w/ MAC_OS_X 
supressed clientAuth
   [junit4]   2> 13053 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 13057 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001
   [junit4]   2> 13067 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 13073 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 13074 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 13282 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer start zk server on port: 62401
   [junit4]   2> 13283 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:62401
   [junit4]   2> 13284 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:62401
   [junit4]   2> 13284 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 62401
   [junit4]   2> 13410 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 13456 INFO  (zkConnectionManagerCallback-47-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13457 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 13489 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 13498 INFO  (zkConnectionManagerCallback-49-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13499 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 13503 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 13509 INFO  (zkConnectionManagerCallback-51-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13510 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 13904 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 13904 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 13908 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
   [junit4]   2> 13909 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 13909 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 13910 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 13910 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 13910 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 13910 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 13929 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
   [junit4]   2> 13929 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
   [junit4]   2> 13930 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: 
a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
   [junit4]   2> 13989 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 13992 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 13993 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 13998 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 13998 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 13998 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 14042 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 14042 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 14043 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 14047 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 14047 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 14047 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 14058 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@248e3d79{/solr,null,AVAILABLE}
   [junit4]   2> 14058 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@31bc8ebd{/solr,null,AVAILABLE}
   [junit4]   2> 14059 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3c41d062{/solr,null,AVAILABLE}
   [junit4]   2> 14059 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7e295e03{/solr,null,AVAILABLE}
   [junit4]   2> 14118 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@b0d2077{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:62417}
   [junit4]   2> 14118 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@4f8a317b{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:62419}
   [junit4]   2> 14118 INFO  (jetty-launcher-52-thread-4) [     ] 
o.e.j.s.Server Started @14188ms
   [junit4]   2> 14118 INFO  (jetty-launcher-52-thread-3) [     ] 
o.e.j.s.Server Started @14188ms
   [junit4]   2> 14118 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=62417}
   [junit4]   2> 14119 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=62419}
   [junit4]   2> 14131 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@244aac49{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:62418}
   [junit4]   2> 14131 INFO  (jetty-launcher-52-thread-2) [     ] 
o.e.j.s.Server Started @14201ms
   [junit4]   2> 14131 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=62418}
   [junit4]   2> 14138 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@5ee500f0{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:62420}
   [junit4]   2> 14138 INFO  (jetty-launcher-52-thread-1) [     ] 
o.e.j.s.Server Started @14209ms
   [junit4]   2> 14138 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=62420}
   [junit4]   2> 14159 ERROR (jetty-launcher-52-thread-3) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 14159 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 14159 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 14159 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 14159 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 14159 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-19T16:37:49.900674Z
   [junit4]   2> 14162 ERROR (jetty-launcher-52-thread-2) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 14162 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 14162 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 14162 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 14162 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 14163 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-19T16:37:49.903995Z
   [junit4]   2> 14163 ERROR (jetty-launcher-52-thread-1) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 14163 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 14163 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 14163 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 14167 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 14167 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-19T16:37:49.908643Z
   [junit4]   2> 14168 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 14170 ERROR (jetty-launcher-52-thread-4) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 14170 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 14170 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
9.0.0
   [junit4]   2> 14171 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 14171 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 14171 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2020-06-19T16:37:49.912177Z
   [junit4]   2> 14180 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 14185 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 14193 INFO  (zkConnectionManagerCallback-54-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14194 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 14195 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 14201 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 14202 INFO  (zkConnectionManagerCallback-56-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14203 INFO  (zkConnectionManagerCallback-58-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14203 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 14203 INFO  (zkConnectionManagerCallback-60-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14203 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 14217 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 14227 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 14227 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 14228 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 14445 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 14468 WARN  (jetty-launcher-52-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@66ddd44f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14468 WARN  (jetty-launcher-52-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@66ddd44f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14470 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 14482 WARN  (jetty-launcher-52-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@96c13ad[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14482 WARN  (jetty-launcher-52-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@96c13ad[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14507 WARN  (jetty-launcher-52-thread-3) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@4e542eff[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14507 WARN  (jetty-launcher-52-thread-3) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@4e542eff[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14508 INFO  (jetty-launcher-52-thread-3) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62401/solr
   [junit4]   2> 14520 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 14546 WARN  (jetty-launcher-52-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@588d91db[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14546 WARN  (jetty-launcher-52-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@588d91db[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14555 WARN  (jetty-launcher-52-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@41b24d85[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14556 WARN  (jetty-launcher-52-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@41b24d85[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14562 INFO  (jetty-launcher-52-thread-1) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62401/solr
   [junit4]   2> 14574 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 14577 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 14603 INFO  (zkConnectionManagerCallback-86-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14603 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 14606 INFO  (zkConnectionManagerCallback-89-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14607 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 14616 WARN  (jetty-launcher-52-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@22dcff8d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14616 WARN  (jetty-launcher-52-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@22dcff8d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14622 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 14622 INFO  (jetty-launcher-52-thread-2) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62401/solr
   [junit4]   2> 14637 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 14638 WARN  (jetty-launcher-52-thread-4) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@5861a1c6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14638 WARN  (jetty-launcher-52-thread-4) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@5861a1c6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14644 INFO  (zkConnectionManagerCallback-99-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14645 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 14655 WARN  (jetty-launcher-52-thread-4) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@61fd0cb5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14655 WARN  (jetty-launcher-52-thread-4) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@61fd0cb5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 14663 INFO  (jetty-launcher-52-thread-4) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62401/solr
   [junit4]   2> 14677 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 14701 INFO  (zkConnectionManagerCallback-104-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 14702 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 17466 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:62418_solr
   [junit4]   2> 17512 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.Overseer Overseer 
(id=72132489871032329-127.0.0.1:62418_solr-n_0000000000) starting
   [junit4]   2> 18139 INFO  
(OverseerStateUpdate-72132489871032329-127.0.0.1:62418_solr-n_0000000000) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:62418_solr
   [junit4]   2> 18253 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:62418_solr
   [junit4]   2> 18311 INFO  (zkCallback-98-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 18332 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 18371 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 18398 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 18406 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 18462 WARN  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 18493 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:62419_solr as DOWN
   [junit4]   2> 18507 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:62420_solr as DOWN
   [junit4]   2> 18515 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 1000 transient cores
   [junit4]   2> 18516 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:62419_solr
   [junit4]   2> 18517 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:62417_solr as DOWN
   [junit4]   2> 18522 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 1000 transient cores
   [junit4]   2> 18523 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:62420_solr
   [junit4]   2> 18557 INFO  (zkCallback-98-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 18557 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 18557 INFO  (zkCallback-88-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 18562 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 1000 transient cores
   [junit4]   2> 18562 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:62417_solr
   [junit4]   2> 18563 INFO  (zkCallback-103-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 18565 INFO  (zkCallback-98-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 18568 INFO  (zkCallback-88-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 18569 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 18570 INFO  (zkCallback-103-thread-2) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 18575 INFO  (zkCallback-98-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 18579 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 18580 INFO  (zkCallback-88-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 18584 INFO  (zkCallback-103-thread-2) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 18593 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 18593 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 18593 WARN  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 18598 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 18599 WARN  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 18611 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 18612 WARN  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.CoreContainer Not all security plugins 
configured!  authentication=disabled authorization=disabled.  Solr is only as 
secure as you make it. Consider configuring authentication/authorization before 
exposing Solr to users internal or external.  See 
https://s.apache.org/solrsecurity for more info
   [junit4]   2> 18627 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 18664 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 18688 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 18836 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62418.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 18837 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62418.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 18837 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62418.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 18839 INFO  (jetty-launcher-52-thread-2) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node2
   [junit4]   2> 19664 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62419.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 19719 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62420.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 19922 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62417.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 19961 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62420.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 19962 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62420.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 19999 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62419.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 19999 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62419.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 20004 INFO  (jetty-launcher-52-thread-1) 
[n:127.0.0.1:62420_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node1
   [junit4]   2> 20041 INFO  (jetty-launcher-52-thread-3) 
[n:127.0.0.1:62419_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node3
   [junit4]   2> 20049 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62417.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 20071 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_62417.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 20077 INFO  (jetty-launcher-52-thread-4) 
[n:127.0.0.1:62417_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node4
   [junit4]   2> 20136 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=4
   [junit4]   2> 20138 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 20147 INFO  (zkConnectionManagerCallback-145-thread-1) [     ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 20147 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 20158 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 20161 INFO  
(SUITE-TestSolrCloudSnapshots-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62401/solr ready
   [junit4]   2> 20443 INFO  
(TEST-TestSolrCloudSnapshots.testSnapshots-seed#[EC4B4A0E150CF02F]) [     ] 
o.a.s.SolrTestCaseJ4 ###Starting testSnapshots
   [junit4]   2> 20791 INFO  (qtp1691166625-109) [n:127.0.0.1:62419_solr     ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf1&name=SolrCloudSnapshots&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 20832 INFO  
(OverseerThreadFactory-117-thread-1-processing-n:127.0.0.1:62418_solr) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
SolrCloudSnapshots
   [junit4]   2> 21013 INFO  (qtp1691166625-111) [n:127.0.0.1:62419_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=12
   [junit4]   2> 21079 INFO  (qtp1387072284-113) [n:127.0.0.1:62420_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=2
   [junit4]   2> 21087 INFO  (qtp1952853760-93) [n:127.0.0.1:62417_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=2
   [junit4]   2> 21100 INFO  (qtp1739741767-99) [n:127.0.0.1:62418_solr     ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 
transient cores
   [junit4]   2> 21101 INFO  (qtp1739741767-99) [n:127.0.0.1:62418_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node}
 status=0 QTime=1
   [junit4]   2> 21230 INFO  
(OverseerStateUpdate-72132489871032329-127.0.0.1:62418_solr-n_0000000000) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SolrCloudSnapshots",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SolrCloudSnapshots_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:62418/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:62418_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 21268 INFO  
(OverseerStateUpdate-72132489871032329-127.0.0.1:62418_solr-n_0000000000) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SolrCloudSnapshots",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SolrCloudSnapshots_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:62417/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:62417_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 21323 INFO  
(OverseerStateUpdate-72132489871032329-127.0.0.1:62418_solr-n_0000000000) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SolrCloudSnapshots",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SolrCloudSnapshots_shard2_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:62420/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:62420_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 21372 INFO  
(OverseerStateUpdate-72132489871032329-127.0.0.1:62418_solr-n_0000000000) 
[n:127.0.0.1:62418_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SolrCloudSnapshots",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SolrCloudSnapshots_shard2_replica_n7",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:62419/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:62419_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 21624 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr    
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n3&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 21625 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr    
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n1&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 21631 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr    
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n7&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 21634 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr    
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n5&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 21727 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 9.0.0
   [junit4]   2> 21727 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 9.0.0
   [junit4]   2> 21728 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 9.0.0
   [junit4]   2> 21751 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 9.0.0
   [junit4]   2> 21831 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 21831 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 21833 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 21862 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 21863 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.CoreContainer Creating 
SolrCore 'SolrCloudSnapshots_shard2_replica_n7' using configuration from 
configset conf1, trusted=true
   [junit4]   2> 21896 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_62419.solr.core.SolrCloudSnapshots.shard2.replica_n7' 
(registry 'solr.core.SolrCloudSnapshots.shard2.replica_n7') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 21898 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 21898 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.CoreContainer Creating 
SolrCore 'SolrCloudSnapshots_shard2_replica_n5' using configuration from 
configset conf1, trusted=true
   [junit4]   2> 21902 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.SolrCore 
[[SolrCloudSnapshots_shard2_replica_n7] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node3/SolrCloudSnapshots_shard2_replica_n7],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node3/SolrCloudSnapshots_shard2_replica_n7/data/]
   [junit4]   2> 21922 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 21923 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.CoreContainer Creating 
SolrCore 'SolrCloudSnapshots_shard1_replica_n3' using configuration from 
configset conf1, trusted=true
   [junit4]   2> 21929 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_62420.solr.core.SolrCloudSnapshots.shard2.replica_n5' 
(registry 'solr.core.SolrCloudSnapshots.shard2.replica_n5') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 21930 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.SolrCore 
[[SolrCloudSnapshots_shard2_replica_n5] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node1/SolrCloudSnapshots_shard2_replica_n5],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node1/SolrCloudSnapshots_shard2_replica_n5/data/]
   [junit4]   2> 21933 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_62417.solr.core.SolrCloudSnapshots.shard1.replica_n3' 
(registry 'solr.core.SolrCloudSnapshots.shard1.replica_n3') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 21938 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 21946 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.SolrCore 
[[SolrCloudSnapshots_shard1_replica_n3] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node4/SolrCloudSnapshots_shard1_replica_n3],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node4/SolrCloudSnapshots_shard1_replica_n3/data/]
   [junit4]   2> 21966 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 21967 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating 
SolrCore 'SolrCloudSnapshots_shard1_replica_n1' using configuration from 
configset conf1, trusted=true
   [junit4]   2> 21968 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_62418.solr.core.SolrCloudSnapshots.shard1.replica_n1' 
(registry 'solr.core.SolrCloudSnapshots.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5ea02f31
   [junit4]   2> 21968 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.SolrCore 
[[SolrCloudSnapshots_shard1_replica_n1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node2/SolrCloudSnapshots_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_EC4B4A0E150CF02F-001/tempDir-001/node2/SolrCloudSnapshots_shard1_replica_n1/data/]
   [junit4]   2> 22350 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.UpdateHandler Using UpdateLog 
implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 22354 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 22480 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.UpdateHandler Using UpdateLog 
implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 22480 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 22503 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.CommitTracker Hard AutoCommit: 
disabled
   [junit4]   2> 22506 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.CommitTracker Soft AutoCommit: 
disabled
   [junit4]   2> 22520 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.CommitTracker Hard AutoCommit: 
disabled
   [junit4]   2> 22520 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.CommitTracker Soft AutoCommit: 
disabled
   [junit4]   2> 22676 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog 
implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 22676 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 22679 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: 
disabled
   [junit4]   2> 22679 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: 
disabled
   [junit4]   2> 22690 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.UpdateHandler Using UpdateLog 
implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 22690 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 22693 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 22697 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.r.ManagedResourceStorage Loaded 
null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 22697 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.h.ReplicationHandler Commits 
will be reserved for 10000 ms
   [junit4]   2> 22698 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.CommitTracker Hard AutoCommit: 
disabled
   [junit4]   2> 22699 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 22703 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.CommitTracker Soft AutoCommit: 
disabled
   [junit4]   2> 22703 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 22704 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.r.ManagedResourceStorage Loaded 
null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 22706 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.h.ReplicationHandler Commits 
will be reserved for 10000 ms
   [junit4]   2> 22707 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.UpdateLog Could not find max 
version in index or recent updates, using new clock 1669946071788290048
   [junit4]   2> 22708 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.UpdateLog Could not find max 
version in index or recent updates, using new clock 1669946071789338624
   [junit4]   2> 22713 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded 
null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 22715 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits 
will be reserved for 10000 ms
   [junit4]   2> 22715 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max 
version in index or recent updates, using new clock 1669946071796678656
   [junit4]   2> 22727 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 22731 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.r.ManagedResourceStorage Loaded 
null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 22735 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.h.ReplicationHandler Commits 
will be reserved for 10000 ms
   [junit4]   2> 22741 INFO  
(searcherExecutor-147-thread-1-processing-n:127.0.0.1:62419_solr 
x:SolrCloudSnapshots_shard2_replica_n7 c:SolrCloudSnapshots s:shard2 
r:core_node8) [n:127.0.0.1:62419_solr c:SolrCloudSnapshots s:shard2 
r:core_node8 x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard2_replica_n7]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 22744 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.UpdateLog Could not find max 
version in index or recent updates, using new clock 1669946071827087360
   [junit4]   2> 22748 INFO  
(searcherExecutor-153-thread-1-processing-n:127.0.0.1:62418_solr 
x:SolrCloudSnapshots_shard1_replica_n1 c:SolrCloudSnapshots s:shard1 
r:core_node2) [n:127.0.0.1:62418_solr c:SolrCloudSnapshots s:shard1 
r:core_node2 x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard1_replica_n1]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 22749 INFO  
(searcherExecutor-151-thread-1-processing-n:127.0.0.1:62417_solr 
x:SolrCloudSnapshots_shard1_replica_n3 c:SolrCloudSnapshots s:shard1 
r:core_node4) [n:127.0.0.1:62417_solr c:SolrCloudSnapshots s:shard1 
r:core_node4 x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard1_replica_n3]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 22759 INFO  
(searcherExecutor-149-thread-1-processing-n:127.0.0.1:62420_solr 
x:SolrCloudSnapshots_shard2_replica_n5 c:SolrCloudSnapshots s:shard2 
r:core_node6) [n:127.0.0.1:62420_solr c:SolrCloudSnapshots s:shard2 
r:core_node6 x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard2_replica_n5]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 22785 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save 
terms, version is not a match, retrying
   [junit4]   2> 22785 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ZkShardTerms Successful update 
of terms at /collections/SolrCloudSnapshots/terms/shard1 to 
Terms{values={core_node4=0}, version=0}
   [junit4]   2> 22791 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ZkShardTerms Successful update 
of terms at /collections/SolrCloudSnapshots/terms/shard2 to 
Terms{values={core_node8=0}, version=0}
   [junit4]   2> 22792 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update 
of terms at /collections/SolrCloudSnapshots/terms/shard1 to 
Terms{values={core_node2=0, core_node4=0}, version=1}
   [junit4]   2> 22794 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.ZkShardTerms Failed to save 
terms, version is not a match, retrying
   [junit4]   2> 22816 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.ZkShardTerms Successful update 
of terms at /collections/SolrCloudSnapshots/terms/shard2 to 
Terms{values={core_node6=0, core_node8=0}, version=1}
   [junit4]   2> 22819 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContextBase 
make sure parent is created /collections/SolrCloudSnapshots/leaders/shard1
   [junit4]   2> 22820 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ShardLeaderElectionContextBase 
make sure parent is created /collections/SolrCloudSnapshots/leaders/shard2
   [junit4]   2> 22821 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase 
make sure parent is created /collections/SolrCloudSnapshots/leaders/shard1
   [junit4]   2> 22821 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.ShardLeaderElectionContextBase 
make sure parent is created /collections/SolrCloudSnapshots/leaders/shard2
   [junit4]   2> 22871 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ShardLeaderElectionContext 
Enough replicas found to continue.
   [junit4]   2> 22871 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ShardLeaderElectionContext I 
may be the new leader - try and sync
   [junit4]   2> 22871 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:62419/solr/SolrCloudSnapshots_shard2_replica_n7/
   [junit4]   2> 22872 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContext 
Enough replicas found to continue.
   [junit4]   2> 22872 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContext I 
may be the new leader - try and sync
   [junit4]   2> 22872 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/
   [junit4]   2> 22883 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.PeerSync PeerSync: 
core=SolrCloudSnapshots_shard1_replica_n3 url=http://127.0.0.1:62417/solr  
START 
replicas=[http://127.0.0.1:62418/solr/SolrCloudSnapshots_shard1_replica_n1/] 
nUpdates=100
   [junit4]   2> 22883 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.PeerSync PeerSync: 
core=SolrCloudSnapshots_shard2_replica_n7 url=http://127.0.0.1:62419/solr  
START 
replicas=[http://127.0.0.1:62420/solr/SolrCloudSnapshots_shard2_replica_n5/] 
nUpdates=100
   [junit4]   2> 22884 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.PeerSync PeerSync: 
core=SolrCloudSnapshots_shard1_replica_n3 url=http://127.0.0.1:62417/solr  
DONE. We have no versions. sync failed.
   [junit4]   2> 22887 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.PeerSync PeerSync: 
core=SolrCloudSnapshots_shard2_replica_n7 url=http://127.0.0.1:62419/solr  
DONE. We have no versions. sync failed.
   [junit4]   2> 22889 INFO  (qtp1739741767-98) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.S.Request 
[SolrCloudSnapshots_shard1_replica_n1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=2
   [junit4]   2> 22890 INFO  (qtp1387072284-112) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.S.Request 
[SolrCloudSnapshots_shard2_replica_n5]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 22897 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.SyncStrategy Leader's attempt 
to sync with shard failed, moving to the next candidate
   [junit4]   2> 22897 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContext We 
failed sync, but we have no versions - we can't sync in that case - we were 
active before, so become leader anyway
   [junit4]   2> 22899 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.SyncStrategy Leader's attempt 
to sync with shard failed, moving to the next candidate
   [junit4]   2> 22899 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ShardLeaderElectionContext We 
failed sync, but we have no versions - we can't sync in that case - we were 
active before, so become leader anyway
   [junit4]   2> 22901 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContextBase 
Creating leader registration node 
/collections/SolrCloudSnapshots/leaders/shard1/leader after winning as 
/collections/SolrCloudSnapshots/leader_elect/shard1/election/72132489871032330-core_node4-n_0000000000
   [junit4]   2> 22901 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ShardLeaderElectionContextBase 
Creating leader registration node 
/collections/SolrCloudSnapshots/leaders/shard2/leader after winning as 
/collections/SolrCloudSnapshots/leader_elect/shard2/election/72132489871032327-core_node8-n_0000000000
   [junit4]   2> 22927 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ShardLeaderElectionContext I 
am the new leader: 
http://127.0.0.1:62419/solr/SolrCloudSnapshots_shard2_replica_n7/ shard2
   [junit4]   2> 22928 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContext I 
am the new leader: 
http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/ shard1
   [junit4]   2> 23052 INFO  (zkCallback-103-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23052 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23052 INFO  (zkCallback-103-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23052 INFO  (zkCallback-85-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23079 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ZkController I am the leader, 
no recovery necessary
   [junit4]   2> 23081 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ZkController I am the leader, 
no recovery necessary
   [junit4]   2> 23133 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n7&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1502
   [junit4]   2> 23146 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n3&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1522
   [junit4]   2> 23216 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23216 INFO  (zkCallback-85-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23216 INFO  (zkCallback-85-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23218 INFO  (zkCallback-103-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23218 INFO  (zkCallback-103-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23218 INFO  (zkCallback-103-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 23964 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n5&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2330
   [junit4]   2> 23982 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n1&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2359
   [junit4]   2> 23996 INFO  (qtp1691166625-109) [n:127.0.0.1:62419_solr     ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
45 seconds. Check all shard replicas
   [junit4]   2> 24092 INFO  (zkCallback-103-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-103-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-88-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-98-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-85-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-98-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-85-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24092 INFO  (zkCallback-85-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24093 INFO  (zkCallback-103-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24093 INFO  (zkCallback-88-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/SolrCloudSnapshots/state.json] for collection 
[SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 24094 INFO  (qtp1691166625-109) [n:127.0.0.1:62419_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={collection.configName=conf1&name=SolrCloudSnapshots&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=3311
   [junit4]   2> 24096 INFO  
(TEST-TestSolrCloudSnapshots.testSnapshots-seed#[EC4B4A0E150CF02F]) [     ] 
o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: SolrCloudSnapshots
   [junit4]   2> 24458 INFO  (qtp1387072284-112) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard2_replica_n5]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&_version_=-1669946073556189184&distrib.from=http://127.0.0.1:62419/solr/SolrCloudSnapshots_shard2_replica_n7/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1669946073556189184)} 0 38
   [junit4]   2> 24488 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.ZkShardTerms Successful update 
of terms at /collections/SolrCloudSnapshots/terms/shard2 to 
Terms{values={core_node6=1, core_node8=1}, version=2}
   [junit4]   2> 24488 INFO  (qtp1691166625-108) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard2_replica_n7]  webapp=/solr path=/update 
params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1669946073556189184)} 0 98
   [junit4]   2> 24616 INFO  (qtp1739741767-98) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard1_replica_n1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&_version_=-1669946073286705152&distrib.from=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1669946073286705152)} 0 55
   [junit4]   2> 24635 INFO  (qtp1952853760-92) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.ZkShardTerms Successful update 
of terms at /collections/SolrCloudSnapshots/terms/shard1 to 
Terms{values={core_node2=1, core_node4=1}, version=2}
   [junit4]   2> 24636 INFO  (qtp1952853760-92) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard1_replica_n3]  webapp=/solr path=/update 
params={wt=javabin&version=2}{deleteByQuery=*:* (-1669946073286705152)} 0 519
   [junit4]   2> 24642 INFO  
(TEST-TestSolrCloudSnapshots.testSnapshots-seed#[EC4B4A0E150CF02F]) [     ] 
o.a.s.h.BackupRestoreUtils Indexing 49 test docs
   [junit4]   2> 24773 INFO  (qtp1387072284-114) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard2_replica_n5]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:62419/solr/SolrCloudSnapshots_shard2_replica_n7/&wt=javabin&version=2}{add=[2
 (1669946073862373376), 3 (1669946073885442048), 5 (1669946073895927808), 6 
(1669946073899073536), 7 (1669946073903267840), 9 (1669946073910607872), 17 
(1669946073911656448), 18 (1669946073911656449), 19 (1669946073912705024), 21 
(1669946073912705025), ... (20 adds)]} 0 64
   [junit4]   2> 24786 INFO  (qtp1739741767-100) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard1_replica_n1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/&wt=javabin&version=2}{add=[0
 (1669946073856081920), 1 (1669946073881247744), 4 (1669946073885442048), 8 
(1669946073895927808), 10 (1669946073899073536), 11 (1669946073910607872), 12 
(1669946073911656448), 13 (1669946073911656449), 14 (1669946073912705024), 15 
(1669946073912705025), ... (29 adds)]} 0 81
   [junit4]   2> 24791 INFO  (qtp1691166625-109) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard2_replica_n7]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[2 (1669946073862373376), 3 
(1669946073885442048), 5 (1669946073895927808), 6 (1669946073899073536), 7 
(1669946073903267840), 9 (1669946073910607872), 17 (1669946073911656448), 18 
(1669946073911656449), 19 (1669946073912705024), 21 (1669946073912705025), ... 
(20 adds)]} 0 133
   [junit4]   2> 24806 INFO  (qtp1952853760-93) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard1_replica_n3]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[0 (1669946073856081920), 1 
(1669946073881247744), 4 (1669946073885442048), 8 (1669946073895927808), 10 
(1669946073899073536), 11 (1669946073910607872), 12 (1669946073911656448), 13 
(1669946073911656449), 14 (1669946073912705024), 15 (1669946073912705025), ... 
(29 adds)]} 0 140
   [junit4]   2> 24851 INFO  
(OverseerCollectionConfigSetProcessor-72132489871032329-127.0.0.1:62418_solr-n_0000000000)
 [n:127.0.0.1:62418_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 25158 INFO  
(searcherExecutor-149-thread-1-processing-n:127.0.0.1:62420_solr 
x:SolrCloudSnapshots_shard2_replica_n5 c:SolrCloudSnapshots s:shard2 
r:core_node6) [n:127.0.0.1:62420_solr c:SolrCloudSnapshots s:shard2 
r:core_node6 x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard2_replica_n5]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 25161 INFO  (qtp1387072284-113) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard2_replica_n5]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62419/solr/SolrCloudSnapshots_shard2_replica_n7/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 326
   [junit4]   2> 25243 INFO  
(searcherExecutor-147-thread-1-processing-n:127.0.0.1:62419_solr 
x:SolrCloudSnapshots_shard2_replica_n7 c:SolrCloudSnapshots s:shard2 
r:core_node8) [n:127.0.0.1:62419_solr c:SolrCloudSnapshots s:shard2 
r:core_node8 x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard2_replica_n7]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 25249 INFO  (qtp1691166625-110) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard2_replica_n7]  webapp=/solr path=/update 
params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 420
   [junit4]   2> 25568 INFO  
(searcherExecutor-151-thread-1-processing-n:127.0.0.1:62417_solr 
x:SolrCloudSnapshots_shard1_replica_n3 c:SolrCloudSnapshots s:shard1 
r:core_node4) [n:127.0.0.1:62417_solr c:SolrCloudSnapshots s:shard1 
r:core_node4 x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard1_replica_n3]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 25613 INFO  
(searcherExecutor-153-thread-1-processing-n:127.0.0.1:62418_solr 
x:SolrCloudSnapshots_shard1_replica_n1 c:SolrCloudSnapshots s:shard1 
r:core_node2) [n:127.0.0.1:62418_solr c:SolrCloudSnapshots s:shard1 
r:core_node2 x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.c.SolrCore 
[SolrCloudSnapshots_shard1_replica_n1]  Registered new searcher autowarm time: 
0 ms
   [junit4]   2> 25618 INFO  (qtp1739741767-99) [n:127.0.0.1:62418_solr 
c:SolrCloudSnapshots s:shard1 r:core_node2 
x:SolrCloudSnapshots_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard1_replica_n1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 354
   [junit4]   2> 25628 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.u.p.LogUpdateProcessorFactory 
[SolrCloudSnapshots_shard1_replica_n3]  webapp=/solr path=/update 
params={_stateVer_=SolrCloudSnapshots:5&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 811
   [junit4]   2> 25700 INFO  (qtp1952853760-93) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.S.Request 
[SolrCloudSnapshots_shard1_replica_n3]  webapp=/solr path=/select 
params={df=text&distrib=false&_stateVer_=SolrCloudSnapshots:5&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/|http://127.0.0.1:62418/solr/SolrCloudSnapshots_shard1_replica_n1/&rows=10&version=2&q=*:*&omitHeader=false&NOW=1592584681373&isShard=true&wt=javabin}
 hits=29 status=0 QTime=1
   [junit4]   2> 25700 INFO  (qtp1691166625-109) [n:127.0.0.1:62419_solr 
c:SolrCloudSnapshots s:shard2 r:core_node8 
x:SolrCloudSnapshots_shard2_replica_n7 ] o.a.s.c.S.Request 
[SolrCloudSnapshots_shard2_replica_n7]  webapp=/solr path=/select 
params={df=text&distrib=false&_stateVer_=SolrCloudSnapshots:5&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=http://127.0.0.1:62419/solr/SolrCloudSnapshots_shard2_replica_n7/|http://127.0.0.1:62420/solr/SolrCloudSnapshots_shard2_replica_n5/&rows=10&version=2&q=*:*&omitHeader=false&NOW=1592584681373&isShard=true&wt=javabin}
 hits=20 status=0 QTime=17
   [junit4]   2> 25779 INFO  (qtp1952853760-103) [n:127.0.0.1:62417_solr 
c:SolrCloudSnapshots s:shard1 r:core_node4 
x:SolrCloudSnapshots_shard1_replica_n3 ] o.a.s.c.S.Request 
[SolrCloudSnapshots_shard1_replica_n3]  webapp=/solr path=/select 
params={q=*:*&df=text&distrib=false&_stateVer_=SolrCloudSnapshots:5&omitHeader=false&shards.purpose=64&NOW=1592584681373&ids=11,0,12,1,13,14,15,4,8,10&isShard=true&shard.url=http://127.0.0.1:62417/solr/SolrCloudSnapshots_shard1_replica_n3/|http://127.0.0.1:62418/solr/SolrCloudSnapshots_shard1_replica_n1/&wt=javabin&version=2}
 status=0 QTime=16
   [junit4]   2> 25801 INFO  (qtp1387072284-112) [n:127.0.0.1:62420_solr 
c:SolrCloudSnapshots s:shard2 r:core_node6 
x:SolrCloudSnapshots_shard2_replica_n5 ] o.a.s.c.S.Request 
[SolrCloudSnapshots_shard2_replica_n5]  webapp=/solr path=/select 
params={q=*:*&_stateVer_=SolrCloudSnapshots:5&wt=javabin&version=2} hits=49 
status=0 QTime=169
   [junit4]   2> 25807 INFO  (qtp1691166625-110) [n:127.0.0.1:62419_solr     ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :collectionprop with 
params 
propertyName=test.property&name=SolrCloudSnapshots&action=COLLECTIONPROP&propertyValue=test.value&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 25811 INFO  (qtp1691166625-110) [n:127.0.0.1:62419_solr     ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={propertyName=test.property&name=SolrCloudSnapshots&action=COLLECTIONPROP&propertyValue=test.value&wt=javabin&version=2}
 status=0 QTime=4
   [junit4]   2> 25811 INFO  (zkCallback-103-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A collection property change: [WatchedEvent 
state:SyncConnected type:NodeCreated 
path:/collections/SolrCloudSnapshots/collectionprops.json] for collection 
[SolrCloudSnapshots] has occurred - updating...
   [junit4]   2> 25811 INFO  (zkCallback-98-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A collection property change: [WatchedEvent 
state:SyncConnected type:NodeCreated 
path:/collections/SolrCloudSnapshots/collectionprops.json] for collection 
[SolrCloudSnapshots] has occurred - updating...
   [junit4]   2> 25812 INFO  (zkCallback-85-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A collection property change: [WatchedEvent 
state:SyncConnected type:NodeCreated 
path:/collections/SolrCloudSnapshots/collectionprops.json] for collection 
[SolrCloudSnapshots] has occurred - updating...
   [junit4]   2> 25812 INFO  (zkCallback-88-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A collection property change: [WatchedEvent 
state:SyncConnected type:NodeCreated 
path:/collections/SolrCloudSnapshots/collectionprops.json] for collection 
[SolrCloudSnapshots] has occurred - updating...
   [junit4]   2> 25813 INFO  
(TEST-TestSolrCloudSnapshots.testSnapshots-seed#[EC4B4A0E150CF02F]) [     

[...truncated too long message...]

istry@7133dd33
   [junit4]   2> 67089 INFO  (jetty-closer-301-thread-4) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 67093 INFO  (closeThreadPool-325-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72132490477895690-127.0.0.1:62497_solr-n_0000000000) closing
   [junit4]   2> 67094 INFO  
(OverseerStateUpdate-72132490477895690-127.0.0.1:62497_solr-n_0000000000) 
[n:127.0.0.1:62497_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:62497_solr
   [junit4]   2> 67095 INFO  
(OverseerAutoScalingTriggerThread-72132490477895690-127.0.0.1:62497_solr-n_0000000000)
 [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 67100 INFO  (closeThreadPool-325-thread-2) [     ] 
o.a.s.c.Overseer Overseer 
(id=72132490477895690-127.0.0.1:62497_solr-n_0000000000) closing
   [junit4]   2> 67211 INFO  (jetty-closer-301-thread-3) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@10c17d10{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 67211 INFO  (jetty-closer-301-thread-3) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@42bedddc{/solr,null,UNAVAILABLE}
   [junit4]   2> 67211 INFO  (jetty-closer-301-thread-3) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 67310 INFO  (jetty-closer-301-thread-2) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@52f816e7{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 67310 INFO  (jetty-closer-301-thread-2) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7350f79e{/solr,null,UNAVAILABLE}
   [junit4]   2> 67310 INFO  (jetty-closer-301-thread-2) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 67411 INFO  (jetty-closer-301-thread-4) [     ] 
o.a.s.c.Overseer Overseer 
(id=72132490477895690-127.0.0.1:62497_solr-n_0000000000) closing
   [junit4]   2> 67414 INFO  (jetty-closer-301-thread-4) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@1326b9bd{HTTP/1.1, (http/1.1, 
h2c)}{127.0.0.1:0}
   [junit4]   2> 67415 INFO  (jetty-closer-301-thread-4) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2f3df32a{/solr,null,UNAVAILABLE}
   [junit4]   2> 67415 INFO  (jetty-closer-301-thread-4) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 67417 INFO  
(SUITE-AssignBackwardCompatibilityTest-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 67629 WARN  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        100     /solr/collections/collection1/terms/shard1
   [junit4]   2>        16      
/solr/configs/collection1.AUTOCREATED/managed-schema
   [junit4]   2>        6       /solr/configs/collection1.AUTOCREATED
   [junit4]   2>        5       /solr/aliases.json
   [junit4]   2>        5       /solr/clusterprops.json
   [junit4]   2>        4       /solr/packages.json
   [junit4]   2>        4       
/solr/collections/collection1/collectionprops.json
   [junit4]   2>        4       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        637     /solr/collections/collection1/state.json
   [junit4]   2>        5       
/solr/collections/collection1/leader_elect/shard1/election/72132490477895688-core_node10-n_0000000004
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard1/election/72132490477895687-core_node8-n_0000000001
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72132490477895689-core_node7-n_0000000002
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72132490477895688-core_node13-n_0000000009
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72132490477895688-core_node19-n_0000000012
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72132490477895690-core_node5-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        138     /solr/overseer/queue
   [junit4]   2>        72      /solr/overseer/collection-queue-work
   [junit4]   2>        20      /solr/live_nodes
   [junit4]   2>        10      /solr/collections
   [junit4]   2> 
   [junit4]   2> 67649 INFO  
(SUITE-AssignBackwardCompatibilityTest-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:62472
   [junit4]   2> 67649 INFO  
(SUITE-AssignBackwardCompatibilityTest-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:62472
   [junit4]   2> 67649 INFO  
(SUITE-AssignBackwardCompatibilityTest-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 62472
   [junit4]   2> 67650 INFO  
(SUITE-AssignBackwardCompatibilityTest-seed#[EC4B4A0E150CF02F]-worker) [     ] 
o.a.s.SolrTestCaseJ4 ------------------------------------------------------- 
Done waiting for tracked resources to be released
   [junit4]   2> Jun 19, 2020 4:38:43 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> Jun 19, 2020 4:38:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.AssignBackwardCompatibilityTest: 
   [junit4]   2>    1) Thread[id=98, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-AssignBackwardCompatibilityTest]
   [junit4]   2>         at [email protected]/java.lang.Thread.sleep(Native 
Method)
   [junit4]   2>         at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]   2> Jun 19, 2020 4:38:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=98, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-AssignBackwardCompatibilityTest]
   [junit4]   2> 77727 ERROR (SessionTracker) [     ] 
o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : 
SessionTracker
   [junit4]   2>           => java.lang.InterruptedException: sleep interrupted
   [junit4]   2>        at java.base/java.lang.Thread.sleep(Native Method)
   [junit4]   2> java.lang.InterruptedException: sleep interrupted
   [junit4]   2>        at java.lang.Thread.sleep(Native Method) [?:?]
   [junit4]   2>        at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) 
~[zookeeper-3.5.7.jar:3.5.7]
   [junit4]   2> Jun 19, 2020 4:38:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene86): {}, 
docValues:{}, maxPointsInLeafNode=1042, maxMBSortInHeap=7.01112576691099, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@166c36b8),
 locale=tr, timezone=Canada/Mountain
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 
(64-bit)/cpus=6,threads=1,free=46428040,total=229064704
   [junit4]   2> NOTE: All tests run in this JVM: [IndexSchemaTest, TaggerTest, 
TestXIncludeConfig, AtomicUpdateProcessorFactoryTest, 
DistributedUpdateProcessorTest, AssignBackwardCompatibilityTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=AssignBackwardCompatibilityTest -Dtests.seed=EC4B4A0E150CF02F 
-Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=Canada/Mountain 
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | AssignBackwardCompatibilityTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.AssignBackwardCompatibilityTest: 
   [junit4]    >    1) Thread[id=98, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-AssignBackwardCompatibilityTest]
   [junit4]    >         at [email protected]/java.lang.Thread.sleep(Native 
Method)
   [junit4]    >         at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([EC4B4A0E150CF02F]:0)
   [junit4] Completed [24/910 (2!)] on J0 in 55.78s, 1 test, 1 error <<< 
FAILURES!

[...truncated 55110 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6185/consoleText

[repro] Revision: 972c84022ec9c2b867848cb11f6d4c6bc466e8f2

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line:  ant test  -Dtestcase=TestSolrCloudSnapshots 
-Dtests.seed=EC4B4A0E150CF02F -Dtests.slow=true -Dtests.locale=en-JE 
-Dtests.timezone=Australia/Currie -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

[repro] Repro line:  ant test  -Dtestcase=AssignBackwardCompatibilityTest 
-Dtests.seed=EC4B4A0E150CF02F -Dtests.slow=true -Dtests.locale=tr 
-Dtests.timezone=Canada/Mountain -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       AssignBackwardCompatibilityTest
[repro]       TestSolrCloudSnapshots
[repro] ant compile-test

[...truncated 2471 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 
-Dtests.class="*.AssignBackwardCompatibilityTest|*.TestSolrCloudSnapshots" 
-Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" 
-Dtests.seed=EC4B4A0E150CF02F -Dtests.slow=true -Dtests.locale=tr 
-Dtests.timezone=Canada/Mountain -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

[...truncated 101 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.AssignBackwardCompatibilityTest
[repro]   0/5 failed: org.apache.solr.core.snapshots.TestSolrCloudSnapshots
[repro] Exiting with code 0

[...truncated 73 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to