Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/731/

1 tests failed.
FAILED:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
expected:<3> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<3> but was:<2>
        at 
__randomizedtesting.SeedInfo.seed([B62CBD36366C7450:FE59C982305F5BC5]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:522)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11902 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/init-core-data-001
   [junit4]   2> 943835 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 943836 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 943836 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001
   [junit4]   2> 943837 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 943838 INFO  (Thread-2280) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 943838 INFO  (Thread-2280) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 943938 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:34837
   [junit4]   2> 943965 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 943971 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 943971 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 943972 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 943977 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2839c73e{/solr,null,AVAILABLE}
   [junit4]   2> 943977 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@757db1ba{HTTP/1.1,[http/1.1]}{127.0.0.1:39810}
   [junit4]   2> 943977 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.e.j.s.Server Started @947158ms
   [junit4]   2> 943978 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39810}
   [junit4]   2> 943978 ERROR (jetty-launcher-1264-thread-3) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 943978 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 943978 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 943978 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 943978 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-17T23:37:51.710Z
   [junit4]   2> 944016 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@37ac9fd4{/solr,null,AVAILABLE}
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@33519cd8{HTTP/1.1,[http/1.1]}{127.0.0.1:41530}
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.e.j.s.Server Started @947197ms
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41530}
   [junit4]   2> 944017 ERROR (jetty-launcher-1264-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 944017 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-17T23:37:51.749Z
   [junit4]   2> 944045 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7f5a9d7e{/solr,null,AVAILABLE}
   [junit4]   2> 944045 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@63154f8f{HTTP/1.1,[http/1.1]}{127.0.0.1:52930}
   [junit4]   2> 944046 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.e.j.s.Server Started @947226ms
   [junit4]   2> 944046 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=52930}
   [junit4]   2> 944046 ERROR (jetty-launcher-1264-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 944046 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 944046 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 944046 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 944046 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-17T23:37:51.778Z
   [junit4]   2> 944057 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 944090 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 944092 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 944094 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@36e044ed{/solr,null,AVAILABLE}
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@a9307f2{HTTP/1.1,[http/1.1]}{127.0.0.1:38797}
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.e.j.s.Server Started @947275ms
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=38797}
   [junit4]   2> 944095 ERROR (jetty-launcher-1264-thread-4) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 944095 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-17T23:37:51.827Z
   [junit4]   2> 944106 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 944107 INFO  (jetty-launcher-1264-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34837/solr
   [junit4]   2> 944111 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 944112 INFO  (jetty-launcher-1264-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34837/solr
   [junit4]   2> 944114 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 944115 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 944126 INFO  (jetty-launcher-1264-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34837/solr
   [junit4]   2> 944129 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 944139 INFO  (jetty-launcher-1264-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34837/solr
   [junit4]   2> 944156 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a4e705ed30007, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 944156 INFO  (jetty-launcher-1264-thread-2) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 944164 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a4e705ed30009, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 944164 INFO  (jetty-launcher-1264-thread-2) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:41530_solr
   [junit4]   2> 944165 INFO  (jetty-launcher-1264-thread-2) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.Overseer Overseer 
(id=97476586476077066-127.0.0.1:41530_solr-n_0000000000) starting
   [junit4]   2> 944173 INFO  (jetty-launcher-1264-thread-3) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 944173 INFO  (jetty-launcher-1264-thread-3) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39810_solr
   [junit4]   2> 944196 INFO  (jetty-launcher-1264-thread-4) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 944197 INFO  (jetty-launcher-1264-thread-4) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 944198 INFO  (jetty-launcher-1264-thread-4) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38797_solr
   [junit4]   2> 944227 INFO  
(zkCallback-1276-thread-1-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 944227 INFO  
(zkCallback-1283-thread-1-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 944228 INFO  
(OverseerStateUpdate-97476586476077066-127.0.0.1:41530_solr-n_0000000000) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 944229 INFO  (jetty-launcher-1264-thread-2) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41530_solr
   [junit4]   2> 944233 INFO  (jetty-launcher-1264-thread-1) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 944236 INFO  (jetty-launcher-1264-thread-1) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 944237 INFO  (jetty-launcher-1264-thread-1) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:52930_solr
   [junit4]   2> 944241 INFO  
(zkCallback-1283-thread-2-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (4)
   [junit4]   2> 944251 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (4)
   [junit4]   2> 944304 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (4)
   [junit4]   2> 944318 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 944340 INFO  (jetty-launcher-1264-thread-3) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node3/.
   [junit4]   2> 944391 INFO  (jetty-launcher-1264-thread-1) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node1/.
   [junit4]   2> 944429 INFO  (jetty-launcher-1264-thread-2) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/.
   [junit4]   2> 944439 INFO  (jetty-launcher-1264-thread-4) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node4/.
   [junit4]   2> 945109 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 945110 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34837/solr ready
   [junit4]   2> 945135 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[B62CBD36366C7450])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testCoresAreDistributedAcrossNodes
   [junit4]   2> 945136 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[B62CBD36366C7450])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 945138 INFO  (qtp2069397454-8585) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&name=nodes_used_collection&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 945140 INFO  
(OverseerThreadFactory-3844-thread-1-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
nodes_used_collection
   [junit4]   2> 945259 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 945260 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 945262 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 945263 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 945368 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 945368 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 945368 INFO  
(zkCallback-1283-thread-3-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 945368 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946270 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 946278 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.s.IndexSchema [nodes_used_collection_shard1_replica1] Schema name=minimal
   [junit4]   2> 946278 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 946282 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 946284 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.s.IndexSchema [nodes_used_collection_shard1_replica2] Schema name=minimal
   [junit4]   2> 946285 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 946302 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 946303 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.s.IndexSchema [nodes_used_collection_shard2_replica2] Schema name=minimal
   [junit4]   2> 946305 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 946305 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.s.IndexSchema [nodes_used_collection_shard2_replica1] Schema name=minimal
   [junit4]   2> 946306 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 946308 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 946308 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'nodes_used_collection_shard1_replica2' 
using configuration from collection nodes_used_collection
   [junit4]   2> 946308 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.SolrCore [[nodes_used_collection_shard1_replica2] ] Opening new 
SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node1/nodes_used_collection_shard1_replica2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node1/./nodes_used_collection_shard1_replica2/data/]
   [junit4]   2> 946309 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'nodes_used_collection_shard2_replica1' 
using configuration from collection nodes_used_collection
   [junit4]   2> 946310 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'nodes_used_collection_shard2_replica2' 
using configuration from collection nodes_used_collection
   [junit4]   2> 946310 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.c.SolrCore [[nodes_used_collection_shard2_replica1] ] Opening new 
SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node4/nodes_used_collection_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node4/./nodes_used_collection_shard2_replica1/data/]
   [junit4]   2> 946310 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.SolrCore [[nodes_used_collection_shard2_replica2] ] Opening new 
SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/nodes_used_collection_shard2_replica2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/./nodes_used_collection_shard2_replica2/data/]
   [junit4]   2> 946311 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'nodes_used_collection_shard1_replica1' 
using configuration from collection nodes_used_collection
   [junit4]   2> 946311 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.c.SolrCore [[nodes_used_collection_shard1_replica1] ] Opening new 
SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node3/nodes_used_collection_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node3/./nodes_used_collection_shard1_replica1/data/]
   [junit4]   2> 946354 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 946355 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 946355 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 946355 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 946359 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@4226d16e[nodes_used_collection_shard1_replica2] main]
   [junit4]   2> 946359 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 946360 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 946360 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 946360 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1559625386260692992
   [junit4]   2> 946365 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 946368 INFO  
(searcherExecutor-3853-thread-1-processing-n:127.0.0.1:52930_solr 
x:nodes_used_collection_shard1_replica2 s:shard1 c:nodes_used_collection) 
[n:127.0.0.1:52930_solr c:nodes_used_collection s:shard1  
x:nodes_used_collection_shard1_replica2] o.a.s.c.SolrCore 
[nodes_used_collection_shard1_replica2] Registered new searcher 
Searcher@4226d16e[nodes_used_collection_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 946370 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 946370 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 946371 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 946371 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 946373 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2c9e66a2[nodes_used_collection_shard2_replica2] main]
   [junit4]   2> 946373 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 946373 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 946374 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 946374 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 946374 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 946374 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 946374 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 946374 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 946375 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@783a648a[nodes_used_collection_shard2_replica1] main]
   [junit4]   2> 946375 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 946375 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 946375 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@29635a86[nodes_used_collection_shard1_replica1] main]
   [junit4]   2> 946375 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 946376 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 946376 INFO  
(searcherExecutor-3854-thread-1-processing-n:127.0.0.1:38797_solr 
x:nodes_used_collection_shard2_replica1 s:shard2 c:nodes_used_collection) 
[n:127.0.0.1:38797_solr c:nodes_used_collection s:shard2  
x:nodes_used_collection_shard2_replica1] o.a.s.c.SolrCore 
[nodes_used_collection_shard2_replica1] Registered new searcher 
Searcher@783a648a[nodes_used_collection_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 946376 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1559625386277470208
   [junit4]   2> 946381 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 946381 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 946381 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1559625386282713088
   [junit4]   2> 946382 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 946382 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 946382 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 946382 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1559625386283761664
   [junit4]   2> 946383 INFO  
(searcherExecutor-3855-thread-1-processing-n:127.0.0.1:41530_solr 
x:nodes_used_collection_shard2_replica2 s:shard2 c:nodes_used_collection) 
[n:127.0.0.1:41530_solr c:nodes_used_collection s:shard2  
x:nodes_used_collection_shard2_replica2] o.a.s.c.SolrCore 
[nodes_used_collection_shard2_replica2] Registered new searcher 
Searcher@2c9e66a2[nodes_used_collection_shard2_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 946385 INFO  
(searcherExecutor-3856-thread-1-processing-n:127.0.0.1:39810_solr 
x:nodes_used_collection_shard1_replica1 s:shard1 c:nodes_used_collection) 
[n:127.0.0.1:39810_solr c:nodes_used_collection s:shard1  
x:nodes_used_collection_shard1_replica1] o.a.s.c.SolrCore 
[nodes_used_collection_shard1_replica1] Registered new searcher 
Searcher@29635a86[nodes_used_collection_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 946386 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 946386 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 946386 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:41530/solr/nodes_used_collection_shard2_replica2/
   [junit4]   2> 946386 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard2_replica2 
url=http://127.0.0.1:41530/solr START 
replicas=[http://127.0.0.1:38797/solr/nodes_used_collection_shard2_replica1/] 
nUpdates=100
   [junit4]   2> 946390 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard2_replica2 
url=http://127.0.0.1:41530/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 946391 INFO  (qtp106895719-8607) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2 r:core_node1 
x:nodes_used_collection_shard2_replica1] o.a.s.c.S.Request 
[nodes_used_collection_shard2_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 946398 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 946398 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 946400 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:41530/solr/nodes_used_collection_shard2_replica2/ shard2
   [junit4]   2> 946502 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946502 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946502 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946504 INFO  
(zkCallback-1283-thread-1-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946552 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 946553 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2}
 status=0 QTime=1290
   [junit4]   2> 946655 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946656 INFO  
(zkCallback-1283-thread-3-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946656 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946655 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946866 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 946866 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 946866 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:52930/solr/nodes_used_collection_shard1_replica2/
   [junit4]   2> 946866 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard1_replica2 
url=http://127.0.0.1:52930/solr START 
replicas=[http://127.0.0.1:39810/solr/nodes_used_collection_shard1_replica1/] 
nUpdates=100
   [junit4]   2> 946866 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard1_replica2 
url=http://127.0.0.1:52930/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 946868 INFO  (qtp663923531-8575) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1 r:core_node2 
x:nodes_used_collection_shard1_replica1] o.a.s.c.S.Request 
[nodes_used_collection_shard1_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 946868 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 946868 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 946875 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:52930/solr/nodes_used_collection_shard1_replica2/ shard1
   [junit4]   2> 946977 INFO  
(zkCallback-1283-thread-2-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946977 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946977 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 946977 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947025 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 947027 INFO  (qtp764754301-8597) [n:127.0.0.1:52930_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2}
 status=0 QTime=1763
   [junit4]   2> 947129 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947129 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947129 INFO  
(zkCallback-1283-thread-1-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947129 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947387 INFO  (qtp663923531-8573) [n:127.0.0.1:39810_solr 
c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2128
   [junit4]   2> 947388 INFO  (qtp106895719-8610) [n:127.0.0.1:38797_solr 
c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2}
 status=0 QTime=2132
   [junit4]   2> 947390 INFO  (qtp2069397454-8585) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 947491 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947491 INFO  
(zkCallback-1283-thread-1-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947491 INFO  
(zkCallback-1285-thread-1-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 947491 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/nodes_used_collection/state.json] for collection 
[nodes_used_collection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 948390 INFO  (qtp2069397454-8585) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=2&collection.configName=conf&name=nodes_used_collection&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=3251
   [junit4]   2> 948391 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[B62CBD36366C7450])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testCoresAreDistributedAcrossNodes
   [junit4]   2> 948423 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[B62CBD36366C7450])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoCollectionSpecified
   [junit4]   2> 948423 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[B62CBD36366C7450])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 948425 INFO  (qtp2069397454-8586) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=nodes_used_collection&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 948436 INFO  
(OverseerCollectionConfigSetProcessor-97476586476077066-127.0.0.1:41530_solr-n_0000000000)
 [n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 948437 INFO  
(OverseerThreadFactory-3844-thread-2-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 948439 INFO  (qtp663923531-8574) [n:127.0.0.1:39810_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard1.replica1
   [junit4]   2> 948442 INFO  (qtp764754301-8598) [n:127.0.0.1:52930_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard1.replica2
   [junit4]   2> 948442 INFO  (qtp106895719-8611) [n:127.0.0.1:38797_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard2.replica1
   [junit4]   2> 948444 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard2.replica2
   [junit4]   2> 948445 INFO  (qtp663923531-8574) [n:127.0.0.1:39810_solr    ] 
o.a.s.c.SolrCore [nodes_used_collection_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@505d2076
   [junit4]   2> 948446 INFO  (qtp764754301-8598) [n:127.0.0.1:52930_solr    ] 
o.a.s.c.SolrCore [nodes_used_collection_shard1_replica2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@3750eb07
   [junit4]   2> 948446 INFO  (qtp106895719-8611) [n:127.0.0.1:38797_solr    ] 
o.a.s.c.SolrCore [nodes_used_collection_shard2_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@3e20075a
   [junit4]   2> 948446 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.c.SolrCore [nodes_used_collection_shard2_replica2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@6dfcff9a
   [junit4]   2> 948446 INFO  (qtp106895719-8611) [n:127.0.0.1:38797_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard2.replica1
   [junit4]   2> 948447 INFO  (qtp663923531-8574) [n:127.0.0.1:39810_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard1.replica1
   [junit4]   2> 948461 INFO  (qtp764754301-8598) [n:127.0.0.1:52930_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard1.replica2
   [junit4]   2> 948461 INFO  (qtp106895719-8611) [n:127.0.0.1:38797_solr    ] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 948461 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.nodes_used_collection.shard2.replica2
   [junit4]   2> 948462 INFO  (qtp106895719-8611) [n:127.0.0.1:38797_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=nodes_used_collection_shard2_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=19
   [junit4]   2> 948463 INFO  (qtp663923531-8574) [n:127.0.0.1:39810_solr    ] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 948463 INFO  (qtp663923531-8574) [n:127.0.0.1:39810_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=nodes_used_collection_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=24
   [junit4]   2> 948464 WARN  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.LeaderElector Our node is no longer in 
line to be leader
   [junit4]   2> 948474 INFO  (qtp764754301-8598) [n:127.0.0.1:52930_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=nodes_used_collection_shard1_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=32
   [junit4]   2> 948474 WARN  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.LeaderElector Our node is no longer in 
line to be leader
   [junit4]   2> 948475 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=nodes_used_collection_shard2_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=35
   [junit4]   2> 949178 INFO  (qtp2069397454-8586) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=nodes_used_collection&action=DELETE&wt=javabin&version=2} status=0 
QTime=752
   [junit4]   2> 949186 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-002&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2
   [junit4]   2> 949188 INFO  
(OverseerStateUpdate-97476586476077066-127.0.0.1:41530_solr-n_0000000000) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 950195 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.0
   [junit4]   2> 950201 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema 
[corewithnocollection] Schema name=minimal
   [junit4]   2> 950203 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 950203 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.CoreContainer Creating 
SolrCore 'corewithnocollection' using configuration from collection 
corewithnocollection
   [junit4]   2> 950204 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
[[corewithnocollection] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/corewithnocollection],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-002/]
   [junit4]   2> 950254 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 950254 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 950255 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 950255 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 950263 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@5dfdafab[corewithnocollection] main]
   [junit4]   2> 950263 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 950264 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 950264 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 950264 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1559625390354333696
   [junit4]   2> 950270 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 950270 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 950271 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:41530/solr/corewithnocollection/
   [junit4]   2> 950271 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync 
Success - now sync replicas to me
   [junit4]   2> 950271 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy 
http://127.0.0.1:41530/solr/corewithnocollection/ has no replicas
   [junit4]   2> 950281 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:41530/solr/corewithnocollection/ shard1
   [junit4]   2> 950285 INFO  
(searcherExecutor-3873-thread-1-processing-n:127.0.0.1:41530_solr 
x:corewithnocollection c:corewithnocollection) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
[corewithnocollection] Registered new searcher 
Searcher@5dfdafab[corewithnocollection] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 950432 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 950434 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-002&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2}
 status=0 QTime=1247
   [junit4]   2> 950436 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-002&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2
   [junit4]   2> 950437 INFO  
(OverseerCollectionConfigSetProcessor-97476586476077066-127.0.0.1:41530_solr-n_0000000000)
 [n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 950439 INFO  
(OverseerStateUpdate-97476586476077066-127.0.0.1:41530_solr-n_0000000000) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 951448 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.0
   [junit4]   2> 951453 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema 
[corewithnocollection2] Schema name=minimal
   [junit4]   2> 951455 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 951456 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.CoreContainer 
Creating SolrCore 'corewithnocollection2' using configuration from collection 
corewithnocollection2
   [junit4]   2> 951456 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
[[corewithnocollection2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/corewithnocollection2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-002/]
   [junit4]   2> 951521 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 951521 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 951521 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 951521 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 951522 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@70ca87b3[corewithnocollection2] main]
   [junit4]   2> 951522 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 951526 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 951526 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 951526 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1559625391677636608
   [junit4]   2> 951531 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 951531 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 951531 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:41530/solr/corewithnocollection2/
   [junit4]   2> 951531 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync 
Success - now sync replicas to me
   [junit4]   2> 951531 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy 
http://127.0.0.1:41530/solr/corewithnocollection2/ has no replicas
   [junit4]   2> 951531 INFO  
(searcherExecutor-3878-thread-1-processing-n:127.0.0.1:41530_solr 
x:corewithnocollection2 c:corewithnocollection2) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
[corewithnocollection2] Registered new searcher 
Searcher@70ca87b3[corewithnocollection2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 951533 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:41530/solr/corewithnocollection2/ shard1
   [junit4]   2> 951684 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ZkController I am 
the leader, no recovery necessary
   [junit4]   2> 951685 INFO  (qtp2069397454-8582) [n:127.0.0.1:41530_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-002&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=1250
   [junit4]   2> 951686 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[B62CBD36366C7450])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoCollectionSpecified
   [junit4]   2> 951713 INFO  
(TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[B62CBD36366C7450]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Starting addReplicaTest
   [junit4]   2> 951714 INFO  
(TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[B62CBD36366C7450]) [ 
   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 951717 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=corewithnocollection&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 951718 INFO  
(OverseerThreadFactory-3844-thread-3-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 951720 INFO  (qtp2069397454-8589) [n:127.0.0.1:41530_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection
   [junit4]   2> 951720 INFO  (qtp2069397454-8589) [n:127.0.0.1:41530_solr    ] 
o.a.s.c.SolrCore [corewithnocollection]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@64b67a11
   [junit4]   2> 951721 INFO  (qtp2069397454-8589) [n:127.0.0.1:41530_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection
   [junit4]   2> 951722 INFO  (qtp2069397454-8589) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=corewithnocollection&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=2
   [junit4]   2> 952425 INFO  (qtp2069397454-8583) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=corewithnocollection&action=DELETE&wt=javabin&version=2} status=0 
QTime=708
   [junit4]   2> 952427 INFO  (qtp2069397454-8585) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=corewithnocollection2&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 952431 INFO  
(OverseerCollectionConfigSetProcessor-97476586476077066-127.0.0.1:41530_solr-n_0000000000)
 [n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 952431 INFO  
(OverseerThreadFactory-3844-thread-4-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 952433 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection2
   [junit4]   2> 952434 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.c.SolrCore [corewithnocollection2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@1f36e8a5
   [junit4]   2> 952435 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection2
   [junit4]   2> 952436 INFO  (qtp2069397454-8587) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=corewithnocollection2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=3
   [junit4]   2> 953139 INFO  (qtp2069397454-8585) [n:127.0.0.1:41530_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=corewithnocollection2&action=DELETE&wt=javabin&version=2} status=0 
QTime=712
   [junit4]   2> 953141 INFO  (qtp2069397454-8586) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&maxShardsPerNode=4&name=addReplicaColl&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 953142 INFO  
(OverseerThreadFactory-3844-thread-5-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
addReplicaColl
   [junit4]   2> 953143 INFO  
(OverseerCollectionConfigSetProcessor-97476586476077066-127.0.0.1:41530_solr-n_0000000000)
 [n:127.0.0.1:41530_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 953347 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr    ] 
o.a.s.u.TestInjection Inject random core creation delay of 0s
   [junit4]   2> 953348 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica2&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2
   [junit4]   2> 953350 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica2&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2
   [junit4]   2> 953350 INFO  (qtp106895719-8609) [n:127.0.0.1:38797_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica1&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2
   [junit4]   2> 953350 INFO  (qtp764754301-8599) [n:127.0.0.1:52930_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica1&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2
   [junit4]   2> 953455 INFO  
(zkCallback-1285-thread-2-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 953455 INFO  
(zkCallback-1276-thread-2-processing-n:127.0.0.1:39810_solr) 
[n:127.0.0.1:39810_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 953455 INFO  
(zkCallback-1283-thread-3-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 953455 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 954359 INFO  (qtp764754301-8599) [n:127.0.0.1:52930_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 954360 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 954368 INFO  (qtp106895719-8609) [n:127.0.0.1:38797_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 954370 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica2] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.0
   [junit4]   2> 954374 INFO  (qtp106895719-8609) [n:127.0.0.1:38797_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica1] 
o.a.s.s.IndexSchema [addReplicaColl_shard1_replica1] Schema name=minimal
   [junit4]   2> 954376 INFO  (qtp106895719-8609) [n:127.0.0.1:38797_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 954377 INFO  (qtp106895719-8609) [n:127.0.0.1:38797_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica1' using 
configuration from collection addReplicaColl
   [junit4]   2> 954377 INFO  (qtp106895719-8609) [n:127.0.0.1:38797_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica1] o.a.s.c.SolrCore 
[[addReplicaColl_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node4/addReplicaColl_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node4/./addReplicaColl_shard1_replica1/data/]
   [junit4]   2> 954380 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.s.IndexSchema [addReplicaColl_shard2_replica2] Schema name=minimal
   [junit4]   2> 954380 INFO  (qtp764754301-8599) [n:127.0.0.1:52930_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica1] 
o.a.s.s.IndexSchema [addReplicaColl_shard2_replica1] Schema name=minimal
   [junit4]   2> 954381 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 954386 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica2' using 
configuration from collection addReplicaColl
   [junit4]   2> 954387 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] o.a.s.c.SolrCore 
[[addReplicaColl_shard2_replica2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node3/addReplicaColl_shard2_replica2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node3/./addReplicaColl_shard2_replica2/data/]
   [junit4]   2> 954389 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica2] 
o.a.s.s.IndexSchema [addReplicaColl_shard1_replica2] Schema name=minimal
   [junit4]   2> 954391 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica2] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 954392 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica2' using 
configuration from collection addReplicaColl
   [junit4]   2> 954393 INFO  (qtp2069397454-8588) [n:127.0.0.1:41530_solr 
c:addReplicaColl s:shard1  x:addReplicaColl_shard1_replica2] o.a.s.c.SolrCore 
[[addReplicaColl_shard1_replica2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/addReplicaColl_shard1_replica2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node2/./addReplicaColl_shard1_replica2/data/]
   [junit4]   2> 954396 INFO  (qtp764754301-8599) [n:127.0.0.1:52930_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 954397 INFO  (qtp764754301-8599) [n:127.0.0.1:52930_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica1' using 
configuration from collection addReplicaColl
   [junit4]   2> 954397 INFO  (qtp764754301-8599) [n:127.0.0.1:52930_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica1] o.a.s.c.SolrCore 
[[addReplicaColl_shard2_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node1/addReplicaColl_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001/tempDir-001/node1/./addReplicaColl_shard2_replica1/data/]
   [junit4]   2> 954468 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 954468 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 954469 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 954469 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 954473 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7a050d43[addReplicaColl_shard2_replica2] main]
   [junit4]   2> 954473 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 954474 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 954474 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 954474 INFO  (qtp663923531-8577) [n:127.0.0.1:39810_solr 
c:addReplicaColl s:shard2  x:addReplicaColl_shard2_replica2] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1559625394768838656
   [junit4]   2> 954477 INFO  
(searcherExecutor-3884-thread-1-processing-n:127.0.0.1:39810_solr 
x:addReplicaColl_shard2_replica2 s:shard2 c:addReplicaColl) 
[n:127.0.0.1:39810_solr c:addReplicaColl s:shard2  
x:addReplicaColl_shard2_replica2] o.a.s.c.SolrCore 
[addReplicaColl_shard2_replica2] Registered new searcher 
Searcher@7a050d43[addReplicaColl_shard2_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 954483 INFO  (qtp663923531-

[...truncated too long message...]

    ] o.e.j.s.AbstractConnector Stopped 
ServerConnector@63154f8f{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1037290 INFO  (jetty-launcher-1264-thread-8) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1752498123
   [junit4]   2> 1037290 INFO  (jetty-launcher-1264-thread-6) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@a9307f2{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1037291 INFO  (jetty-launcher-1264-thread-7) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@33519cd8{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1037291 INFO  (jetty-launcher-1264-thread-6) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=460289220
   [junit4]   2> 1037294 INFO  (jetty-launcher-1264-thread-7) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=147405791
   [junit4]   2> 1037298 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a4e705ed30008, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1037299 INFO  (jetty-launcher-1264-thread-5) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1037299 INFO  (jetty-launcher-1264-thread-5) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2839c73e{/solr,null,UNAVAILABLE}
   [junit4]   2> 1037300 INFO  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 1037300 INFO  
(zkCallback-1283-thread-2-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 1037302 INFO  (jetty-launcher-1264-thread-7) [    ] 
o.a.s.c.Overseer Overseer 
(id=97476586476077066-127.0.0.1:41530_solr-n_0000000000) closing
   [junit4]   2> 1037302 INFO  
(OverseerStateUpdate-97476586476077066-127.0.0.1:41530_solr-n_0000000000) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:41530_solr
   [junit4]   2> 1037302 INFO  
(zkCallback-1283-thread-2-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (1)
   [junit4]   2> 1038799 WARN  
(zkCallback-1285-thread-3-processing-n:127.0.0.1:52930_solr) 
[n:127.0.0.1:52930_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1038800 WARN  
(zkCallback-1286-thread-1-processing-n:127.0.0.1:38797_solr) 
[n:127.0.0.1:38797_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1038801 INFO  (jetty-launcher-1264-thread-6) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1038801 INFO  (jetty-launcher-1264-thread-6) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@36e044ed{/solr,null,UNAVAILABLE}
   [junit4]   2> 1038802 INFO  (jetty-launcher-1264-thread-8) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1038802 INFO  (jetty-launcher-1264-thread-8) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7f5a9d7e{/solr,null,UNAVAILABLE}
   [junit4]   2> 1038811 WARN  
(zkCallback-1283-thread-2-processing-n:127.0.0.1:41530_solr) 
[n:127.0.0.1:41530_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1038811 INFO  (jetty-launcher-1264-thread-7) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1038811 INFO  (jetty-launcher-1264-thread-7) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@37ac9fd4{/solr,null,UNAVAILABLE}
   [junit4]   2> 1038812 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:34837 34837
   [junit4]   2> 1038994 INFO  (Thread-2280) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:34837 34837
   [junit4]   2> 1038995 WARN  (Thread-2280) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        25      /solr/aliases.json
   [junit4]   2>        25      /solr/clusterprops.json
   [junit4]   2>        23      /solr/configs/conf
   [junit4]   2>        5       /solr/configs/conf2
   [junit4]   2>        4       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        263     /solr/clusterstate.json
   [junit4]   2>        6       
/solr/collections/awhollynewcollection_0/state.json
   [junit4]   2>        4       
/solr/collections/nodes_used_collection/state.json
   [junit4]   2>        4       /solr/collections/addReplicaColl/state.json
   [junit4]   2>        4       /solr/collections/reloaded_collection/state.json
   [junit4]   2>        3       
/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2>        2       /solr/collections/onlyinzk/state.json
   [junit4]   2>        2       
/solr/collections/halfdeletedcollection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        469     /solr/collections
   [junit4]   2>        127     /solr/overseer/queue
   [junit4]   2>        44      /solr/overseer/collection-queue-work
   [junit4]   2>        25      /solr/live_nodes
   [junit4]   2>        18      /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1038995 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[B62CBD36366C7450]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_B62CBD36366C7450-001
   [junit4]   2> Feb 17, 2017 11:39:26 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: 
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
 chunkSize=5, maxDocsPerChunk=821, blockSize=8), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, 
chunkSize=5, blockSize=8)), sim=RandomSimilarity(queryNorm=false,coord=no): {}, 
locale=ms-MY, timezone=Europe/Mariehamn
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_121 (64-bit)/cpus=4,threads=1,free=165282560,total=521142272
   [junit4]   2> NOTE: All tests run in this JVM: [TestMiniSolrCloudCluster, 
CursorMarkTest, DateRangeFieldTest, DistributedFacetPivotSmallAdvancedTest, 
ConcurrentDeleteAndCreateCollectionTest, SystemInfoHandlerTest, 
AddBlockUpdateTest, EchoParamsTest, TestReloadDeadlock, 
TestClassicSimilarityFactory, DirectSolrSpellCheckerTest, 
ManagedSchemaRoundRobinCloudTest, TestSimpleTrackingShardHandler, 
SaslZkACLProviderTest, TestManagedSchemaAPI, SortSpecParsingTest, 
IndexBasedSpellCheckerTest, SolrInfoMBeanTest, TestObjectReleaseTracker, 
OverseerModifyCollectionTest, HdfsUnloadDistributedZkTest, 
TestCopyFieldCollectionResource, TestRestoreCore, TestHdfsBackupRestoreCore, 
JSONWriterTest, SearchHandlerTest, TestGraphMLResponseWriter, 
TestIntervalFaceting, TestOrdValues, CoreSorterTest, 
ShufflingReplicaListTransformerTest, SuggesterFSTTest, SolrCmdDistributorTest, 
SimplePostToolTest, TestBM25SimilarityFactory, TestImpersonationWithHadoopAuth, 
SpellingQueryConverterTest, TestRTGBase, CloneFieldUpdateProcessorFactoryTest, 
TestFieldCacheSanityChecker, TestFieldTypeCollectionResource, 
TestCloudDeleteByQuery, DistributedQueryComponentCustomSortTest, 
TestElisionMultitermQuery, TestLRUCache, DistributedFacetExistsSmallTest, 
TestPivotHelperCode, CreateCollectionCleanupTest, 
TestRuleBasedAuthorizationPlugin, TestDistributedGrouping, TestCoreContainer, 
RequestLoggingTest, TestEmbeddedSolrServerConstructors, ZkCLITest, 
SolrIndexConfigTest, TestNumericTerms32, CopyFieldTest, BadCopyFieldTest, 
TestTrie, TestQuerySenderListener, MultiTermTest, RemoteQueryErrorTest, 
TestConfigOverlay, HdfsBasicDistributedZk2Test, TestSolrCloudWithKerberosAlt, 
TestLeaderInitiatedRecoveryThread, TestCursorMarkWithoutUniqueKey, 
TestSurroundQueryParser, TestBulkSchemaConcurrent, TestDefaultStatsCache, 
RAMDirectoryFactoryTest, TestWordDelimiterFilterFactory, 
TermVectorComponentTest, BasicFunctionalityTest, DataDrivenBlockJoinTest, 
TestRebalanceLeaders, TestClusterStateMutator, TestRestManager, 
TestPerFieldSimilarityClassic, TestOnReconnectListenerSupport, 
SolrIndexSplitterTest, DistribDocExpirationUpdateProcessorTest, 
TestCharFilters, DocValuesTest, JvmMetricsTest, WrapperMergePolicyFactoryTest, 
TestChildDocTransformer, LeaderFailureAfterFreshStartTest, HdfsSyncSliceTest, 
CdcrReplicationDistributedZkTest, SortByFunctionTest, TestSchemaResource, 
CloudExitableDirectoryReaderTest, TestRequestStatusCollectionAPI, 
TestExactStatsCache, TermsComponentTest, TestDocTermOrds, 
CSVRequestHandlerTest, TestUseDocValuesAsStored2, HighlighterMaxOffsetTest, 
TestQueryUtils, JsonLoaderTest, HighlighterTest, 
TestSerializedLuceneMatchVersion, DistributedVersionInfoTest, 
HttpPartitionTest, TestQueryTypes, ShardRoutingTest, 
DistributedTermsComponentTest, FullHLLTest, MoreLikeThisHandlerTest, 
TestSchemaManager, CollectionTooManyReplicasTest, ChaosMonkeySafeLeaderTest, 
BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed [302/692 (1!)] on J1 in 95.68s, 20 tests, 1 failure <<< 
FAILURES!

[...truncated 63877 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to