Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1688/

1 tests failed.
FAILED:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
expected:<3> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<3> but was:<1>
        at 
__randomizedtesting.SeedInfo.seed([4520B761189B179D:D55C3D51EA83808]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:523)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11988 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/init-core-data-001
   [junit4]   2> 821117 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 821119 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 821119 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001
   [junit4]   2> 821119 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 821130 INFO  (Thread-1985) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 821130 INFO  (Thread-1985) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 821230 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:55252
   [junit4]   2> 821251 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 821252 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 821252 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 821253 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 821253 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@74b9ca3e{/solr,null,AVAILABLE}
   [junit4]   2> 821254 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7d11a2bc{HTTP/1.1,[http/1.1]}{127.0.0.1:44644}
   [junit4]   2> 821254 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.e.j.s.Server Started @824583ms
   [junit4]   2> 821254 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44644}
   [junit4]   2> 821255 ERROR (jetty-launcher-1520-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 821255 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.0.0
   [junit4]   2> 821255 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 821255 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 821255 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-22T23:19:47.595Z
   [junit4]   2> 821256 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5ff49f9{/solr,null,AVAILABLE}
   [junit4]   2> 821256 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@20e2abfb{HTTP/1.1,[http/1.1]}{127.0.0.1:34210}
   [junit4]   2> 821256 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.e.j.s.Server Started @824586ms
   [junit4]   2> 821256 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=34210}
   [junit4]   2> 821257 ERROR (jetty-launcher-1520-thread-3) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 821257 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.0.0
   [junit4]   2> 821257 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 821257 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 821257 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-22T23:19:47.597Z
   [junit4]   2> 821258 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4b7e248{/solr,null,AVAILABLE}
   [junit4]   2> 821258 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@631be4ec{HTTP/1.1,[http/1.1]}{127.0.0.1:40785}
   [junit4]   2> 821258 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.e.j.s.Server Started @824587ms
   [junit4]   2> 821258 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=40785}
   [junit4]   2> 821259 ERROR (jetty-launcher-1520-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 821259 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.0.0
   [junit4]   2> 821259 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 821259 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 821259 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-22T23:19:47.599Z
   [junit4]   2> 821260 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 821260 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@32966db9{/solr,null,AVAILABLE}
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@30bc422c{HTTP/1.1,[http/1.1]}{127.0.0.1:49838}
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.e.j.s.Server Started @824590ms
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=49838}
   [junit4]   2> 821261 ERROR (jetty-launcher-1520-thread-4) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.0.0
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 821261 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-22T23:19:47.601Z
   [junit4]   2> 821263 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 821263 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 821266 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 821274 INFO  (jetty-launcher-1520-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55252/solr
   [junit4]   2> 821277 INFO  (jetty-launcher-1520-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55252/solr
   [junit4]   2> 821285 INFO  (jetty-launcher-1520-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55252/solr
   [junit4]   2> 821285 INFO  (jetty-launcher-1520-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55252/solr
   [junit4]   2> 821287 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a681fa0220006, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 821288 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a681fa0220005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 821301 INFO  (jetty-launcher-1520-thread-3) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 821302 INFO  (jetty-launcher-1520-thread-3) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:34210_solr
   [junit4]   2> 821302 INFO  (jetty-launcher-1520-thread-3) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.Overseer Overseer 
(id=97504826981744648-127.0.0.1:34210_solr-n_0000000000) starting
   [junit4]   2> 821313 INFO  (jetty-launcher-1520-thread-4) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 821314 INFO  (jetty-launcher-1520-thread-4) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:49838_solr
   [junit4]   2> 821330 INFO  (jetty-launcher-1520-thread-2) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 821332 INFO  (jetty-launcher-1520-thread-2) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 821333 INFO  (jetty-launcher-1520-thread-2) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40785_solr
   [junit4]   2> 821345 INFO  
(zkCallback-1541-thread-1-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 821350 INFO  
(OverseerStateUpdate-97504826981744648-127.0.0.1:34210_solr-n_0000000000) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 821358 INFO  
(zkCallback-1542-thread-1-processing-n:127.0.0.1:49838_solr) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 821358 INFO  (jetty-launcher-1520-thread-3) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34210_solr
   [junit4]   2> 821359 INFO  
(zkCallback-1542-thread-1-processing-n:127.0.0.1:49838_solr) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 821359 INFO  
(zkCallback-1539-thread-1-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 821359 INFO  
(zkCallback-1541-thread-1-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 821370 INFO  (jetty-launcher-1520-thread-1) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 821371 INFO  (jetty-launcher-1520-thread-1) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 821372 INFO  (jetty-launcher-1520-thread-1) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44644_solr
   [junit4]   2> 821378 INFO  
(zkCallback-1542-thread-1-processing-n:127.0.0.1:49838_solr) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 821378 INFO  
(zkCallback-1541-thread-1-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 821387 INFO  
(zkCallback-1539-thread-3-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 821394 INFO  
(zkCallback-1543-thread-1-processing-n:127.0.0.1:44644_solr) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 821458 INFO  (jetty-launcher-1520-thread-1) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node1/.
   [junit4]   2> 821485 INFO  (jetty-launcher-1520-thread-4) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node4/.
   [junit4]   2> 821490 INFO  (jetty-launcher-1520-thread-2) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node2/.
   [junit4]   2> 821554 INFO  (jetty-launcher-1520-thread-3) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node3/.
   [junit4]   2> 822094 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 822094 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55252/solr ready
   [junit4]   2> 822118 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateShouldFailOnExistingCore
   [junit4]   2> 822118 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[4520B761189B179D])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 822127 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-002&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker&wt=javabin&version=2
   [junit4]   2> 822129 INFO  
(OverseerStateUpdate-97504826981744648-127.0.0.1:34210_solr-n_0000000000) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 823140 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 823155 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema 
[halfcollection_shard1_replica1] Schema name=minimal
   [junit4]   2> 823172 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 823173 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica1' using 
configuration from collection halfcollectionblocker
   [junit4]   2> 823173 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[[halfcollection_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node4/halfcollection_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-002/]
   [junit4]   2> 823270 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 823270 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 823271 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 823271 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 823271 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5adb981b[halfcollection_shard1_replica1] main]
   [junit4]   2> 823272 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 823272 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 823272 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 823273 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1560077233934041088
   [junit4]   2> 823273 INFO  
(searcherExecutor-3404-thread-1-processing-n:127.0.0.1:49838_solr 
x:halfcollection_shard1_replica1 c:halfcollectionblocker) 
[n:127.0.0.1:49838_solr c:halfcollectionblocker   
x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[halfcollection_shard1_replica1] Registered new searcher 
Searcher@5adb981b[halfcollection_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 823278 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 823278 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 823278 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:49838/solr/halfcollection_shard1_replica1/
   [junit4]   2> 823278 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 823278 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:49838/solr/halfcollection_shard1_replica1/ has no replicas
   [junit4]   2> 823278 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 823280 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49838/solr/halfcollection_shard1_replica1/ shard1
   [junit4]   2> 823526 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 823536 INFO  (qtp438990240-8583) [n:127.0.0.1:49838_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-002&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker&wt=javabin&version=2}
 status=0 QTime=1408
   [junit4]   2> 823555 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-003&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker2&wt=javabin&version=2
   [junit4]   2> 823557 INFO  
(OverseerStateUpdate-97504826981744648-127.0.0.1:34210_solr-n_0000000000) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 824583 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 824601 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.IndexSchema [halfcollection_shard1_replica1] Schema name=minimal
   [junit4]   2> 824604 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 824604 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica1' using 
configuration from collection halfcollectionblocker2
   [junit4]   2> 824605 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[[halfcollection_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node3/halfcollection_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-003/]
   [junit4]   2> 824631 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 824631 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 824632 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 824632 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 824632 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@370f43c4[halfcollection_shard1_replica1] main]
   [junit4]   2> 824633 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 824633 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 824633 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 824633 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1560077235360104448
   [junit4]   2> 824639 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 824639 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 824639 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:34210/solr/halfcollection_shard1_replica1/
   [junit4]   2> 824639 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 824639 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:34210/solr/halfcollection_shard1_replica1/ has no replicas
   [junit4]   2> 824639 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 824642 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:34210/solr/halfcollection_shard1_replica1/ shard1
   [junit4]   2> 824642 INFO  
(searcherExecutor-3409-thread-1-processing-n:127.0.0.1:34210_solr 
x:halfcollection_shard1_replica1 c:halfcollectionblocker2) 
[n:127.0.0.1:34210_solr c:halfcollectionblocker2   
x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[halfcollection_shard1_replica1] Registered new searcher 
Searcher@370f43c4[halfcollection_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 824793 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 824795 INFO  (qtp696847750-8560) [n:127.0.0.1:34210_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-003&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker2&wt=javabin&version=2}
 status=0 QTime=1240
   [junit4]   2> 824798 INFO  (qtp1222009247-8571) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf&name=halfcollection&action=CREATE&numShards=2&createNodeSet=127.0.0.1:49838_solr,127.0.0.1:34210_solr&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 824801 INFO  
(OverseerThreadFactory-3395-thread-1-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
halfcollection
   [junit4]   2> 825007 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 825008 INFO  (qtp438990240-8581) [n:127.0.0.1:49838_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 825009 WARN  (qtp438990240-8581) [n:127.0.0.1:49838_solr    ] 
o.a.s.c.CoreContainer Creating a core with existing name is not allowed
   [junit4]   2> 825009 ERROR (qtp438990240-8581) [n:127.0.0.1:49838_solr    ] 
o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Core with name 
'halfcollection_shard1_replica1' already exists.
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:858)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:374)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:747)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:728)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:509)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
   [junit4]   2>        at 
org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 825009 INFO  (qtp438990240-8581) [n:127.0.0.1:49838_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2}
 status=500 QTime=1
   [junit4]   2> 825009 ERROR (qtp438990240-8581) [n:127.0.0.1:49838_solr    ] 
o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Core with name 
'halfcollection_shard1_replica1' already exists.
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:858)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:374)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:747)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:728)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:509)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
   [junit4]   2>        at 
org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 825011 ERROR 
(OverseerThreadFactory-3395-thread-1-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error 
from shard: http://127.0.0.1:49838/solr
   [junit4]   2> 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:49838/solr: Core with name 
'halfcollection_shard1_replica1' already exists.
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
   [junit4]   2>        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2>        at 
org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:163)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>        at 
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 825113 INFO  
(zkCallback-1539-thread-4-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/halfcollection/state.json] for collection [halfcollection] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 826017 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 826023 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.IndexSchema [halfcollection_shard2_replica1] Schema name=minimal
   [junit4]   2> 826025 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 826030 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard2_replica1' using 
configuration from collection halfcollection
   [junit4]   2> 826031 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.c.SolrCore 
[[halfcollection_shard2_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node3/halfcollection_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node3/./halfcollection_shard2_replica1/data/]
   [junit4]   2> 826095 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 826095 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 826096 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 826096 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 826096 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@4931c5ad[halfcollection_shard2_replica1] main]
   [junit4]   2> 826096 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 826097 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 826097 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 826097 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1560077236895219712
   [junit4]   2> 826101 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 826101 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 826101 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:34210/solr/halfcollection_shard2_replica1/
   [junit4]   2> 826101 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 826101 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:34210/solr/halfcollection_shard2_replica1/ has no replicas
   [junit4]   2> 826102 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 826102 INFO  
(searcherExecutor-3414-thread-1-processing-n:127.0.0.1:34210_solr 
x:halfcollection_shard2_replica1 s:shard2 c:halfcollection) 
[n:127.0.0.1:34210_solr c:halfcollection s:shard2  
x:halfcollection_shard2_replica1] o.a.s.c.SolrCore 
[halfcollection_shard2_replica1] Registered new searcher 
Searcher@4931c5ad[halfcollection_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 826104 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:34210/solr/halfcollection_shard2_replica1/ shard2
   [junit4]   2> 826230 INFO  
(zkCallback-1539-thread-2-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/halfcollection/state.json] for collection [halfcollection] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 826280 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 826281 INFO  (qtp696847750-8558) [n:127.0.0.1:34210_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2}
 status=0 QTime=1274
   [junit4]   2> 826281 ERROR 
(OverseerThreadFactory-3395-thread-1-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning 
up collection [halfcollection].
   [junit4]   2> 826282 INFO  
(OverseerThreadFactory-3395-thread-1-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 826283 INFO  (qtp696847750-8564) [n:127.0.0.1:34210_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection.shard2.replica1
   [junit4]   2> 826283 INFO  (qtp696847750-8564) [n:127.0.0.1:34210_solr    ] 
o.a.s.c.SolrCore [halfcollection_shard2_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5a8cf935
   [junit4]   2> 826294 INFO  (qtp696847750-8564) [n:127.0.0.1:34210_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection.shard2.replica1
   [junit4]   2> 826295 INFO  (qtp696847750-8564) [n:127.0.0.1:34210_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=halfcollection_shard2_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=12
   [junit4]   2> 826997 INFO  
(OverseerThreadFactory-3395-thread-1-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Cleaned up artifacts 
for failed create collection for [halfcollection]
   [junit4]   2> 826999 INFO  (qtp1222009247-8571) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 828826 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 857002 ERROR (qtp1222009247-8571) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Timed out waiting for new collection's replicas to 
become ACTIVE with timeout=30
   [junit4]   2> 857002 INFO  (qtp1222009247-8571) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=1&collection.configName=conf&name=halfcollection&action=CREATE&numShards=2&createNodeSet=127.0.0.1:49838_solr,127.0.0.1:34210_solr&wt=javabin&version=2}
 status=0 QTime=32204
   [junit4]   2> 857003 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreateShouldFailOnExistingCore
   [junit4]   2> 857020 INFO  
(TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testSpecificConfigsets
   [junit4]   2> 857020 INFO  
(TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[4520B761189B179D])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 857021 INFO  (qtp1222009247-8572) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=halfcollectionblocker2&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 857024 INFO  
(OverseerThreadFactory-3395-thread-2-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 857025 INFO  (qtp696847750-8557) [n:127.0.0.1:34210_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection_shard1_replica1
   [junit4]   2> 857026 INFO  (qtp696847750-8557) [n:127.0.0.1:34210_solr    ] 
o.a.s.c.SolrCore [halfcollection_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@53a7b575
   [junit4]   2> 857028 INFO  (qtp696847750-8557) [n:127.0.0.1:34210_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection_shard1_replica1
   [junit4]   2> 857029 INFO  (qtp696847750-8557) [n:127.0.0.1:34210_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=halfcollection_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=3
   [junit4]   2> 857732 INFO  (qtp1222009247-8572) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=halfcollectionblocker2&action=DELETE&wt=javabin&version=2} 
status=0 QTime=711
   [junit4]   2> 857733 INFO  (qtp1222009247-8573) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=halfcollectionblocker&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 857737 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 857737 INFO  
(OverseerThreadFactory-3395-thread-3-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 857739 INFO  (qtp438990240-8587) [n:127.0.0.1:49838_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection_shard1_replica1
   [junit4]   2> 857739 INFO  (qtp438990240-8587) [n:127.0.0.1:49838_solr    ] 
o.a.s.c.SolrCore [halfcollection_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@3ca1fe9c
   [junit4]   2> 857741 INFO  (qtp438990240-8587) [n:127.0.0.1:49838_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection_shard1_replica1
   [junit4]   2> 857743 INFO  (qtp438990240-8587) [n:127.0.0.1:49838_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=halfcollection_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=4
   [junit4]   2> 858446 INFO  (qtp1222009247-8573) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=halfcollectionblocker&action=DELETE&wt=javabin&version=2} status=0 
QTime=712
   [junit4]   2> 858447 INFO  (qtp1222009247-8574) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf2&name=withconfigset2&action=CREATE&numShards=1&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 858451 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 858451 INFO  
(OverseerThreadFactory-3395-thread-4-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
withconfigset2
   [junit4]   2> 858658 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf2&newCollection=true&name=withconfigset2_shard1_replica1&action=CREATE&numShards=1&collection=withconfigset2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 858763 INFO  
(zkCallback-1541-thread-2-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/withconfigset2/state.json] for collection [withconfigset2] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 859686 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 859693 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.s.IndexSchema [withconfigset2_shard1_replica1] Schema name=minimal
   [junit4]   2> 859695 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 859695 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'withconfigset2_shard1_replica1' using 
configuration from collection withconfigset2
   [junit4]   2> 859696 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] o.a.s.c.SolrCore 
[[withconfigset2_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node2/withconfigset2_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node2/./withconfigset2_shard1_replica1/data/]
   [junit4]   2> 859696 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32228f96
   [junit4]   2> 859730 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 859730 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 859731 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 859731 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 859732 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@143e68a3[withconfigset2_shard1_replica1] main]
   [junit4]   2> 859732 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf2
   [junit4]   2> 859733 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 859733 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 859733 INFO  
(searcherExecutor-3419-thread-1-processing-n:127.0.0.1:40785_solr 
x:withconfigset2_shard1_replica1 s:shard1 c:withconfigset2) 
[n:127.0.0.1:40785_solr c:withconfigset2 s:shard1  
x:withconfigset2_shard1_replica1] o.a.s.c.SolrCore 
[withconfigset2_shard1_replica1] Registered new searcher 
Searcher@143e68a3[withconfigset2_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 859733 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1560077272165122048
   [junit4]   2> 859739 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 859739 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 859739 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:40785/solr/withconfigset2_shard1_replica1/
   [junit4]   2> 859739 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 859739 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:40785/solr/withconfigset2_shard1_replica1/ has no replicas
   [junit4]   2> 859739 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 859742 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:40785/solr/withconfigset2_shard1_replica1/ shard1
   [junit4]   2> 859848 INFO  
(zkCallback-1541-thread-2-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/withconfigset2/state.json] for collection [withconfigset2] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 859897 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 859901 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr 
c:withconfigset2 s:shard1  x:withconfigset2_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf2&newCollection=true&name=withconfigset2_shard1_replica1&action=CREATE&numShards=1&collection=withconfigset2&shard=shard1&wt=javabin&version=2}
 status=0 QTime=1243
   [junit4]   2> 859907 INFO  (qtp1222009247-8574) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 860000 INFO  
(zkCallback-1541-thread-2-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/withconfigset2/state.json] for collection [withconfigset2] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 860452 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 860907 INFO  (qtp1222009247-8574) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=1&collection.configName=conf2&name=withconfigset2&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=2460
   [junit4]   2> 860908 INFO  
(TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testSpecificConfigsets
   [junit4]   2> 860943 INFO  
(TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testTooManyReplicas
   [junit4]   2> 860944 INFO  
(TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[4520B761189B179D])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 860945 INFO  (qtp1222009247-8575) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=withconfigset2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 860949 INFO  
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 860951 INFO  (qtp1222009247-8568) [n:127.0.0.1:40785_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.withconfigset2.shard1.replica1
   [junit4]   2> 860952 INFO  (qtp1222009247-8568) [n:127.0.0.1:40785_solr    ] 
o.a.s.c.SolrCore [withconfigset2_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@309040cd
   [junit4]   2> 860987 INFO  (qtp1222009247-8568) [n:127.0.0.1:40785_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.withconfigset2.shard1.replica1
   [junit4]   2> 860990 INFO  (qtp1222009247-8568) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=withconfigset2_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=39
   [junit4]   2> 861694 INFO  (qtp1222009247-8575) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=withconfigset2&action=DELETE&wt=javabin&version=2} status=0 
QTime=748
   [junit4]   2> 861695 INFO  (qtp1222009247-8571) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=10&collection.configName=conf&name=collection&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 861696 INFO  
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
collection
   [junit4]   2> 861697 WARN  
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Specified 
replicationFactor of 10 on collection collection is higher than or equal to the 
number of Solr instances currently live or live and part of your 
createNodeSet(4). It's unusual to run two replica of the same slice on the same 
Solr-instance.
   [junit4]   2> 861697 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 861697 ERROR 
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
Collection: collection operation: create 
failed:org.apache.solr.common.SolrException: Cannot create collection 
collection. Value of maxShardsPerNode is 1, and the number of nodes currently 
live or live and part of your createNodeSet is 4. This allows a maximum of 4 to 
be created. Value of numShards is 2 and value of replicationFactor is 10. This 
requires 20 shards to be created (higher than the allowed number)
   [junit4]   2>        at 
org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:155)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 861703 INFO  (qtp1222009247-8571) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=10&collection.configName=conf&name=collection&action=CREATE&numShards=2&wt=javabin&version=2}
 status=400 QTime=7
   [junit4]   2> 861703 INFO  
(TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
   [junit4]   2> 861728 INFO  
(TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testMissingNumShards
   [junit4]   2> 861730 INFO  
(TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[4520B761189B179D])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 861731 INFO  (qtp1222009247-8573) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 861733 INFO  
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
acollection
   [junit4]   2> 861733 ERROR 
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
Collection: acollection operation: create 
failed:org.apache.solr.common.SolrException: numShards is a required param 
(when using CompositeId router).
   [junit4]   2>        at 
org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:112)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 861733 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 861735 INFO  (qtp1222009247-8573) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&wt=javabin&version=2}
 status=400 QTime=3
   [junit4]   2> 861735 INFO  
(TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testMissingNumShards
   [junit4]   2> 861759 INFO  
(TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[4520B761189B179D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionOnlyInZk
   [junit4]   2> 861760 INFO  
(TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[4520B761189B179D])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 861763 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=onlyinzk&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 861766 INFO  (qtp1222009247-8569) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=onlyinzk&action=DELETE&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 861766 INFO  (qtp1222009247-8574) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 861766 INFO  (qtp1222009247-8574) [n:127.0.0.1:40785_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 861767 INFO  (qtp1222009247-8568) [n:127.0.0.1:40785_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf&name=onlyinzk&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 861768 INFO  
(OverseerThreadFactory-3395-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
onlyinzk
   [junit4]   2> 861768 INFO  
(OverseerCollectionConfigSetProcessor-97504826981744648-127.0.0.1:34210_solr-n_0000000000)
 [n:127.0.0.1:34210_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000014 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 861972 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=onlyinzk_shard1_replica1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard1&wt=javabin&version=2
   [junit4]   2> 861973 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=onlyinzk_shard2_replica1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard2&wt=javabin&version=2
   [junit4]   2> 862076 INFO  
(zkCallback-1542-thread-2-processing-n:127.0.0.1:49838_solr) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 862076 INFO  
(zkCallback-1543-thread-1-processing-n:127.0.0.1:44644_solr) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 863004 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 7.0.0
   [junit4]   2> 863006 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 7.0.0
   [junit4]   2> 863010 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.s.IndexSchema 
[onlyinzk_shard2_replica1] Schema name=minimal
   [junit4]   2> 863013 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.s.IndexSchema 
[onlyinzk_shard1_replica1] Schema name=minimal
   [junit4]   2> 863014 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 863015 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 863015 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.CoreContainer Creating 
SolrCore 'onlyinzk_shard2_replica1' using configuration from collection onlyinzk
   [junit4]   2> 863015 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.CoreContainer Creating 
SolrCore 'onlyinzk_shard1_replica1' using configuration from collection onlyinzk
   [junit4]   2> 863016 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.SolrCore 
[[onlyinzk_shard2_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node4/onlyinzk_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node4/./onlyinzk_shard2_replica1/data/]
   [junit4]   2> 863016 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.SolrCore 
[[onlyinzk_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node1/onlyinzk_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001/tempDir-001/node1/./onlyinzk_shard1_replica1/data/]
   [junit4]   2> 863044 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 863044 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 863044 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 863044 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 863045 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 863045 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 863045 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 863045 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 863045 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@13c6decb[onlyinzk_shard1_replica1] main]
   [junit4]   2> 863045 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@4ae56bb2[onlyinzk_shard2_replica1] main]
   [junit4]   2> 863046 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 863046 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 863046 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 863046 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 863046 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 863046 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 863046 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1560077275639054336
   [junit4]   2> 863046 INFO  
(searcherExecutor-3425-thread-1-processing-n:127.0.0.1:44644_solr 
x:onlyinzk_shard1_replica1 s:shard1 c:onlyinzk) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.SolrCore 
[onlyinzk_shard1_replica1] Registered new searcher 
Searcher@13c6decb[onlyinzk_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 863046 INFO  
(searcherExecutor-3424-thread-1-processing-n:127.0.0.1:49838_solr 
x:onlyinzk_shard2_replica1 s:shard2 c:onlyinzk) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.SolrCore 
[onlyinzk_shard2_replica1] Registered new searcher 
Searcher@4ae56bb2[onlyinzk_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 863046 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1560077275639054336
   [junit4]   2> 863051 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 863051 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 863051 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:44644/solr/onlyinzk_shard1_replica1/
   [junit4]   2> 863051 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.SyncStrategy Sync 
Success - now sync replicas to me
   [junit4]   2> 863051 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.SyncStrategy 
http://127.0.0.1:44644/solr/onlyinzk_shard1_replica1/ has no replicas
   [junit4]   2> 863052 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 863053 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 863053 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 863053 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:49838/solr/onlyinzk_shard2_replica1/
   [junit4]   2> 863053 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.SyncStrategy Sync 
Success - now sync replicas to me
   [junit4]   2> 863053 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.SyncStrategy 
http://127.0.0.1:49838/solr/onlyinzk_shard2_replica1/ has no replicas
   [junit4]   2> 863053 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 863055 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:44644/solr/onlyinzk_shard1_replica1/ shard1
   [junit4]   2> 863056 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49838/solr/onlyinzk_shard2_replica1/ shard2
   [junit4]   2> 863158 INFO  
(zkCallback-1542-thread-2-processing-n:127.0.0.1:49838_solr) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 863158 INFO  
(zkCallback-1543-thread-1-processing-n:127.0.0.1:44644_solr) 
[n:127.0.0.1:44644_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 863206 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 863207 INFO  (qtp438990240-8580) [n:127.0.0.1:49838_solr 
c:onlyinzk s:shard2  x:onlyinzk_shard2_replica1] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 863208 INFO  (qtp358017157-8549) [n:127.0.0.1:44644_solr 
c:onlyinzk s:shard1  x:onlyinzk_shard1_replica1] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores params={qt=/admin/cores&collection.co

[...truncated too long message...]

in.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:171)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:747)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:728)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:509)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 908308 INFO  (qtp358017157-8552) [n:127.0.0.1:44644_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={nodeName=127.0.0.1:44644_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica2&coreNodeName=core_node7&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
 status=400 QTime=23037
   [junit4]   2> 909758 WARN  
(zkCallback-1539-thread-5-processing-n:127.0.0.1:34210_solr) 
[n:127.0.0.1:34210_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 909758 INFO  (jetty-closer-1521-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 909759 INFO  (jetty-closer-1521-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5ff49f9{/solr,null,UNAVAILABLE}
   [junit4]   2> 909760 WARN  
(zkCallback-1542-thread-8-processing-n:127.0.0.1:49838_solr) 
[n:127.0.0.1:49838_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 909760 WARN  
(zkCallback-1541-thread-8-processing-n:127.0.0.1:40785_solr) 
[n:127.0.0.1:40785_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 909760 INFO  (jetty-closer-1521-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 909760 INFO  (jetty-closer-1521-thread-3) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 909760 INFO  (jetty-closer-1521-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@32966db9{/solr,null,UNAVAILABLE}
   [junit4]   2> 909760 INFO  (jetty-closer-1521-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@4b7e248{/solr,null,UNAVAILABLE}
   [junit4]   2> 909761 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:55252 55252
   [junit4]   2> 909762 INFO  (Thread-2028) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:55252 55252
   [junit4]   2> 909763 WARN  (Thread-2028) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        81      /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        61      /solr/collections
   [junit4]   2>        11      /solr/overseer/queue
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 909763 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[4520B761189B179D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4520B761189B179D-001
   [junit4]   2> Feb 22, 2017 11:21:16 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: 
codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
 chunkSize=5, maxDocsPerChunk=329, blockSize=275), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
chunkSize=5, blockSize=275)), sim=RandomSimilarity(queryNorm=true): {}, 
locale=sq-AL, timezone=Jamaica
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_121 (64-bit)/cpus=4,threads=1,free=76928088,total=516423680
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestClassicSimilarityFactory, TestSolrDynamicMBean, ZkControllerTest, 
SolrCloudExampleTest, BlockJoinFacetDistribTest, SpellCheckCollatorTest, 
TestNumericTerms32, CloudExitableDirectoryReaderTest, ConvertedLegacyTest, 
MigrateRouteKeyTest, TestCoreContainer, TestShortCircuitedRequests, 
UUIDUpdateProcessorFallbackTest, OverseerModifyCollectionTest, BufferStoreTest, 
TestFieldSortValues, JSONWriterTest, SharedFSAutoReplicaFailoverUtilsTest, 
TestFastLRUCache, TestSlowCompositeReaderWrapper, SampleTest, 
TestIntervalFaceting, TestSubQueryTransformerDistrib, 
HdfsChaosMonkeyNothingIsSafeTest, HdfsRestartWhileUpdatingTest, 
DataDrivenBlockJoinTest, SuggesterFSTTest, CdcrVersionReplicationTest, 
BadComponentTest, OpenExchangeRatesOrgProviderTest, SolrGangliaReporterTest, 
DirectSolrConnectionTest, QueryParsingTest, CachingDirectoryFactoryTest, 
DirectSolrSpellCheckerTest, ParsingFieldUpdateProcessorsTest, 
DistributedFacetPivotWhiteBoxTest, ShardRoutingTest, 
VMParamsZkACLAndCredentialsProvidersTest, TestFuzzyAnalyzedSuggestions, 
CdcrReplicationDistributedZkTest, CSVRequestHandlerTest, MetricsHandlerTest, 
TestStressRecovery, TestDocTermOrds, TestElisionMultitermQuery, 
TestLeaderInitiatedRecoveryThread, TestTestInjection, StatsReloadRaceTest, 
TestXIncludeConfig, PKIAuthenticationIntegrationTest, TestSmileRequest, 
TestDistribIDF, TestCloudDeleteByQuery, TestFieldCacheVsDocValues, 
ClassificationUpdateProcessorFactoryTest, UpdateRequestProcessorFactoryTest, 
TestOnReconnectListenerSupport, ShardRoutingCustomTest, SaslZkACLProviderTest, 
OverseerTaskQueueTest, TestUseDocValuesAsStored2, TestCloudSchemaless, 
SoftAutoCommitTest, IndexSchemaRuntimeFieldTest, AlternateDirectoryTest, 
ZkSolrClientTest, GraphQueryTest, DistributedSuggestComponentTest, 
TestConfigSetsAPIZkFailure, DeleteLastCustomShardedReplicaTest, 
TestSolrIndexConfig, TestTolerantUpdateProcessorRandomCloud, TestCharFilters, 
TestRequestStatusCollectionAPI, SortByFunctionTest, TestExpandComponent, 
SpatialFilterTest, MoreLikeThisHandlerTest, TestDistributedGrouping, 
DistributedIntervalFacetingTest, ChaosMonkeySafeLeaderTest, RulesTest, 
BasicFunctionalityTest, TestRuleBasedAuthorizationPlugin, SolrInfoMBeanTest, 
TestBM25SimilarityFactory, LeaderFailureAfterFreshStartTest, 
CloneFieldUpdateProcessorFactoryTest, ReplicaListTransformerTest, 
TestPerFieldSimilarity, SimplePostToolTest, TestJsonRequest, 
TestManagedSchemaAPI, TestLRUStatsCache, ZkCLITest, TestRestManager, 
OutOfBoxZkACLAndCredentialsProvidersTest, SpellCheckComponentTest, 
SolrCmdDistributorTest, TestPostingsSolrHighlighter, TestSystemIdResolver, 
TestSchemaManager, ZkStateWriterTest, TestUpdate, TestQueryUtils, 
CreateCollectionCleanupTest, SparseHLLTest, JsonLoaderTest, 
TestDynamicFieldResource, TestSolrCloudWithKerberosAlt, TestReqParamsAPI, 
BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed [346/693 (1!)] on J1 in 89.70s, 20 tests, 1 failure <<< 
FAILURES!

[...truncated 63691 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to