Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.5/15/

1 tests failed.
FAILED:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Could not find expected core.properties file

Stack Trace:
java.lang.AssertionError: Could not find expected core.properties file
        at 
__randomizedtesting.SeedInfo.seed([14E423DEAEC7C759:5C91576AA8F4E8CC]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:552)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11302 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/init-core-data-001
   [junit4]   2> 504626 WARN  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 504626 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 504627 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 504629 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001
   [junit4]   2> 504630 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 504631 INFO  (Thread-505) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 504631 INFO  (Thread-505) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 504731 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:39921
   [junit4]   2> 504742 INFO  (jetty-launcher-254-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 504744 INFO  (jetty-launcher-254-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 504746 INFO  (jetty-launcher-254-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 504747 INFO  (jetty-launcher-254-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 504749 INFO  (jetty-launcher-254-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7391517a{/solr,null,AVAILABLE}
   [junit4]   2> 504750 INFO  (jetty-launcher-254-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@fe83aab{SSL,[ssl, 
http/1.1]}{127.0.0.1:45438}
   [junit4]   2> 504750 INFO  (jetty-launcher-254-thread-2) [    ] 
o.e.j.s.Server Started @511027ms
   [junit4]   2> 504750 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45438}
   [junit4]   2> 504751 ERROR (jetty-launcher-254-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 504751 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.1
   [junit4]   2> 504751 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 504751 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 504757 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-04-09T18:50:39.248Z
   [junit4]   2> 504768 INFO  (jetty-launcher-254-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4bed526d{/solr,null,AVAILABLE}
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@76f5b849{SSL,[ssl, 
http/1.1]}{127.0.0.1:57498}
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.e.j.s.Server Started @511045ms
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=57498}
   [junit4]   2> 504769 ERROR (jetty-launcher-254-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.1
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 504769 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-04-09T18:50:39.260Z
   [junit4]   2> 504774 INFO  (jetty-launcher-254-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3682ff5e{/solr,null,AVAILABLE}
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@54c56458{SSL,[ssl, 
http/1.1]}{127.0.0.1:58525}
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.e.j.s.Server Started @511051ms
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=58525}
   [junit4]   2> 504775 ERROR (jetty-launcher-254-thread-3) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.1
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 504775 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-04-09T18:50:39.266Z
   [junit4]   2> 504776 INFO  (jetty-launcher-254-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@47aa04fe{/solr,null,AVAILABLE}
   [junit4]   2> 504777 INFO  (jetty-launcher-254-thread-4) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@3c4b2d4e{SSL,[ssl, 
http/1.1]}{127.0.0.1:39566}
   [junit4]   2> 504777 INFO  (jetty-launcher-254-thread-4) [    ] 
o.e.j.s.Server Started @511053ms
   [junit4]   2> 504777 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39566}
   [junit4]   2> 504778 ERROR (jetty-launcher-254-thread-4) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 504778 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.1
   [junit4]   2> 504778 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 504778 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 504778 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-04-09T18:50:39.269Z
   [junit4]   2> 504827 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 504841 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 504841 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 504841 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 504842 INFO  (jetty-launcher-254-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39921/solr
   [junit4]   2> 504851 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 504852 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 504854 INFO  (jetty-launcher-254-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39921/solr
   [junit4]   2> 504855 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 505007 INFO  (jetty-launcher-254-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39921/solr
   [junit4]   2> 505017 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15b540dc0930005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 505025 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15b540dc0930004, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 505017 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 505027 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15b540dc0930006, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 505031 INFO  (jetty-launcher-254-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39921/solr
   [junit4]   2> 505049 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15b540dc0930007, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 505090 INFO  (jetty-launcher-254-thread-1) 
[n:127.0.0.1:57498_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 505117 INFO  (jetty-launcher-254-thread-3) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 505119 INFO  (jetty-launcher-254-thread-3) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:58525_solr
   [junit4]   2> 505121 INFO  (jetty-launcher-254-thread-3) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.Overseer Overseer 
(id=97764234960764938-127.0.0.1:58525_solr-n_0000000000) starting
   [junit4]   2> 505123 INFO  (jetty-launcher-254-thread-2) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 505125 INFO  (jetty-launcher-254-thread-1) 
[n:127.0.0.1:57498_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:57498_solr
   [junit4]   2> 505129 INFO  (jetty-launcher-254-thread-2) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45438_solr
   [junit4]   2> 505304 INFO  
(zkCallback-270-thread-1-processing-n:127.0.0.1:57498_solr) 
[n:127.0.0.1:57498_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 505304 INFO  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 505305 INFO  
(zkCallback-273-thread-1-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 505307 INFO  (jetty-launcher-254-thread-3) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:58525_solr
   [junit4]   2> 505309 INFO  
(zkCallback-270-thread-1-processing-n:127.0.0.1:57498_solr) 
[n:127.0.0.1:57498_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 505309 INFO  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 505310 INFO  
(zkCallback-273-thread-1-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 505351 INFO  (jetty-launcher-254-thread-4) 
[n:127.0.0.1:39566_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 505353 INFO  (jetty-launcher-254-thread-4) 
[n:127.0.0.1:39566_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 505356 INFO  (jetty-launcher-254-thread-4) 
[n:127.0.0.1:39566_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39566_solr
   [junit4]   2> 505358 INFO  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 505364 INFO  
(zkCallback-270-thread-1-processing-n:127.0.0.1:57498_solr) 
[n:127.0.0.1:57498_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 505386 INFO  
(zkCallback-277-thread-1-processing-n:127.0.0.1:39566_solr) 
[n:127.0.0.1:39566_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 505396 INFO  
(zkCallback-273-thread-3-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 505502 INFO  (jetty-launcher-254-thread-1) 
[n:127.0.0.1:57498_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node1/.
   [junit4]   2> 505547 INFO  (jetty-launcher-254-thread-2) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node2/.
   [junit4]   2> 505690 INFO  (jetty-launcher-254-thread-3) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node3/.
   [junit4]   2> 505791 INFO  (jetty-launcher-254-thread-4) 
[n:127.0.0.1:39566_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node4/.
   [junit4]   2> 506701 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 506702 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39921/solr ready
   [junit4]   2> 506732 INFO  
(TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testTooManyReplicas
   [junit4]   2> 506733 INFO  
(TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[14E423DEAEC7C759])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 506816 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=10&collection.configName=conf&name=collection&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 506820 INFO  
(OverseerThreadFactory-880-thread-1-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
collection
   [junit4]   2> 506821 WARN  
(OverseerThreadFactory-880-thread-1-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.CreateCollectionCmd Specified 
replicationFactor of 10 on collection collection is higher than or equal to the 
number of Solr instances currently live or live and part of your 
createNodeSet(4). It's unusual to run two replica of the same slice on the same 
Solr-instance.
   [junit4]   2> 506822 ERROR 
(OverseerThreadFactory-880-thread-1-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
Collection: collection operation: create 
failed:org.apache.solr.common.SolrException: Cannot create collection 
collection. Value of maxShardsPerNode is 1, and the number of nodes currently 
live or live and part of your createNodeSet is 4. This allows a maximum of 4 to 
be created. Value of numShards is 2 and value of replicationFactor is 10. This 
requires 20 shards to be created (higher than the allowed number)
   [junit4]   2>        at 
org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:155)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 506849 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=10&collection.configName=conf&name=collection&action=CREATE&numShards=2&wt=javabin&version=2}
 status=400 QTime=32
   [junit4]   2> 506849 INFO  
(TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
   [junit4]   2> 506850 INFO  
(OverseerCollectionConfigSetProcessor-97764234960764938-127.0.0.1:58525_solr-n_0000000000)
 [n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 506877 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoConfigSetExist-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoConfigSetExist
   [junit4]   2> 506878 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoConfigSetExist-seed#[14E423DEAEC7C759])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 506883 INFO  (qtp1905047565-1822) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-002&collection.configName=conf123&name=corewithnocollection3&action=CREATE&numShards=1&collection=&wt=javabin&version=2
   [junit4]   2> 506886 INFO  
(OverseerStateUpdate-97764234960764938-127.0.0.1:58525_solr-n_0000000000) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 507891 ERROR (qtp1905047565-1822) [n:127.0.0.1:58525_solr 
c:corewithnocollection3   x:corewithnocollection3] o.a.s.c.c.ZkStateReader 
Specified config=[conf123] does not exist in ZooKeeper at 
location=[/configs/conf123]
   [junit4]   2> 507901 ERROR (qtp1905047565-1822) [n:127.0.0.1:58525_solr 
c:corewithnocollection3   x:corewithnocollection3] o.a.s.h.RequestHandlerBase 
org.apache.solr.common.SolrException: Error CREATEing SolrCore 
'corewithnocollection3': Unable to create core [corewithnocollection3] Caused 
by: Specified config does not exist in ZooKeeper: conf123
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:888)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:370)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Unable to 
create core [corewithnocollection3]
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:933)
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:854)
   [junit4]   2>        ... 37 more
   [junit4]   2> Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
Specified config does not exist in ZooKeeper: conf123
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.readConfigName(ZkStateReader.java:189)
   [junit4]   2>        at 
org.apache.solr.cloud.CloudConfigSetService.createCoreResourceLoader(CloudConfigSetService.java:54)
   [junit4]   2>        at 
org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:74)
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:915)
   [junit4]   2>        ... 38 more
   [junit4]   2> 
   [junit4]   2> 507901 INFO  (qtp1905047565-1822) [n:127.0.0.1:58525_solr 
c:corewithnocollection3   x:corewithnocollection3] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-002&collection.configName=conf123&name=corewithnocollection3&action=CREATE&numShards=1&collection=&wt=javabin&version=2}
 status=400 QTime=1018
   [junit4]   2> 508920 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 508921 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 508924 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoConfigSetExist-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoConfigSetExist
   [junit4]   2> 509157 INFO  
(TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testMaxNodesPerShard
   [junit4]   2> 509158 INFO  
(TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[14E423DEAEC7C759])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 509162 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=corewithnocollection3&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 509182 INFO  
(OverseerThreadFactory-880-thread-2-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 509904 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=corewithnocollection3&action=DELETE&wt=javabin&version=2} status=0 
QTime=741
   [junit4]   2> 509909 INFO  (qtp1905047565-1819) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&name=oversharded&action=CREATE&numShards=3&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 509985 INFO  
(OverseerCollectionConfigSetProcessor-97764234960764938-127.0.0.1:58525_solr-n_0000000000)
 [n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 509986 INFO  
(OverseerThreadFactory-880-thread-3-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
oversharded
   [junit4]   2> 509987 ERROR 
(OverseerThreadFactory-880-thread-3-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
Collection: oversharded operation: create 
failed:org.apache.solr.common.SolrException: Cannot create collection 
oversharded. Value of maxShardsPerNode is 1, and the number of nodes currently 
live or live and part of your createNodeSet is 4. This allows a maximum of 4 to 
be created. Value of numShards is 3 and value of replicationFactor is 2. This 
requires 6 shards to be created (higher than the allowed number)
   [junit4]   2>        at 
org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:155)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:224)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:463)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 509996 INFO  (qtp1905047565-1819) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=2&collection.configName=conf&name=oversharded&action=CREATE&numShards=3&wt=javabin&version=2}
 status=400 QTime=87
   [junit4]   2> 509997 INFO  
(TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testMaxNodesPerShard
   [junit4]   2> 510061 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoCollectionSpecified
   [junit4]   2> 510063 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[14E423DEAEC7C759])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 510066 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-003&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2
   [junit4]   2> 510068 INFO  
(OverseerStateUpdate-97764234960764938-127.0.0.1:58525_solr-n_0000000000) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 511105 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.1
   [junit4]   2> 511124 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema 
[corewithnocollection] Schema name=minimal
   [junit4]   2> 511127 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 511128 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.CoreContainer Creating 
SolrCore 'corewithnocollection' using configuration from collection 
corewithnocollection
   [junit4]   2> 511129 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 511129 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
[[corewithnocollection] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node3/corewithnocollection],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-003/]
   [junit4]   2> 511419 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 511419 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 511420 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 511420 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 511428 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@26c9793f[corewithnocollection] main]
   [junit4]   2> 511430 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 511431 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 511431 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 511431 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1564227766501507072
   [junit4]   2> 511437 INFO  
(searcherExecutor-889-thread-1-processing-n:127.0.0.1:58525_solr 
x:corewithnocollection c:corewithnocollection) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
[corewithnocollection] Registered new searcher 
Searcher@26c9793f[corewithnocollection] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 511547 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 511547 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 511547 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync 
replicas to https://127.0.0.1:58525/solr/corewithnocollection/
   [junit4]   2> 511547 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync 
Success - now sync replicas to me
   [junit4]   2> 511548 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy 
https://127.0.0.1:58525/solr/corewithnocollection/ has no replicas
   [junit4]   2> 511548 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 511557 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:58525/solr/corewithnocollection/ shard1
   [junit4]   2> 511708 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 511711 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr 
c:corewithnocollection   x:corewithnocollection] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-003&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2}
 status=0 QTime=1644
   [junit4]   2> 511713 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-003&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2
   [junit4]   2> 511719 INFO  
(OverseerStateUpdate-97764234960764938-127.0.0.1:58525_solr-n_0000000000) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 512038 INFO  
(OverseerCollectionConfigSetProcessor-97764234960764938-127.0.0.1:58525_solr-n_0000000000)
 [n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 512741 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.1
   [junit4]   2> 512812 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema 
[corewithnocollection2] Schema name=minimal
   [junit4]   2> 512905 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 512907 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.CoreContainer 
Creating SolrCore 'corewithnocollection2' using configuration from collection 
corewithnocollection2
   [junit4]   2> 512907 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 512908 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
[[corewithnocollection2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node3/corewithnocollection2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-003/]
   [junit4]   2> 513327 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 513327 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 513328 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 513328 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 513336 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@5e3ebe30[corewithnocollection2] main]
   [junit4]   2> 513339 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 513339 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 513340 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 513340 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1564227768503238656
   [junit4]   2> 513342 INFO  
(searcherExecutor-894-thread-1-processing-n:127.0.0.1:58525_solr 
x:corewithnocollection2 c:corewithnocollection2) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
[corewithnocollection2] Registered new searcher 
Searcher@5e3ebe30[corewithnocollection2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 513360 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 513360 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 513361 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync 
replicas to https://127.0.0.1:58525/solr/corewithnocollection2/
   [junit4]   2> 513361 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync 
Success - now sync replicas to me
   [junit4]   2> 513361 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy 
https://127.0.0.1:58525/solr/corewithnocollection2/ has no replicas
   [junit4]   2> 513361 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 513368 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:58525/solr/corewithnocollection2/ shard1
   [junit4]   2> 513519 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ZkController I am 
the leader, no recovery necessary
   [junit4]   2> 513522 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr 
c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-003&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=1808
   [junit4]   2> 513523 INFO  
(TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoCollectionSpecified
   [junit4]   2> 513590 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateShouldFailOnExistingCore
   [junit4]   2> 513591 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[14E423DEAEC7C759])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 513595 INFO  (qtp1905047565-1822) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=corewithnocollection&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 513697 INFO  
(OverseerThreadFactory-880-thread-4-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 513817 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection
   [junit4]   2> 513817 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.c.SolrCore [corewithnocollection]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@49430f86
   [junit4]   2> 513876 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection
   [junit4]   2> 513879 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=corewithnocollection&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=63
   [junit4]   2> 514709 INFO  (qtp1905047565-1822) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=corewithnocollection&action=DELETE&wt=javabin&version=2} status=0 
QTime=1113
   [junit4]   2> 514712 INFO  (qtp1905047565-1818) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
name=corewithnocollection2&action=DELETE&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 514715 INFO  
(OverseerCollectionConfigSetProcessor-97764234960764938-127.0.0.1:58525_solr-n_0000000000)
 [n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 514716 INFO  
(OverseerThreadFactory-880-thread-5-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 514720 INFO  (qtp1905047565-1816) [n:127.0.0.1:58525_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection2
   [junit4]   2> 514721 INFO  (qtp1905047565-1816) [n:127.0.0.1:58525_solr    ] 
o.a.s.c.SolrCore [corewithnocollection2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@c6f2da5
   [junit4]   2> 514750 INFO  (qtp1905047565-1816) [n:127.0.0.1:58525_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.corewithnocollection2
   [junit4]   2> 514752 INFO  (qtp1905047565-1816) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=corewithnocollection2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=33
   [junit4]   2> 515643 INFO  (qtp1905047565-1818) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={name=corewithnocollection2&action=DELETE&wt=javabin&version=2} status=0 
QTime=931
   [junit4]   2> 515768 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-004&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker&wt=javabin&version=2
   [junit4]   2> 515771 INFO  
(OverseerStateUpdate-97764234960764938-127.0.0.1:58525_solr-n_0000000000) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 516717 INFO  
(OverseerCollectionConfigSetProcessor-97764234960764938-127.0.0.1:58525_solr-n_0000000000)
 [n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 516795 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.1
   [junit4]   2> 516846 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema 
[halfcollection_shard1_replica1] Schema name=minimal
   [junit4]   2> 516869 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 516871 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica1' using 
configuration from collection halfcollectionblocker
   [junit4]   2> 516871 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 516871 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[[halfcollection_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node1/halfcollection_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-004/]
   [junit4]   2> 516973 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 516973 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 516974 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 516974 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 516975 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@3d29fb9c[halfcollection_shard1_replica1] main]
   [junit4]   2> 516977 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 516977 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 516977 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 516978 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1564227772317958144
   [junit4]   2> 516988 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 516988 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 516988 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:57498/solr/halfcollection_shard1_replica1/
   [junit4]   2> 516988 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 516988 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy 
https://127.0.0.1:57498/solr/halfcollection_shard1_replica1/ has no replicas
   [junit4]   2> 516988 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 516989 INFO  
(searcherExecutor-899-thread-1-processing-n:127.0.0.1:57498_solr 
x:halfcollection_shard1_replica1 c:halfcollectionblocker) 
[n:127.0.0.1:57498_solr c:halfcollectionblocker   
x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[halfcollection_shard1_replica1] Registered new searcher 
Searcher@3d29fb9c[halfcollection_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 516995 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:57498/solr/halfcollection_shard1_replica1/ shard1
   [junit4]   2> 517128 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 517132 INFO  (qtp2065013188-1802) [n:127.0.0.1:57498_solr 
c:halfcollectionblocker   x:halfcollection_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-004&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker&wt=javabin&version=2}
 status=0 QTime=1364
   [junit4]   2> 517216 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-005&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker2&wt=javabin&version=2
   [junit4]   2> 517218 INFO  
(OverseerStateUpdate-97764234960764938-127.0.0.1:58525_solr-n_0000000000) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 518246 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.1
   [junit4]   2> 518366 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.IndexSchema [halfcollection_shard1_replica1] Schema name=minimal
   [junit4]   2> 518372 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 518374 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica1' using 
configuration from collection halfcollectionblocker2
   [junit4]   2> 518374 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 518374 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[[halfcollection_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node2/halfcollection_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-005/]
   [junit4]   2> 518647 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 518647 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 518649 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 518649 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 518651 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@39f2984d[halfcollection_shard1_replica1] main]
   [junit4]   2> 518654 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 518655 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 518655 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 518655 INFO  
(searcherExecutor-904-thread-1-processing-n:127.0.0.1:45438_solr 
x:halfcollection_shard1_replica1 c:halfcollectionblocker2) 
[n:127.0.0.1:45438_solr c:halfcollectionblocker2   
x:halfcollection_shard1_replica1] o.a.s.c.SolrCore 
[halfcollection_shard1_replica1] Registered new searcher 
Searcher@39f2984d[halfcollection_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 518656 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1564227774077468672
   [junit4]   2> 518666 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 518666 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 518666 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45438/solr/halfcollection_shard1_replica1/
   [junit4]   2> 518666 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 518666 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.SyncStrategy 
https://127.0.0.1:45438/solr/halfcollection_shard1_replica1/ has no replicas
   [junit4]   2> 518666 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 518672 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:45438/solr/halfcollection_shard1_replica1/ shard1
   [junit4]   2> 518823 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 518831 INFO  (qtp625673861-1791) [n:127.0.0.1:45438_solr 
c:halfcollectionblocker2   x:halfcollection_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-005&collection.configName=conf&name=halfcollection_shard1_replica1&action=CREATE&numShards=1&collection=halfcollectionblocker2&wt=javabin&version=2}
 status=0 QTime=1615
   [junit4]   2> 518835 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf&name=halfcollection&action=CREATE&numShards=2&createNodeSet=127.0.0.1:57498_solr,127.0.0.1:45438_solr&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 518857 INFO  
(OverseerThreadFactory-880-thread-5-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
halfcollection
   [junit4]   2> 519126 INFO  (qtp2065013188-1800) [n:127.0.0.1:57498_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 519127 WARN  (qtp2065013188-1800) [n:127.0.0.1:57498_solr    ] 
o.a.s.c.CoreContainer Creating a core with existing name is not allowed
   [junit4]   2> 519127 ERROR (qtp2065013188-1800) [n:127.0.0.1:57498_solr    ] 
o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Core with name 
'halfcollection_shard1_replica1' already exists.
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:839)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:370)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 519127 INFO  (qtp2065013188-1800) [n:127.0.0.1:57498_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2}
 status=500 QTime=1
   [junit4]   2> 519127 ERROR (qtp2065013188-1800) [n:127.0.0.1:57498_solr    ] 
o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Core with name 
'halfcollection_shard1_replica1' already exists.
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:839)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:88)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:370)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
   [junit4]   2>        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:395)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 519128 ERROR 
(OverseerThreadFactory-880-thread-5-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler Error 
from shard: https://127.0.0.1:57498/solr
   [junit4]   2> 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at https://127.0.0.1:57498/solr: Core with name 
'halfcollection_shard1_replica1' already exists.
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
   [junit4]   2>        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2>        at 
org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:163)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>        at 
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 519151 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 519285 INFO  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/halfcollection/state.json] for collection [halfcollection] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 520167 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.5.1
   [junit4]   2> 520191 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.IndexSchema [halfcollection_shard2_replica1] Schema name=minimal
   [junit4]   2> 520194 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 520222 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard2_replica1' using 
configuration from collection halfcollection
   [junit4]   2> 520223 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 520223 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.c.SolrCore 
[[halfcollection_shard2_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node2/halfcollection_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001/tempDir-001/node2/./halfcollection_shard2_replica1/data/]
   [junit4]   2> 520652 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 520652 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 520654 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 520654 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 520669 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@6a9e0020[halfcollection_shard2_replica1] main]
   [junit4]   2> 520670 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 520671 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 520671 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 520673 INFO  
(searcherExecutor-909-thread-1-processing-n:127.0.0.1:45438_solr 
x:halfcollection_shard2_replica1 s:shard2 c:halfcollection) 
[n:127.0.0.1:45438_solr c:halfcollection s:shard2  
x:halfcollection_shard2_replica1] o.a.s.c.SolrCore 
[halfcollection_shard2_replica1] Registered new searcher 
Searcher@6a9e0020[halfcollection_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 520673 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1564227776192446464
   [junit4]   2> 520686 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 520686 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 520686 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45438/solr/halfcollection_shard2_replica1/
   [junit4]   2> 520686 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 520686 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.SyncStrategy 
https://127.0.0.1:45438/solr/halfcollection_shard2_replica1/ has no replicas
   [junit4]   2> 520686 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 520694 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:45438/solr/halfcollection_shard2_replica1/ shard2
   [junit4]   2> 520795 INFO  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/halfcollection/state.json] for collection [halfcollection] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 520864 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 520893 INFO  (qtp625673861-1789) [n:127.0.0.1:45438_solr 
c:halfcollection s:shard2  x:halfcollection_shard2_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica1&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2}
 status=0 QTime=1741
   [junit4]   2> 520893 ERROR 
(OverseerThreadFactory-880-thread-5-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning 
up collection [halfcollection].
   [junit4]   2> 520894 INFO  
(OverseerThreadFactory-880-thread-5-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing 
Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 520897 INFO  (qtp625673861-1790) [n:127.0.0.1:45438_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection.shard2.replica1
   [junit4]   2> 521000 INFO  (qtp625673861-1790) [n:127.0.0.1:45438_solr    ] 
o.a.s.c.SolrCore [halfcollection_shard2_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@70baa41f
   [junit4]   2> 521002 INFO  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/halfcollection/state.json] for collection [halfcollection] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 521014 INFO  (qtp625673861-1790) [n:127.0.0.1:45438_solr    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.halfcollection.shard2.replica1
   [junit4]   2> 521024 INFO  (qtp625673861-1790) [n:127.0.0.1:45438_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={deleteInstanceDir=true&core=halfcollection_shard2_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
 status=0 QTime=127
   [junit4]   2> 521741 INFO  
(OverseerThreadFactory-880-thread-5-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.CreateCollectionCmd Cleaned up artifacts 
for failed create collection for [halfcollection]
   [junit4]   2> 521746 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 522868 INFO  
(OverseerCollectionConfigSetProcessor-97764234960764938-127.0.0.1:58525_solr-n_0000000000)
 [n:127.0.0.1:58525_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 551797 ERROR (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Timed out waiting for new collection's replicas to 
become ACTIVE with timeout=30
   [junit4]   2> 551797 INFO  (qtp1905047565-1785) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=1&collection.configName=conf&name=halfcollection&action=CREATE&numShards=2&createNodeSet=127.0.0.1:57498_solr,127.0.0.1:45438_solr&wt=javabin&version=2}
 status=0 QTime=32962
   [junit4]   2> 551798 INFO  
(TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreateShouldFailOnExistingCore
   [junit4]   2> 551842 INFO  
(TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[14E423DEAEC7C759])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteNonExistentCollection
   [junit4]   2> 551843 INFO  
(TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[14E423DEAEC7C759])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 551850 INFO  (qtp1905047565-1821) [n:127.0.0.1:58525_solr    ] 
o.a.s.h.a.CollectionsHandler Inv

[...truncated too long message...]

.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2>        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
   [junit4]   2>        at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2>        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2>        at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 619782 INFO  (qtp1905047565-1820) [n:127.0.0.1:58525_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={nodeName=127.0.0.1:57498_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica1&coreNodeName=core_node7&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
 status=400 QTime=27229
   [junit4]   2> 620467 WARN  
(zkCallback-275-thread-1-processing-n:127.0.0.1:45438_solr) 
[n:127.0.0.1:45438_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 620467 INFO  (jetty-closer-255-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 620468 INFO  (jetty-closer-255-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7391517a{/solr,null,UNAVAILABLE}
   [junit4]   2> 620489 WARN  
(zkCallback-273-thread-8-processing-n:127.0.0.1:58525_solr) 
[n:127.0.0.1:58525_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 620490 INFO  (jetty-closer-255-thread-3) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 620490 INFO  (jetty-closer-255-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3682ff5e{/solr,null,UNAVAILABLE}
   [junit4]   2> 620490 WARN  
(zkCallback-277-thread-1-processing-n:127.0.0.1:39566_solr) 
[n:127.0.0.1:39566_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 620490 INFO  (jetty-closer-255-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 620490 INFO  (jetty-closer-255-thread-4) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@47aa04fe{/solr,null,UNAVAILABLE}
   [junit4]   2> 620494 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:39921 39921
   [junit4]   2> 620594 INFO  (Thread-505) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:39921 39921
   [junit4]   2> 620595 WARN  (Thread-505) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        25      /solr/aliases.json
   [junit4]   2>        23      /solr/configs/conf
   [junit4]   2>        5       /solr/configs/conf2
   [junit4]   2>        4       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        131     /solr/clusterstate.json
   [junit4]   2>        25      /solr/clusterprops.json
   [junit4]   2>        5       
/solr/collections/awhollynewcollection_0/state.json
   [junit4]   2>        4       
/solr/collections/nodes_used_collection/state.json
   [junit4]   2>        4       /solr/collections/addReplicaColl/state.json
   [junit4]   2>        4       /solr/collections/reloaded_collection/state.json
   [junit4]   2>        3       
/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/leader_elect/shard4/election/97764234960764939-core_node19-n_0000000001
   [junit4]   2>        2       /solr/collections/onlyinzk/state.json
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/leader_elect/shard1/election/97764234960764939-core_node20-n_0000000001
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/leader_elect/shard3/election/97764234960764939-core_node16-n_0000000001
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/leader_elect/shard5/election/97764234960764936-core_node3-n_0000000001
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/leader_elect/shard4/election/97764234960764936-core_node7-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/97764234960764938-127.0.0.1:58525_solr-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/97764234960764936-127.0.0.1:57498_solr-n_0000000001
   [junit4]   2>        2       
/solr/collections/awhollynewcollection_0/leader_elect/shard3/election/97764234960764940-core_node14-n_0000000000
   [junit4]   2>        2       
/solr/collections/halfdeletedcollection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        394     /solr/collections
   [junit4]   2>        109     /solr/overseer/queue
   [junit4]   2>        56      /solr/overseer/collection-queue-work
   [junit4]   2>        25      /solr/live_nodes
   [junit4]   2>        16      /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 620596 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[14E423DEAEC7C759]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.5/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_14E423DEAEC7C759-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {}, 
docValues:{}, maxPointsInLeafNode=2037, maxMBSortInHeap=7.498367022715485, 
sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=mt, 
timezone=Asia/Tehran
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_121 (64-bit)/cpus=4,threads=1,free=118569512,total=440401920
   [junit4]   2> NOTE: All tests run in this JVM: [AddBlockUpdateTest, 
OpenCloseCoreStressTest, SimplePostToolTest, DistributedTermsComponentTest, 
TestConfigsApi, TestSolrCloudWithSecureImpersonation, TestQueryUtils, 
ConnectionReuseTest, ConfigureRecoveryStrategyTest, DistribCursorPagingTest, 
TestLRUCache, SparseHLLTest, TestSolr4Spatial2, BasicFunctionalityTest, 
IndexSchemaTest, TestBackupRepositoryFactory, 
CloneFieldUpdateProcessorFactoryTest, TestBinaryResponseWriter, 
DistributedIntervalFacetingTest, TestSchemaVersionResource, 
URLClassifyProcessorTest, TestAddFieldRealTimeGet, TestTrie, TestLRUStatsCache, 
HdfsSyncSliceTest, TermVectorComponentTest, EchoParamsTest, DocValuesTest, 
ResponseHeaderTest, BufferStoreTest, TestSubQueryTransformerCrossCore, 
ZkControllerTest, SuggestComponentContextFilterQueryTest, DocumentBuilderTest, 
ChaosMonkeySafeLeaderTest, TestSlowCompositeReaderWrapper, 
TestGeoJSONResponseWriter, TestSolrCoreSnapshots, TestExpandComponent, 
TestManagedResourceStorage, TestTestInjection, TestReRankQParserPlugin, 
TestSolrQueryParserResource, CollectionsAPIDistributedZkTest]
   [junit4] Completed [110/701 (1!)] on J1 in 116.00s, 20 tests, 1 failure <<< 
FAILURES!

[...truncated 64620 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to