FYI, I disabled the 6.6 jobs on Policeman Jenkins. 

--
Steve
www.lucidworks.com

> On Sep 8, 2017, at 2:40 AM, Policeman Jenkins Server <[email protected]> 
> wrote:
> 
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.6-Linux/155/
> Java: 32bit/jdk1.8.0_144 -server -XX:+UseConcMarkSweepGC
> 
> 1 tests failed.
> FAILED:  
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
> 
> Error Message:
> Something is broken in the assert for no shards using the same indexDir - 
> probably something was changed in the attributes published in the MBean of 
> SolrCore : {}
> 
> Stack Trace:
> java.lang.AssertionError: Something is broken in the assert for no shards 
> using the same indexDir - probably something was changed in the attributes 
> published in the MBean of SolrCore : {}
>       at 
> __randomizedtesting.SeedInfo.seed([10ECD6E9979EF149:5899A25D91ADDEDC]:0)
>       at org.junit.Assert.fail(Assert.java:93)
>       at org.junit.Assert.assertTrue(Assert.java:43)
>       at 
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkNoTwoShardsUseTheSameIndexDir(CollectionsAPIDistributedZkTest.java:646)
>       at 
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:524)
>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>       at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>       at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>       at java.lang.reflect.Method.invoke(Method.java:498)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
>       at 
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>       at 
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>       at 
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>       at 
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>       at 
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>       at 
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>       at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>       at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
>       at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>       at 
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>       at 
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>       at 
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>       at 
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>       at 
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>       at 
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>       at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>       at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>       at java.lang.Thread.run(Thread.java:748)
> 
> 
> 
> 
> Build Log:
> [...truncated 11795 lines...]
>   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
>   [junit4]   2> Creating dataDir: 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/init-core-data-001
>   [junit4]   2> 685774 WARN  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
>   [junit4]   2> 685774 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.SolrTestCaseJ4 Using TrieFields
>   [junit4]   2> 685776 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
> @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, 
> clientAuth=NaN)
>   [junit4]   2> 685776 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001
>   [junit4]   2> 685777 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
>   [junit4]   2> 685777 INFO  (Thread-2062) [    ] o.a.s.c.ZkTestServer client 
> port:0.0.0.0/0.0.0.0:0
>   [junit4]   2> 685777 INFO  (Thread-2062) [    ] o.a.s.c.ZkTestServer 
> Starting server
>   [junit4]   2> 685779 ERROR (Thread-2062) [    ] o.a.z.s.ZooKeeperServer 
> ZKShutdownHandler is not registered, so ZooKeeper server won't take any 
> action on ERROR or SHUTDOWN server state changes
>   [junit4]   2> 685877 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.c.ZkTestServer start zk server on port:35215
>   [junit4]   2> 685884 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.e.j.s.Server jetty-9.3.14.v20161028
>   [junit4]   2> 685884 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.e.j.s.Server jetty-9.3.14.v20161028
>   [junit4]   2> 685884 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.e.j.s.Server jetty-9.3.14.v20161028
>   [junit4]   2> 685884 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.e.j.s.Server jetty-9.3.14.v20161028
>   [junit4]   2> 685887 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.e.j.s.h.ContextHandler Started 
> o.e.j.s.ServletContextHandler@d33289{/solr,null,AVAILABLE}
>   [junit4]   2> 685887 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.e.j.s.h.ContextHandler Started 
> o.e.j.s.ServletContextHandler@14d14d6{/solr,null,AVAILABLE}
>   [junit4]   2> 685887 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.e.j.s.h.ContextHandler Started 
> o.e.j.s.ServletContextHandler@aa7053{/solr,null,AVAILABLE}
>   [junit4]   2> 685887 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.e.j.s.h.ContextHandler Started 
> o.e.j.s.ServletContextHandler@532f3e{/solr,null,AVAILABLE}
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.e.j.s.AbstractConnector Started 
> ServerConnector@c0126a{HTTP/1.1,[http/1.1]}{127.0.0.1:44953}
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.e.j.s.AbstractConnector Started 
> ServerConnector@1b544b{HTTP/1.1,[http/1.1]}{127.0.0.1:36015}
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.e.j.s.Server Started @687456ms
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.e.j.s.Server Started @687456ms
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
> hostPort=44953}
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
> hostPort=36015}
>   [junit4]   2> 685892 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.e.j.s.AbstractConnector Started 
> ServerConnector@e2d0a8{HTTP/1.1,[http/1.1]}{127.0.0.1:43097}
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.e.j.s.Server Started @687456ms
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.e.j.s.AbstractConnector Started 
> ServerConnector@f16dfc{HTTP/1.1,[http/1.1]}{127.0.0.1:40553}
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
> hostPort=43097}
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.e.j.s.Server Started @687456ms
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
> hostPort=40553}
>   [junit4]   2> 685893 ERROR (jetty-launcher-909-thread-1) [    ] 
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
> missing or incomplete.
>   [junit4]   2> 685893 ERROR (jetty-launcher-909-thread-4) [    ] 
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
> missing or incomplete.
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
> 6.6.2
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
> 6.6.2
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port 
> null
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port 
> null
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
> 2017-09-08T06:09:45.372Z
>   [junit4]   2> 685893 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
> 2017-09-08T06:09:45.372Z
>   [junit4]   2> 685893 ERROR (jetty-launcher-909-thread-3) [    ] 
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
> missing or incomplete.
>   [junit4]   2> 685893 ERROR (jetty-launcher-909-thread-2) [    ] 
> o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
> missing or incomplete.
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
> 6.6.2
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
> 6.6.2
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port 
> null
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port 
> null
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
> 2017-09-08T06:09:45.373Z
>   [junit4]   2> 685894 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
> 2017-09-08T06:09:45.373Z
>   [junit4]   2> 685896 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>   [junit4]   2> 685896 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>   [junit4]   2> 685896 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>   [junit4]   2> 685896 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>   [junit4]   2> 685914 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
> params: socketTimeout=340000&connTimeout=45000&retry=true
>   [junit4]   2> 685914 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
> params: socketTimeout=340000&connTimeout=45000&retry=true
>   [junit4]   2> 685915 INFO  (jetty-launcher-909-thread-2) [    ] 
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35215/solr
>   [junit4]   2> 685915 INFO  (jetty-launcher-909-thread-4) [    ] 
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35215/solr
>   [junit4]   2> 685916 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
> params: socketTimeout=340000&connTimeout=45000&retry=true
>   [junit4]   2> 685916 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
> params: socketTimeout=340000&connTimeout=45000&retry=true
>   [junit4]   2> 685917 INFO  (jetty-launcher-909-thread-1) [    ] 
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35215/solr
>   [junit4]   2> 685918 INFO  (jetty-launcher-909-thread-3) [    ] 
> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35215/solr
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-1) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-4) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-2) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-3) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-1) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
> the leader 127.0.0.1:36015_solr
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-4) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.ZkController Register node as live in 
> ZooKeeper:/live_nodes/127.0.0.1:43097_solr
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-3) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.ZkController Register node as live in 
> ZooKeeper:/live_nodes/127.0.0.1:40553_solr
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-2) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.ZkController Register node as live in 
> ZooKeeper:/live_nodes/127.0.0.1:44953_solr
>   [junit4]   2> 685934 INFO  (jetty-launcher-909-thread-1) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.Overseer Overseer 
> (id=98621914169802763-127.0.0.1:36015_solr-n_0000000000) starting
>   [junit4]   2> 685935 INFO  
> (zkCallback-930-thread-1-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (0) -> (2)
>   [junit4]   2> 685935 INFO  
> (zkCallback-931-thread-1-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (0) -> (2)
>   [junit4]   2> 685935 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (0) -> (2)
>   [junit4]   2> 685935 INFO  
> (zkCallback-930-thread-1-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (2) -> (3)
>   [junit4]   2> 685935 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (2) -> (3)
>   [junit4]   2> 685942 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (0) -> (3)
>   [junit4]   2> 685942 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (2) -> (3)
>   [junit4]   2> 685946 INFO  (jetty-launcher-909-thread-1) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.ZkController Register node as live in 
> ZooKeeper:/live_nodes/127.0.0.1:36015_solr
>   [junit4]   2> 685946 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (3) -> (4)
>   [junit4]   2> 685947 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (3) -> (4)
>   [junit4]   2> 685949 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (3) -> (4)
>   [junit4]   2> 685949 INFO  
> (zkCallback-930-thread-1-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
> ZooKeeper... (3) -> (4)
>   [junit4]   2> 686009 INFO  (jetty-launcher-909-thread-2) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
> definitions underneath 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node2/.
>   [junit4]   2> 686009 INFO  (jetty-launcher-909-thread-1) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
> definitions underneath 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node1/.
>   [junit4]   2> 686012 INFO  (jetty-launcher-909-thread-3) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
> definitions underneath 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node3/.
>   [junit4]   2> 686034 INFO  (jetty-launcher-909-thread-4) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
> definitions underneath 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node4/.
>   [junit4]   2> 686041 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
>   [junit4]   2> 686041 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35215/solr ready
>   [junit4]   2> 686064 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Starting testMissingNumShards
>   [junit4]   2> 686064 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> 
> (4)
>   [junit4]   2> 686067 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
> replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&wt=javabin&version=2
>  and sendToOCPQueue=true
>   [junit4]   2> 686068 INFO  
> (OverseerThreadFactory-2580-thread-1-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
> acollection
>   [junit4]   2> 686068 ERROR 
> (OverseerThreadFactory-2580-thread-1-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
> Collection: acollection operation: create 
> failed:org.apache.solr.common.SolrException: numShards is a required param 
> (when using CompositeId router).
>   [junit4]   2>       at 
> org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:112)
>   [junit4]   2>       at 
> org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:226)
>   [junit4]   2>       at 
> org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
>   [junit4]   2>       at 
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>   [junit4]   2>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   [junit4]   2>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   [junit4]   2>       at java.lang.Thread.run(Thread.java:748)
>   [junit4]   2> 
>   [junit4]   2> 686070 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&wt=javabin&version=2}
>  status=400 QTime=2
>   [junit4]   2> 686070 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testMissingNumShards-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Ending testMissingNumShards
>   [junit4]   2> 686089 INFO  
> (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Starting 
> deleteCollectionRemovesStaleZkCollectionsNode
>   [junit4]   2> 686089 INFO  
> (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> 
> (4)
>   [junit4]   2> 686091 INFO  (qtp32442172-6468) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
> name=out_of_sync_collection&action=DELETE&wt=javabin&version=2 and 
> sendToOCPQueue=true
>   [junit4]   2> 686092 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 686093 INFO  (qtp32442172-6468) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={name=out_of_sync_collection&action=DELETE&wt=javabin&version=2} 
> status=0 QTime=1
>   [junit4]   2> 686095 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
> action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
>   [junit4]   2> 686095 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={action=LIST&wt=javabin&version=2} status=0 QTime=0
>   [junit4]   2> 686095 INFO  
> (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Ending 
> deleteCollectionRemovesStaleZkCollectionsNode
>   [junit4]   2> 686110 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Starting testMaxNodesPerShard
>   [junit4]   2> 686111 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> 
> (4)
>   [junit4]   2> 686113 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
> replicationFactor=2&collection.configName=conf&name=oversharded&action=CREATE&numShards=3&wt=javabin&version=2
>  and sendToOCPQueue=true
>   [junit4]   2> 686114 INFO  
> (OverseerThreadFactory-2580-thread-3-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
> oversharded
>   [junit4]   2> 686114 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 686114 ERROR 
> (OverseerThreadFactory-2580-thread-3-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
> Collection: oversharded operation: create 
> failed:org.apache.solr.common.SolrException: Cannot create collection 
> oversharded. Value of maxShardsPerNode is 1, and the number of nodes 
> currently live or live and part of your createNodeSet is 4. This allows a 
> maximum of 4 to be created. Value of numShards is 3 and value of 
> replicationFactor is 2. This requires 6 shards to be created (higher than the 
> allowed number)
>   [junit4]   2>       at 
> org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:155)
>   [junit4]   2>       at 
> org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:226)
>   [junit4]   2>       at 
> org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
>   [junit4]   2>       at 
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>   [junit4]   2>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   [junit4]   2>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   [junit4]   2>       at java.lang.Thread.run(Thread.java:748)
>   [junit4]   2> 
>   [junit4]   2> 686115 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={replicationFactor=2&collection.configName=conf&name=oversharded&action=CREATE&numShards=3&wt=javabin&version=2}
>  status=400 QTime=2
>   [junit4]   2> 686116 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Ending testMaxNodesPerShard
>   [junit4]   2> 686131 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Starting testCoresAreDistributedAcrossNodes
>   [junit4]   2> 686132 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> 
> (4)
>   [junit4]   2> 686133 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
> replicationFactor=2&collection.configName=conf&name=nodes_used_collection&action=CREATE&numShards=2&wt=javabin&version=2
>  and sendToOCPQueue=true
>   [junit4]   2> 686134 INFO  
> (OverseerThreadFactory-2580-thread-4-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
> nodes_used_collection
>   [junit4]   2> 686134 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 686239 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CoreAdminOperation core create command 
> qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2
>   [junit4]   2> 686239 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr    ] 
> o.a.s.h.a.CoreAdminOperation core create command 
> qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2
>   [junit4]   2> 686239 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr    ] 
> o.a.s.h.a.CoreAdminOperation core create command 
> qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2
>   [junit4]   2> 686239 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr    ] 
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
> 2147483647 transient cores
>   [junit4]   2> 686239 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr    ] 
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
> 2147483647 transient cores
>   [junit4]   2> 686239 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr    ] 
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
> 2147483647 transient cores
>   [junit4]   2> 686239 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr    ] 
> o.a.s.h.a.CoreAdminOperation core create command 
> qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2
>   [junit4]   2> 686240 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr    ] 
> o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
> 2147483647 transient cores
>   [junit4]   2> 686343 INFO  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 686343 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 686343 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 686344 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687269 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.2
>   [junit4]   2> 687269 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.2
>   [junit4]   2> 687270 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.2
>   [junit4]   2> 687270 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.2
>   [junit4]   2> 687291 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.s.IndexSchema [nodes_used_collection_shard1_replica2] Schema 
> name=minimal
>   [junit4]   2> 687292 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.s.IndexSchema [nodes_used_collection_shard2_replica1] Schema 
> name=minimal
>   [junit4]   2> 687293 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
>   [junit4]   2> 687293 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.c.CoreContainer Creating SolrCore 
> 'nodes_used_collection_shard1_replica2' using configuration from collection 
> nodes_used_collection, trusted=true
>   [junit4]   2> 687296 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.s.IndexSchema [nodes_used_collection_shard2_replica2] Schema 
> name=minimal
>   [junit4]   2> 687296 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 687296 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.c.SolrCore [[nodes_used_collection_shard1_replica2] ] Opening new 
> SolrCore at 
> [/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node1/nodes_used_collection_shard1_replica2],
>  
> dataDir=[/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node1/./nodes_used_collection_shard1_replica2/data/]
>   [junit4]   2> 687296 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
>   [junit4]   2> 687296 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.c.CoreContainer Creating SolrCore 
> 'nodes_used_collection_shard2_replica1' using configuration from collection 
> nodes_used_collection, trusted=true
>   [junit4]   2> 687297 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 687297 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.c.SolrCore [[nodes_used_collection_shard2_replica1] ] Opening new 
> SolrCore at 
> [/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node2/nodes_used_collection_shard2_replica1],
>  
> dataDir=[/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node2/./nodes_used_collection_shard2_replica1/data/]
>   [junit4]   2> 687297 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.s.IndexSchema [nodes_used_collection_shard1_replica1] Schema 
> name=minimal
>   [junit4]   2> 687298 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
>   [junit4]   2> 687298 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.CoreContainer Creating SolrCore 
> 'nodes_used_collection_shard2_replica2' using configuration from collection 
> nodes_used_collection, trusted=true
>   [junit4]   2> 687298 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 687298 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.SolrCore [[nodes_used_collection_shard2_replica2] ] Opening new 
> SolrCore at 
> [/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node4/nodes_used_collection_shard2_replica2],
>  
> dataDir=[/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node4/./nodes_used_collection_shard2_replica2/data/]
>   [junit4]   2> 687301 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
>   [junit4]   2> 687301 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.CoreContainer Creating SolrCore 
> 'nodes_used_collection_shard1_replica1' using configuration from collection 
> nodes_used_collection, trusted=true
>   [junit4]   2> 687302 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
>   [junit4]   2> 687302 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.SolrCore [[nodes_used_collection_shard1_replica1] ] Opening new 
> SolrCore at 
> [/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node3/nodes_used_collection_shard1_replica1],
>  
> dataDir=[/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node3/./nodes_used_collection_shard1_replica1/data/]
>   [junit4]   2> 687343 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.u.UpdateHandler Using UpdateLog implementation: 
> org.apache.solr.update.UpdateLog
>   [junit4]   2> 687343 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 687343 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.UpdateHandler Using UpdateLog implementation: 
> org.apache.solr.update.UpdateLog
>   [junit4]   2> 687343 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 687343 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 687343 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 687344 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 687344 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 687344 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.s.SolrIndexSearcher Opening 
> [Searcher@159f411[nodes_used_collection_shard1_replica2] main]
>   [junit4]   2> 687344 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.s.SolrIndexSearcher Opening 
> [Searcher@fd430d[nodes_used_collection_shard1_replica1] main]
>   [junit4]   2> 687345 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
> /configs/conf
>   [junit4]   2> 687345 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
> /configs/conf
>   [junit4]   2> 687345 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
> ZooKeeperStorageIO:path=/configs/conf
>   [junit4]   2> 687345 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.h.ReplicationHandler Commits will be reserved for  10000
>   [junit4]   2> 687346 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
> ZooKeeperStorageIO:path=/configs/conf
>   [junit4]   2> 687346 INFO  
> (searcherExecutor-2592-thread-1-processing-n:127.0.0.1:40553_solr 
> x:nodes_used_collection_shard1_replica1 s:shard1 c:nodes_used_collection) 
> [n:127.0.0.1:40553_solr c:nodes_used_collection s:shard1  
> x:nodes_used_collection_shard1_replica1] o.a.s.c.SolrCore 
> [nodes_used_collection_shard1_replica1] Registered new searcher 
> Searcher@fd430d[nodes_used_collection_shard1_replica1] 
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 687346 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.UpdateLog Could not find max version in index or recent updates, 
> using new clock 1577950628361011200
>   [junit4]   2> 687346 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.h.ReplicationHandler Commits will be reserved for  10000
>   [junit4]   2> 687346 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.u.UpdateLog Could not find max version in index or recent updates, 
> using new clock 1577950628361011200
>   [junit4]   2> 687347 INFO  
> (searcherExecutor-2589-thread-1-processing-n:127.0.0.1:36015_solr 
> x:nodes_used_collection_shard1_replica2 s:shard1 c:nodes_used_collection) 
> [n:127.0.0.1:36015_solr c:nodes_used_collection s:shard1  
> x:nodes_used_collection_shard1_replica2] o.a.s.c.SolrCore 
> [nodes_used_collection_shard1_replica2] Registered new searcher 
> Searcher@159f411[nodes_used_collection_shard1_replica2] 
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 687349 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>   [junit4]   2> 687349 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>   [junit4]   2> 687349 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.SyncStrategy Sync replicas to 
> http://127.0.0.1:40553/solr/nodes_used_collection_shard1_replica1/
>   [junit4]   2> 687349 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard1_replica1 
> url=http://127.0.0.1:40553/solr START 
> replicas=[http://127.0.0.1:36015/solr/nodes_used_collection_shard1_replica2/] 
> nUpdates=100
>   [junit4]   2> 687350 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard1_replica1 
> url=http://127.0.0.1:40553/solr DONE.  We have no versions.  sync failed.
>   [junit4]   2> 687351 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.UpdateHandler Using UpdateLog implementation: 
> org.apache.solr.update.UpdateLog
>   [junit4]   2> 687351 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 687351 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 687351 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 687352 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.s.SolrIndexSearcher Opening 
> [Searcher@43d18f[nodes_used_collection_shard2_replica2] main]
>   [junit4]   2> 687352 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.u.UpdateHandler Using UpdateLog implementation: 
> org.apache.solr.update.UpdateLog
>   [junit4]   2> 687352 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 687352 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
> /configs/conf
>   [junit4]   2> 687353 INFO  (qtp24988469-6488) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1 r:core_node3 
> x:nodes_used_collection_shard1_replica2] o.a.s.c.S.Request 
> [nodes_used_collection_shard1_replica2]  webapp=/solr path=/get 
> params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
>  status=0 QTime=0
>   [junit4]   2> 687353 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to 
> the next candidate
>   [junit4]   2> 687353 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
> ZooKeeperStorageIO:path=/configs/conf
>   [junit4]   2> 687353 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - 
> we can't sync in that case - we were active before, so become leader anyway
>   [junit4]   2> 687353 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
> election, clear LIR
>   [junit4]   2> 687353 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.h.ReplicationHandler Commits will be reserved for  10000
>   [junit4]   2> 687353 INFO  
> (searcherExecutor-2591-thread-1-processing-n:127.0.0.1:43097_solr 
> x:nodes_used_collection_shard2_replica2 s:shard2 c:nodes_used_collection) 
> [n:127.0.0.1:43097_solr c:nodes_used_collection s:shard2  
> x:nodes_used_collection_shard2_replica2] o.a.s.c.SolrCore 
> [nodes_used_collection_shard2_replica2] Registered new searcher 
> Searcher@43d18f[nodes_used_collection_shard2_replica2] 
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 687353 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.UpdateLog Could not find max version in index or recent updates, 
> using new clock 1577950628368351232
>   [junit4]   2> 687353 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.u.CommitTracker Hard AutoCommit: disabled
>   [junit4]   2> 687353 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.u.CommitTracker Soft AutoCommit: disabled
>   [junit4]   2> 687354 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.s.SolrIndexSearcher Opening 
> [Searcher@ceb490[nodes_used_collection_shard2_replica1] main]
>   [junit4]   2> 687354 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
> /configs/conf
>   [junit4]   2> 687355 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
> ZooKeeperStorageIO:path=/configs/conf
>   [junit4]   2> 687355 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.h.ReplicationHandler Commits will be reserved for  10000
>   [junit4]   2> 687355 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.ShardLeaderElectionContext I am the new leader: 
> http://127.0.0.1:40553/solr/nodes_used_collection_shard1_replica1/ shard1
>   [junit4]   2> 687355 INFO  
> (searcherExecutor-2590-thread-1-processing-n:127.0.0.1:44953_solr 
> x:nodes_used_collection_shard2_replica1 s:shard2 c:nodes_used_collection) 
> [n:127.0.0.1:44953_solr c:nodes_used_collection s:shard2  
> x:nodes_used_collection_shard2_replica1] o.a.s.c.SolrCore 
> [nodes_used_collection_shard2_replica1] Registered new searcher 
> Searcher@ceb490[nodes_used_collection_shard2_replica1] 
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 687355 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.u.UpdateLog Could not find max version in index or recent updates, 
> using new clock 1577950628370448384
>   [junit4]   2> 687356 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
> shard shard2: total=2 found=1 timeoutin=9999ms
>   [junit4]   2> 687459 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687459 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687459 INFO  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687459 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687505 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.c.ZkController I am the leader, no recovery necessary
>   [junit4]   2> 687507 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica1] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2}
>  status=0 QTime=1268
>   [junit4]   2> 687610 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687610 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687610 INFO  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687610 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687857 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>   [junit4]   2> 687857 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>   [junit4]   2> 687857 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.SyncStrategy Sync replicas to 
> http://127.0.0.1:43097/solr/nodes_used_collection_shard2_replica2/
>   [junit4]   2> 687857 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard2_replica2 
> url=http://127.0.0.1:43097/solr START 
> replicas=[http://127.0.0.1:44953/solr/nodes_used_collection_shard2_replica1/] 
> nUpdates=100
>   [junit4]   2> 687857 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.u.PeerSync PeerSync: core=nodes_used_collection_shard2_replica2 
> url=http://127.0.0.1:43097/solr DONE.  We have no versions.  sync failed.
>   [junit4]   2> 687860 INFO  (qtp23510893-6481) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2 r:core_node4 
> x:nodes_used_collection_shard2_replica1] o.a.s.c.S.Request 
> [nodes_used_collection_shard2_replica1]  webapp=/solr path=/get 
> params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
>  status=0 QTime=0
>   [junit4]   2> 687860 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to 
> the next candidate
>   [junit4]   2> 687860 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - 
> we can't sync in that case - we were active before, so become leader anyway
>   [junit4]   2> 687860 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
> election, clear LIR
>   [junit4]   2> 687864 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ShardLeaderElectionContext I am the new leader: 
> http://127.0.0.1:43097/solr/nodes_used_collection_shard2_replica2/ shard2
>   [junit4]   2> 687987 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687987 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687987 INFO  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 687987 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688016 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.c.ZkController I am the leader, no recovery necessary
>   [junit4]   2> 688017 INFO  (qtp17254031-6471) [n:127.0.0.1:43097_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica2] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2}
>  status=0 QTime=1778
>   [junit4]   2> 688120 INFO  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688120 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688120 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688120 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688351 INFO  (qtp24988469-6484) [n:127.0.0.1:36015_solr 
> c:nodes_used_collection s:shard1  x:nodes_used_collection_shard1_replica2] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2}
>  status=0 QTime=2111
>   [junit4]   2> 688358 INFO  (qtp23510893-6477) [n:127.0.0.1:44953_solr 
> c:nodes_used_collection s:shard2  x:nodes_used_collection_shard2_replica1] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2}
>  status=0 QTime=2119
>   [junit4]   2> 688359 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
> 30 seconds. Check all shard replicas
>   [junit4]   2> 688459 INFO  
> (zkCallback-928-thread-1-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688459 INFO  
> (zkCallback-931-thread-2-processing-n:127.0.0.1:40553_solr) 
> [n:127.0.0.1:40553_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688459 INFO  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 688459 INFO  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
> [WatchedEvent state:SyncConnected type:NodeDataChanged 
> path:/collections/nodes_used_collection/state.json] for collection 
> [nodes_used_collection] has occurred - updating... (live nodes size: [4])
>   [junit4]   2> 689359 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={replicationFactor=2&collection.configName=conf&name=nodes_used_collection&action=CREATE&numShards=2&wt=javabin&version=2}
>  status=0 QTime=3225
>   [junit4]   2> 689360 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Ending testCoresAreDistributedAcrossNodes
>   [junit4]   2> 689413 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoCollectionSpecified
>   [junit4]   2> 689414 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> 
> (4)
>   [junit4]   2> 689416 INFO  (qtp32442172-6468) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
> name=nodes_used_collection&action=DELETE&wt=javabin&version=2 and 
> sendToOCPQueue=true
>   [junit4]   2> 689418 INFO  
> (OverseerThreadFactory-2580-thread-5-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
> Executing Collection Cmd : 
> action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
>   [junit4]   2> 689418 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 689419 INFO  (qtp24988469-6486) [n:127.0.0.1:36015_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard1.replica2
>   [junit4]   2> 689419 INFO  (qtp17254031-6476) [n:127.0.0.1:43097_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard2.replica2
>   [junit4]   2> 689419 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard1.replica1
>   [junit4]   2> 689420 INFO  (qtp17254031-6476) [n:127.0.0.1:43097_solr    ] 
> o.a.s.c.SolrCore [nodes_used_collection_shard2_replica2]  CLOSING SolrCore 
> org.apache.solr.core.SolrCore@12097d1
>   [junit4]   2> 689419 INFO  (qtp24988469-6486) [n:127.0.0.1:36015_solr    ] 
> o.a.s.c.SolrCore [nodes_used_collection_shard1_replica2]  CLOSING SolrCore 
> org.apache.solr.core.SolrCore@13fa74f
>   [junit4]   2> 689420 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.c.SolrCore [nodes_used_collection_shard1_replica1]  CLOSING SolrCore 
> org.apache.solr.core.SolrCore@a2757a
>   [junit4]   2> 689421 INFO  (qtp23510893-6480) [n:127.0.0.1:44953_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard2.replica1
>   [junit4]   2> 689421 INFO  (qtp23510893-6480) [n:127.0.0.1:44953_solr    ] 
> o.a.s.c.SolrCore [nodes_used_collection_shard2_replica1]  CLOSING SolrCore 
> org.apache.solr.core.SolrCore@e429e0
>   [junit4]   2> 689421 INFO  (qtp24988469-6486) [n:127.0.0.1:36015_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard1.replica2
>   [junit4]   2> 689421 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard1.replica1
>   [junit4]   2> 689423 INFO  (qtp17254031-6476) [n:127.0.0.1:43097_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard2.replica2
>   [junit4]   2> 689423 INFO  (qtp24988469-6486) [n:127.0.0.1:36015_solr    ] 
> o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
> parent node, won't remove previous leader registration.
>   [junit4]   2> 689424 INFO  (qtp23510893-6480) [n:127.0.0.1:44953_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.nodes_used_collection.shard2.replica1
>   [junit4]   2> 689425 INFO  (qtp24988469-6486) [n:127.0.0.1:36015_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={deleteInstanceDir=true&core=nodes_used_collection_shard1_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
>  status=0 QTime=5
>   [junit4]   2> 689425 WARN  
> (zkCallback-930-thread-2-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.LeaderElector Our node is no longer in 
> line to be leader
>   [junit4]   2> 689426 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={deleteInstanceDir=true&core=nodes_used_collection_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
>  status=0 QTime=6
>   [junit4]   2> 689427 INFO  (qtp23510893-6480) [n:127.0.0.1:44953_solr    ] 
> o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
> parent node, won't remove previous leader registration.
>   [junit4]   2> 689427 WARN  
> (zkCallback-927-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.LeaderElector 
>   [junit4]   2> org.apache.solr.common.SolrException: SolrCore not 
> found:nodes_used_collection_shard2_replica1 in []
>   [junit4]   2>       at 
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:294)
>   [junit4]   2>       at 
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
>   [junit4]   2>       at 
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
>   [junit4]   2>       at 
> org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
>   [junit4]   2>       at 
> org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
>   [junit4]   2>       at 
> org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
>   [junit4]   2>       at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   [junit4]   2>       at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   [junit4]   2>       at 
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>   [junit4]   2>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   [junit4]   2>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   [junit4]   2>       at java.lang.Thread.run(Thread.java:748)
>   [junit4]   2> 689427 INFO  (qtp23510893-6480) [n:127.0.0.1:44953_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={deleteInstanceDir=true&core=nodes_used_collection_shard2_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
>  status=0 QTime=7
>   [junit4]   2> 689427 INFO  (qtp17254031-6476) [n:127.0.0.1:43097_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={deleteInstanceDir=true&core=nodes_used_collection_shard2_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
>  status=0 QTime=8
>   [junit4]   2> 690131 INFO  (qtp32442172-6468) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={name=nodes_used_collection&action=DELETE&wt=javabin&version=2} 
> status=0 QTime=715
>   [junit4]   2> 690134 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CoreAdminOperation core create command 
> dataDir=/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-002&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2
>   [junit4]   2> 690136 INFO  
> (OverseerStateUpdate-98621914169802763-127.0.0.1:36015_solr-n_0000000000) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
> shard shard=shard1
>   [junit4]   2> 691152 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrConfig Using 
> Lucene MatchVersion: 6.6.2
>   [junit4]   2> 691169 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema 
> [corewithnocollection] Schema name=minimal
>   [junit4]   2> 691177 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.s.IndexSchema Loaded 
> schema minimal/1.1 with uniqueid field id
>   [junit4]   2> 691177 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.CoreContainer 
> Creating SolrCore 'corewithnocollection' using configuration from collection 
> corewithnocollection, trusted=true
>   [junit4]   2> 691178 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
> solr.RecoveryStrategy.Builder
>   [junit4]   2> 691178 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
> [[corewithnocollection] ] Opening new SolrCore at 
> [/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node3/corewithnocollection],
>  
> dataDir=[/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-002/]
>   [junit4]   2> 691208 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateHandler Using 
> UpdateLog implementation: org.apache.solr.update.UpdateLog
>   [junit4]   2> 691208 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog 
> Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 691208 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Hard 
> AutoCommit: disabled
>   [junit4]   2> 691208 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.u.CommitTracker Soft 
> AutoCommit: disabled
>   [junit4]   2> 691209 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.s.SolrIndexSearcher 
> Opening [Searcher@117ece3[corewithnocollection] main]
>   [junit4]   2> 691210 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] 
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
> /configs/conf
>   [junit4]   2> 691210 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] 
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
> ZooKeeperStorageIO:path=/configs/conf
>   [junit4]   2> 691210 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.h.ReplicationHandler 
> Commits will be reserved for  10000
>   [junit4]   2> 691210 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.u.UpdateLog Could not 
> find max version in index or recent updates, using new clock 
> 1577950632412708864
>   [junit4]   2> 691211 INFO  
> (searcherExecutor-2609-thread-1-processing-n:127.0.0.1:40553_solr 
> x:corewithnocollection c:corewithnocollection) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SolrCore 
> [corewithnocollection] Registered new searcher 
> Searcher@117ece3[corewithnocollection] 
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 691213 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] 
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>   [junit4]   2> 691213 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] 
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>   [junit4]   2> 691213 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync 
> replicas to http://127.0.0.1:40553/solr/corewithnocollection/
>   [junit4]   2> 691213 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy Sync 
> Success - now sync replicas to me
>   [junit4]   2> 691213 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.SyncStrategy 
> http://127.0.0.1:40553/solr/corewithnocollection/ has no replicas
>   [junit4]   2> 691214 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] 
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
> election, clear LIR
>   [junit4]   2> 691214 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] 
> o.a.s.c.ShardLeaderElectionContext I am the new leader: 
> http://127.0.0.1:40553/solr/corewithnocollection/ shard1
>   [junit4]   2> 691365 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.c.ZkController I am 
> the leader, no recovery necessary
>   [junit4]   2> 691366 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr 
> c:corewithnocollection   x:corewithnocollection] o.a.s.s.HttpSolrCall [admin] 
> webapp=null path=/admin/cores 
> params={dataDir=/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-002&collection.configName=conf&name=corewithnocollection&action=CREATE&numShards=1&collection=&wt=javabin&version=2}
>  status=0 QTime=1232
>   [junit4]   2> 691368 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CoreAdminOperation core create command 
> dataDir=/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-002&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2
>   [junit4]   2> 691371 INFO  
> (OverseerStateUpdate-98621914169802763-127.0.0.1:36015_solr-n_0000000000) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
> shard shard=shard1
>   [junit4]   2> 691419 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 692384 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrConfig Using 
> Lucene MatchVersion: 6.6.2
>   [junit4]   2> 692403 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema 
> [corewithnocollection2] Schema name=minimal
>   [junit4]   2> 692406 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.IndexSchema Loaded 
> schema minimal/1.1 with uniqueid field id
>   [junit4]   2> 692406 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.CoreContainer 
> Creating SolrCore 'corewithnocollection2' using configuration from collection 
> corewithnocollection2, trusted=true
>   [junit4]   2> 692406 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
> solr.RecoveryStrategy.Builder
>   [junit4]   2> 692406 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
> [[corewithnocollection2] ] Opening new SolrCore at 
> [/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-001/node3/corewithnocollection2],
>  
> dataDir=[/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-002/]
>   [junit4]   2> 692443 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateHandler 
> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
>   [junit4]   2> 692443 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog 
> Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
> numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
>   [junit4]   2> 692443 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Hard 
> AutoCommit: disabled
>   [junit4]   2> 692443 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.CommitTracker Soft 
> AutoCommit: disabled
>   [junit4]   2> 692444 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.SolrIndexSearcher 
> Opening [Searcher@1ec3e41[corewithnocollection2] main]
>   [junit4]   2> 692445 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] 
> o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
> /configs/conf
>   [junit4]   2> 692445 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] 
> o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
> ZooKeeperStorageIO:path=/configs/conf
>   [junit4]   2> 692445 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.h.ReplicationHandler 
> Commits will be reserved for  10000
>   [junit4]   2> 692445 INFO  
> (searcherExecutor-2614-thread-1-processing-n:127.0.0.1:40553_solr 
> x:corewithnocollection2 c:corewithnocollection2) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SolrCore 
> [corewithnocollection2] Registered new searcher 
> Searcher@1ec3e41[corewithnocollection2] 
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>   [junit4]   2> 692445 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.u.UpdateLog Could 
> not find max version in index or recent updates, using new clock 
> 1577950633707700224
>   [junit4]   2> 692448 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] 
> o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
>   [junit4]   2> 692448 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] 
> o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
>   [junit4]   2> 692449 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync 
> replicas to http://127.0.0.1:40553/solr/corewithnocollection2/
>   [junit4]   2> 692449 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy Sync 
> Success - now sync replicas to me
>   [junit4]   2> 692449 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.SyncStrategy 
> http://127.0.0.1:40553/solr/corewithnocollection2/ has no replicas
>   [junit4]   2> 692449 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] 
> o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
> election, clear LIR
>   [junit4]   2> 692450 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] 
> o.a.s.c.ShardLeaderElectionContext I am the new leader: 
> http://127.0.0.1:40553/solr/corewithnocollection2/ shard1
>   [junit4]   2> 692600 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.c.ZkController I am 
> the leader, no recovery necessary
>   [junit4]   2> 692601 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr 
> c:corewithnocollection2   x:corewithnocollection2] o.a.s.s.HttpSolrCall 
> [admin] webapp=null path=/admin/cores 
> params={dataDir=/home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001/tempDir-002&collection.configName=conf&name=corewithnocollection2&action=CREATE&numShards=1&wt=javabin&version=2}
>  status=0 QTime=1233
>   [junit4]   2> 692602 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testNoCollectionSpecified-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoCollectionSpecified
>   [junit4]   2> 692657 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateNodeSet
>   [junit4]   2> 692658 INFO  
> (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[10ECD6E9979EF149])
>  [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> 
> (4)
>   [junit4]   2> 692661 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
> name=corewithnocollection&action=DELETE&wt=javabin&version=2 and 
> sendToOCPQueue=true
>   [junit4]   2> 692663 INFO  
> (OverseerThreadFactory-2580-thread-5-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
> Executing Collection Cmd : 
> action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
>   [junit4]   2> 692665 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.corewithnocollection
>   [junit4]   2> 692665 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr    ] 
> o.a.s.c.SolrCore [corewithnocollection]  CLOSING SolrCore 
> org.apache.solr.core.SolrCore@9b8099
>   [junit4]   2> 692667 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.corewithnocollection
>   [junit4]   2> 692669 INFO  (qtp32442172-6455) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={deleteInstanceDir=true&core=corewithnocollection&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
>  status=0 QTime=3
>   [junit4]   2> 693374 INFO  (qtp32442172-6472) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={name=corewithnocollection&action=DELETE&wt=javabin&version=2} 
> status=0 QTime=712
>   [junit4]   2> 693376 INFO  (qtp32442172-6468) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params 
> name=corewithnocollection2&action=DELETE&wt=javabin&version=2 and 
> sendToOCPQueue=true
>   [junit4]   2> 693378 INFO  
> (OverseerThreadFactory-2580-thread-5-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
> Executing Collection Cmd : 
> action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
>   [junit4]   2> 693378 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 693380 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.corewithnocollection2
>   [junit4]   2> 693380 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.c.SolrCore [corewithnocollection2]  CLOSING SolrCore 
> org.apache.solr.core.SolrCore@1e21d05
>   [junit4]   2> 693381 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.m.SolrMetricManager Closing metric reporters for: 
> solr.core.corewithnocollection2
>   [junit4]   2> 693383 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={deleteInstanceDir=true&core=corewithnocollection2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2}
>  status=0 QTime=3
>   [junit4]   2> 694087 INFO  (qtp32442172-6468) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
> params={name=corewithnocollection2&action=DELETE&wt=javabin&version=2} 
> status=0 QTime=711
>   [junit4]   2> 694089 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
> replicationFactor=1&collection.configName=conf&name=nodeset_collection&action=CREATE&numShards=2&createNodeSet=http://127.0.0.1:36015/solr,http://127.0.0.1:44953/solr&wt=javabin&version=2
>  and sendToOCPQueue=true
>   [junit4]   2> 694091 INFO  
> (OverseerThreadFactory-2580-thread-5-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
> nodeset_collection
>   [junit4]   2> 694092 INFO  
> (OverseerCollectionConfigSetProcessor-98621914169802763-127.0.0.1:36015_solr-n_0000000000)
>  [n:127.0.0.1:36015_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
> /overseer/collection-queue-work/qnr-0000000012 doesn't exist.  Requestor may 
> have disconnected from ZooKeeper
>   [junit4]   2> 694092 WARN  
> (OverseerThreadFactory-2580-thread-5-processing-n:127.0.0.1:36015_solr) 
> [n:127.0.0.1:36015_solr    ] o.a.s.c.CreateCollectionCmd It is unusual to 
> create a collection (nodeset_collection) without cores.
>   [junit4]   2> 694297 INFO  (qtp32442172-6460) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.a.Col
> 
> [...truncated too long message...]
> 
> olr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> 
> (1)
>   [junit4]   2> 771851 INFO  (jetty-closer-910-thread-3) [    ] 
> o.e.j.s.h.ContextHandler Stopped 
> o.e.j.s.ServletContextHandler@532f3e{/solr,null,UNAVAILABLE}
>   [junit4]   2> 771852 WARN  
> (zkCallback-928-thread-3-processing-n:127.0.0.1:43097_solr) 
> [n:127.0.0.1:43097_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch 
> triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for 
> /live_nodes]
>   [junit4]   2> 772511 ERROR (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Solr is 
> shutting down
>   [junit4]   2>       at 
> org.apache.solr.handler.admin.PrepRecoveryOp.execute(PrepRecoveryOp.java:183)
>   [junit4]   2>       at 
> org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
>   [junit4]   2>       at 
> org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:388)
>   [junit4]   2>       at 
> org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
>   [junit4]   2>       at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
>   [junit4]   2>       at 
> org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:748)
>   [junit4]   2>       at 
> org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:729)
>   [junit4]   2>       at 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:510)
>   [junit4]   2>       at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:361)
>   [junit4]   2>       at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:305)
>   [junit4]   2>       at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
>   [junit4]   2>       at 
> org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
>   [junit4]   2>       at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
>   [junit4]   2>       at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
>   [junit4]   2>       at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.Server.handle(Server.java:534)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
>   [junit4]   2>       at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
>   [junit4]   2>       at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
>   [junit4]   2>       at 
> org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
>   [junit4]   2>       at 
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
>   [junit4]   2>       at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
>   [junit4]   2>       at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
>   [junit4]   2>       at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
>   [junit4]   2>       at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
>   [junit4]   2>       at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
>   [junit4]   2>       at java.lang.Thread.run(Thread.java:748)
>   [junit4]   2> 
>   [junit4]   2> 772511 INFO  (qtp32442172-6454) [n:127.0.0.1:40553_solr    ] 
> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
> params={nodeName=127.0.0.1:43097_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica2&coreNodeName=core_node7&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
>  status=400 QTime=13003
>   [junit4]   2> 773350 WARN  
> (zkCallback-965-thread-1-processing-n:127.0.0.1:44953_solr) 
> [n:127.0.0.1:44953_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch 
> triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for 
> /live_nodes]
>   [junit4]   2> 773351 INFO  (jetty-closer-910-thread-1) [    ] 
> o.e.j.s.h.ContextHandler Stopped 
> o.e.j.s.ServletContextHandler@3f5ed6{/solr,null,UNAVAILABLE}
>   [junit4]   2> 773351 INFO  (jetty-closer-910-thread-4) [    ] 
> o.e.j.s.h.ContextHandler Stopped 
> o.e.j.s.ServletContextHandler@aa7053{/solr,null,UNAVAILABLE}
>   [junit4]   2> 773352 ERROR 
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
> server won't take any action on ERROR or SHUTDOWN server state changes
>   [junit4]   2> 773352 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.c.ZkTestServer connecting to 127.0.0.1:35215 35215
>   [junit4]   2> 778407 INFO  (Thread-2062) [    ] o.a.s.c.ZkTestServer 
> connecting to 127.0.0.1:35215 35215
>   [junit4]   2> 778408 WARN  (Thread-2062) [    ] o.a.s.c.ZkTestServer Watch 
> limit violations: 
>   [junit4]   2> Maximum concurrent create/delete watches above limit:
>   [junit4]   2> 
>   [junit4]   2>       26      /solr/aliases.json
>   [junit4]   2>       26      /solr/clusterprops.json
>   [junit4]   2>       23      /solr/configs/conf
>   [junit4]   2>       5       /solr/security.json
>   [junit4]   2>       2       /solr/configs/conf2
>   [junit4]   2> 
>   [junit4]   2> Maximum concurrent data watches above limit:
>   [junit4]   2> 
>   [junit4]   2>       194     /solr/clusterstate.json
>   [junit4]   2>       4       
> /solr/collections/nodes_used_collection/state.json
>   [junit4]   2>       4       /solr/collections/addReplicaColl/state.json
>   [junit4]   2>       4       /solr/collections/reloaded_collection/state.json
>   [junit4]   2>       3       
> /solr/collections/acollectionafterbaddelete/state.json
>   [junit4]   2>       2       /solr/collections/onlyinzk/state.json
>   [junit4]   2>       2       
> /solr/collections/awhollynewcollection_0/state.json
>   [junit4]   2>       2       
> /solr/collections/addReplicaColl/leader_elect/shard2/election/98621914169802761-core_node4-n_0000000000
>   [junit4]   2>       2       
> /solr/collections/halfdeletedcollection/state.json
>   [junit4]   2>       2       
> /solr/overseer_elect/election/98621914169802760-127.0.0.1:43097_solr-n_0000000001
>   [junit4]   2> 
>   [junit4]   2> Maximum concurrent children watches above limit:
>   [junit4]   2> 
>   [junit4]   2>       431     /solr/collections
>   [junit4]   2>       61      /solr/live_nodes
>   [junit4]   2> 
>   [junit4]   2> 778408 INFO  
> (SUITE-CollectionsAPIDistributedZkTest-seed#[10ECD6E9979EF149]-worker) [    ] 
> o.a.s.SolrTestCaseJ4 ###deleteCore
>   [junit4]   2> NOTE: leaving temporary files on disk at: 
> /home/jenkins/workspace/Lucene-Solr-6.6-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_10ECD6E9979EF149-001
>   [junit4]   2> NOTE: test params are: codec=Lucene62, 
> sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=zh-HK, 
> timezone=Brazil/West
>   [junit4]   2> NOTE: Linux 4.10.0-33-generic i386/Oracle Corporation 
> 1.8.0_144 (32-bit)/cpus=8,threads=1,free=71785248,total=183463936
>   [junit4]   2> NOTE: All tests run in this JVM: [SliceStateTest, 
> TestSQLHandlerNonCloud, DocValuesTest, ShardRoutingTest, 
> TestClusterProperties, TestElisionMultitermQuery, TestSolrCoreSnapshots, 
> TestGraphMLResponseWriter, TestLuceneMatchVersion, 
> HdfsWriteToMultipleCollectionsTest, CloneFieldUpdateProcessorFactoryTest, 
> BasicFunctionalityTest, TestUseDocValuesAsStored2, SolrIndexSplitterTest, 
> TestExclusionRuleCollectionAccess, TestCloudPivotFacet, 
> TestPerFieldSimilarityWithDefaultOverride, TestTrie, DeleteReplicaTest, 
> TestFieldCacheWithThreads, SolrIndexConfigTest, TestDFISimilarityFactory, 
> ClusterStateUpdateTest, OverseerTaskQueueTest, DirectSolrConnectionTest, 
> EchoParamsTest, TestSchemaManager, CleanupOldIndexTest, 
> URLClassifyProcessorTest, TestFieldCache, TestFuzzyAnalyzedSuggestions, 
> TestUnifiedSolrHighlighter, TestShardHandlerFactory, 
> TestConfigSetsAPIExclusivity, ZkSolrClientTest, OverseerModifyCollectionTest, 
> TestSearchPerf, TestObjectReleaseTracker, TestTrieFacet, 
> TestRandomRequestDistribution, TestSmileRequest, HdfsRecoveryZkTest, 
> TestQueryUtils, SpatialHeatmapFacetsTest, TestStressCloudBlindAtomicUpdates, 
> TestSolrFieldCacheMBean, HighlighterTest, TestSurroundQueryParser, 
> SolrJmxReporterCloudTest, TestGraphTermsQParserPlugin, 
> TestRuleBasedAuthorizationPlugin, TestSystemIdResolver, TestUpdate, 
> MoveReplicaTest, TestRawResponseWriter, IndexSchemaRuntimeFieldTest, 
> TestManagedSchemaAPI, AddSchemaFieldsUpdateProcessorFactoryTest, 
> OutOfBoxZkACLAndCredentialsProvidersTest, PKIAuthenticationIntegrationTest, 
> TestReqParamsAPI, RestartWhileUpdatingTest, SuggesterFSTTest, 
> SolrCloudExampleTest, TestLMDirichletSimilarityFactory, TestNoOpRegenerator, 
> SolrInfoMBeanTest, TestIntervalFaceting, ZkCLITest, TestRestManager, 
> TestFastOutputStream, CollectionsAPISolrJTest, 
> BigEndianAscendingWordSerializerTest, TestBM25SimilarityFactory, 
> TestDeleteCollectionOnDownNodes, MetricsHandlerTest, 
> TemplateUpdateProcessorTest, HdfsCollectionsAPIDistributedZkTest, 
> TestSolrDynamicMBean, TestManagedStopFilterFactory, 
> DistributedIntervalFacetingTest, TestCustomSort, TestFiltering, 
> AnalysisErrorHandlingTest, ParsingFieldUpdateProcessorsTest, 
> DeleteInactiveReplicaTest, CollectionsAPIDistributedZkTest]
>   [junit4] Completed [251/713 (1!)] on J1 in 92.66s, 20 tests, 1 failure <<< 
> FAILURES!
> 
> [...truncated 40990 lines...]
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to