Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/918/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI

Error Message:
Could not find collection : implicitcoll

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : implicitcoll
        at 
__randomizedtesting.SeedInfo.seed([DB7A130E558A4DEA:B19B9D656810FB92]:0)
        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
        at 
org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
        at 
org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:68)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12555 lines...]
   [junit4] Suite: org.apache.solr.cloud.CustomCollectionTest
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/init-core-data-001
   [junit4]   2> 1757514 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields
   [junit4]   2> 1757520 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) 
w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1757521 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001
   [junit4]   2> 1757522 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1757522 INFO  (Thread-3879) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1757522 INFO  (Thread-3879) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1757526 ERROR (Thread-3879) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1757624 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:64246
   [junit4]   2> 1757663 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1757663 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1757664 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1757664 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1757688 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@49192f6b{/solr,null,AVAILABLE}
   [junit4]   2> 1757689 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5b6df796{/solr,null,AVAILABLE}
   [junit4]   2> 1757690 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@44a31634{HTTP/1.1,[http/1.1]}{127.0.0.1:64249}
   [junit4]   2> 1757690 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.e.j.s.Server Started @1761217ms
   [junit4]   2> 1757690 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64249}
   [junit4]   2> 1757690 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@23e1b171{HTTP/1.1,[http/1.1]}{127.0.0.1:64248}
   [junit4]   2> 1757690 ERROR (jetty-launcher-3598-thread-4) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1757691 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@75884cd9{/solr,null,AVAILABLE}
   [junit4]   2> 1757690 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.e.j.s.Server Started @1761217ms
   [junit4]   2> 1757691 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64248}
   [junit4]   2> 1757691 ERROR (jetty-launcher-3598-thread-3) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1757691 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2232c280{/solr,null,AVAILABLE}
   [junit4]   2> 1757692 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@72a99e39{HTTP/1.1,[http/1.1]}{127.0.0.1:64251}
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-09T08:06:18.636Z
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.e.j.s.Server Started @1761220ms
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64251}
   [junit4]   2> 1757692 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4af31d26{HTTP/1.1,[http/1.1]}{127.0.0.1:64250}
   [junit4]   2> 1757693 ERROR (jetty-launcher-3598-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.e.j.s.Server Started @1761220ms
   [junit4]   2> 1757693 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64250}
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1757691 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-09T08:06:18.637Z
   [junit4]   2> 1757694 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-09T08:06:18.637Z
   [junit4]   2> 1757694 ERROR (jetty-launcher-3598-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1757695 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1757695 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1757695 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1757695 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-09T08:06:18.638Z
   [junit4]   2> 1757698 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1757698 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1757698 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1757698 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1757708 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1757709 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1757709 INFO  (jetty-launcher-3598-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64246/solr
   [junit4]   2> 1757709 INFO  (jetty-launcher-3598-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64246/solr
   [junit4]   2> 1757710 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1757711 INFO  (jetty-launcher-3598-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64246/solr
   [junit4]   2> 1757711 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1757712 INFO  (jetty-launcher-3598-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64246/solr
   [junit4]   2> 1757746 INFO  (jetty-launcher-3598-thread-1) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1757746 INFO  (jetty-launcher-3598-thread-4) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1757747 INFO  (jetty-launcher-3598-thread-3) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1757747 INFO  (jetty-launcher-3598-thread-2) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1757748 INFO  (jetty-launcher-3598-thread-1) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:64251_solr
   [junit4]   2> 1757749 INFO  (jetty-launcher-3598-thread-4) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64249_solr
   [junit4]   2> 1757749 INFO  (jetty-launcher-3598-thread-3) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64248_solr
   [junit4]   2> 1757749 INFO  (jetty-launcher-3598-thread-2) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64250_solr
   [junit4]   2> 1757750 INFO  (jetty-launcher-3598-thread-1) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.Overseer Overseer 
(id=98107102230478859-127.0.0.1:64251_solr-n_0000000000) starting
   [junit4]   2> 1757751 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1757751 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1757752 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1757752 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1757788 INFO  (jetty-launcher-3598-thread-1) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64251_solr
   [junit4]   2> 1757790 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1757790 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1757790 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1757790 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1757817 INFO  (jetty-launcher-3598-thread-2) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node2/.
   [junit4]   2> 1757828 INFO  (jetty-launcher-3598-thread-3) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node3/.
   [junit4]   2> 1757833 INFO  (jetty-launcher-3598-thread-4) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node4/.
   [junit4]   2> 1757867 INFO  (jetty-launcher-3598-thread-1) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node1/.
   [junit4]   2> 1757882 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1757883 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64246/solr ready
   [junit4]   2> 1757912 INFO  
(TEST-CustomCollectionTest.testRouteFieldForHashRouter-seed#[DB7A130E558A4DEA]) 
[    ] o.a.s.SolrTestCaseJ4 ###Starting testRouteFieldForHashRouter
   [junit4]   2> 1757913 INFO  
(TEST-CustomCollectionTest.testRouteFieldForHashRouter-seed#[DB7A130E558A4DEA]) 
[    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1757917 INFO  (qtp888377316-19519) [n:127.0.0.1:64251_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&maxShardsPerNode=3&router.field=shard_s&name=routeFieldColl&action=CREATE&numShards=4&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1757920 INFO  
(OverseerThreadFactory-8359-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
routeFieldColl
   [junit4]   2> 1758036 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard3_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard3&wt=javabin&version=2
   [junit4]   2> 1758036 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard1_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1758036 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1758036 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1758036 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard4_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard4&wt=javabin&version=2
   [junit4]   2> 1758037 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1758037 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard4_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard4&wt=javabin&version=2
   [junit4]   2> 1758037 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard3_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard3&wt=javabin&version=2
   [junit4]   2> 1758038 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1758038 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard2_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1758038 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard2_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1758045 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard1_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1758171 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1758171 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1758171 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1758171 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1759086 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759086 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759089 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759093 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759111 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759111 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759113 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.s.IndexSchema [routeFieldColl_shard3_replica1] Schema name=cloud-dynamic
   [junit4]   2> 1759118 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.s.IndexSchema [routeFieldColl_shard1_replica1] Schema name=cloud-dynamic
   [junit4]   2> 1759121 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.s.IndexSchema [routeFieldColl_shard2_replica1] Schema name=cloud-dynamic
   [junit4]   2> 1759135 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759140 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.7.0
   [junit4]   2> 1759144 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759144 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard3_replica1' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759144 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759144 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] o.a.s.c.SolrCore 
[[routeFieldColl_shard3_replica1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node3/routeFieldColl_shard3_replica1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node3/./routeFieldColl_shard3_replica1/data/]
   [junit4]   2> 1759145 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.s.IndexSchema [routeFieldColl_shard1_replica2] Schema name=cloud-dynamic
   [junit4]   2> 1759146 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.s.IndexSchema [routeFieldColl_shard4_replica2] Schema name=cloud-dynamic
   [junit4]   2> 1759157 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.s.IndexSchema [routeFieldColl_shard2_replica2] Schema name=cloud-dynamic
   [junit4]   2> 1759158 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.s.IndexSchema [routeFieldColl_shard4_replica1] Schema name=cloud-dynamic
   [junit4]   2> 1759178 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.s.IndexSchema [routeFieldColl_shard3_replica2] Schema name=cloud-dynamic
   [junit4]   2> 1759179 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759180 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard2_replica1' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759180 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759180 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.c.SolrCore 
[[routeFieldColl_shard2_replica1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node2/routeFieldColl_shard2_replica1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node2/./routeFieldColl_shard2_replica1/data/]
   [junit4]   2> 1759200 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759200 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard1_replica2' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759200 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759201 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.c.SolrCore 
[[routeFieldColl_shard1_replica2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node4/routeFieldColl_shard1_replica2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node4/./routeFieldColl_shard1_replica2/data/]
   [junit4]   2> 1759204 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759204 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard4_replica1' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759204 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759204 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.c.SolrCore 
[[routeFieldColl_shard4_replica1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node2/routeFieldColl_shard4_replica1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node2/./routeFieldColl_shard4_replica1/data/]
   [junit4]   2> 1759225 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759225 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard4_replica2' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759226 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759226 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard3_replica2' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759226 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759226 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] o.a.s.c.SolrCore 
[[routeFieldColl_shard4_replica2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node1/routeFieldColl_shard4_replica2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node1/./routeFieldColl_shard4_replica2/data/]
   [junit4]   2> 1759226 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759226 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.c.SolrCore 
[[routeFieldColl_shard3_replica2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node4/routeFieldColl_shard3_replica2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node4/./routeFieldColl_shard3_replica2/data/]
   [junit4]   2> 1759228 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759228 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard1_replica1' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759229 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759229 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] o.a.s.c.SolrCore 
[[routeFieldColl_shard1_replica1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node3/routeFieldColl_shard1_replica1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node3/./routeFieldColl_shard1_replica1/data/]
   [junit4]   2> 1759230 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
   [junit4]   2> 1759230 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.c.CoreContainer Creating SolrCore 'routeFieldColl_shard2_replica2' using 
configuration from collection routeFieldColl, trusted=true
   [junit4]   2> 1759230 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1759230 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] o.a.s.c.SolrCore 
[[routeFieldColl_shard2_replica2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node1/routeFieldColl_shard2_replica2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001/tempDir-001/node1/./routeFieldColl_shard2_replica2/data/]
   [junit4]   2> 1759340 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759340 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759343 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759343 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759345 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759345 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759346 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759346 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759352 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759352 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759353 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759353 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759354 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@3bac5511[routeFieldColl_shard4_replica1] main]
   [junit4]   2> 1759362 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759362 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759364 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759364 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759365 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759365 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759365 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759365 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759366 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759366 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759366 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759367 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759367 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759367 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759367 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759367 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759367 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759367 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637619138560
   [junit4]   2> 1759368 INFO  
(searcherExecutor-8371-thread-1-processing-n:127.0.0.1:64250_solr 
x:routeFieldColl_shard4_replica1 s:shard4 c:routeFieldColl) 
[n:127.0.0.1:64250_solr c:routeFieldColl s:shard4  
x:routeFieldColl_shard4_replica1] o.a.s.c.SolrCore 
[routeFieldColl_shard4_replica1] Registered new searcher 
Searcher@3bac5511[routeFieldColl_shard4_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759369 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759369 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759372 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1759372 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1759374 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1759374 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1759374 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard4: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1759376 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@53e1bd98[routeFieldColl_shard2_replica1] main]
   [junit4]   2> 1759376 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5e4ecb89[routeFieldColl_shard3_replica2] main]
   [junit4]   2> 1759377 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759377 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759377 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759377 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759377 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759377 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759378 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637630672896
   [junit4]   2> 1759378 INFO  
(searcherExecutor-8369-thread-1-processing-n:127.0.0.1:64250_solr 
x:routeFieldColl_shard2_replica1 s:shard2 c:routeFieldColl) 
[n:127.0.0.1:64250_solr c:routeFieldColl s:shard2  
x:routeFieldColl_shard2_replica1] o.a.s.c.SolrCore 
[routeFieldColl_shard2_replica1] Registered new searcher 
Searcher@53e1bd98[routeFieldColl_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759378 INFO  
(searcherExecutor-8373-thread-1-processing-n:127.0.0.1:64249_solr 
x:routeFieldColl_shard3_replica2 s:shard3 c:routeFieldColl) 
[n:127.0.0.1:64249_solr c:routeFieldColl s:shard3  
x:routeFieldColl_shard3_replica2] o.a.s.c.SolrCore 
[routeFieldColl_shard3_replica2] Registered new searcher 
Searcher@5e4ecb89[routeFieldColl_shard3_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759378 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637630672896
   [junit4]   2> 1759380 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@1bccd66d[routeFieldColl_shard1_replica2] main]
   [junit4]   2> 1759382 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759382 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759383 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759383 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637635915776
   [junit4]   2> 1759383 INFO  
(searcherExecutor-8370-thread-1-processing-n:127.0.0.1:64249_solr 
x:routeFieldColl_shard1_replica2 s:shard1 c:routeFieldColl) 
[n:127.0.0.1:64249_solr c:routeFieldColl s:shard1  
x:routeFieldColl_shard1_replica2] o.a.s.c.SolrCore 
[routeFieldColl_shard1_replica2] Registered new searcher 
Searcher@1bccd66d[routeFieldColl_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759384 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1759385 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard3: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1759385 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@66114680[routeFieldColl_shard4_replica2] main]
   [junit4]   2> 1759385 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@575d65cc[routeFieldColl_shard1_replica1] main]
   [junit4]   2> 1759386 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759387 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759387 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759387 INFO  
(searcherExecutor-8372-thread-1-processing-n:127.0.0.1:64251_solr 
x:routeFieldColl_shard4_replica2 s:shard4 c:routeFieldColl) 
[n:127.0.0.1:64251_solr c:routeFieldColl s:shard4  
x:routeFieldColl_shard4_replica2] o.a.s.c.SolrCore 
[routeFieldColl_shard4_replica2] Registered new searcher 
Searcher@66114680[routeFieldColl_shard4_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759387 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637640110080
   [junit4]   2> 1759388 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759389 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759389 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759391 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@1821c0e6[routeFieldColl_shard2_replica2] main]
   [junit4]   2> 1759392 INFO  
(searcherExecutor-8374-thread-1-processing-n:127.0.0.1:64248_solr 
x:routeFieldColl_shard1_replica1 s:shard1 c:routeFieldColl) 
[n:127.0.0.1:64248_solr c:routeFieldColl s:shard1  
x:routeFieldColl_shard1_replica1] o.a.s.c.SolrCore 
[routeFieldColl_shard1_replica1] Registered new searcher 
Searcher@575d65cc[routeFieldColl_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759393 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759393 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759393 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759393 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637646401536
   [junit4]   2> 1759393 INFO  
(searcherExecutor-8375-thread-1-processing-n:127.0.0.1:64251_solr 
x:routeFieldColl_shard2_replica2 s:shard2 c:routeFieldColl) 
[n:127.0.0.1:64251_solr c:routeFieldColl s:shard2  
x:routeFieldColl_shard2_replica2] o.a.s.c.SolrCore 
[routeFieldColl_shard2_replica2] Registered new searcher 
Searcher@1821c0e6[routeFieldColl_shard2_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759397 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637650595840
   [junit4]   2> 1759398 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2b794120[routeFieldColl_shard3_replica1] main]
   [junit4]   2> 1759400 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1759400 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1759401 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1759401 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1759401 INFO  
(searcherExecutor-8368-thread-1-processing-n:127.0.0.1:64248_solr 
x:routeFieldColl_shard3_replica1 s:shard3 c:routeFieldColl) 
[n:127.0.0.1:64248_solr c:routeFieldColl s:shard3  
x:routeFieldColl_shard3_replica1] o.a.s.c.SolrCore 
[routeFieldColl_shard3_replica1] Registered new searcher 
Searcher@2b794120[routeFieldColl_shard3_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1759401 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1569713637654790144
   [junit4]   2> 1759506 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1759506 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1759506 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1759506 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1759879 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1759879 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1759879 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:64250/solr/routeFieldColl_shard4_replica1/
   [junit4]   2> 1759879 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard4_replica1 url=http://127.0.0.1:64250/solr 
START replicas=[http://127.0.0.1:64251/solr/routeFieldColl_shard4_replica2/] 
nUpdates=100
   [junit4]   2> 1759879 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard4_replica1 url=http://127.0.0.1:64250/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 1759881 INFO  (qtp888377316-19533) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4 r:core_node3 x:routeFieldColl_shard4_replica2] 
o.a.s.c.S.Request [routeFieldColl_shard4_replica2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1759881 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 1759881 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1759881 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1759885 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1759885 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1759886 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1759886 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:64250/solr/routeFieldColl_shard2_replica1/
   [junit4]   2> 1759885 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1759886 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/
   [junit4]   2> 1759886 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard2_replica1 url=http://127.0.0.1:64250/solr 
START replicas=[http://127.0.0.1:64251/solr/routeFieldColl_shard2_replica2/] 
nUpdates=100
   [junit4]   2> 1759886 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard3_replica2 url=http://127.0.0.1:64249/solr 
START replicas=[http://127.0.0.1:64248/solr/routeFieldColl_shard3_replica1/] 
nUpdates=100
   [junit4]   2> 1759886 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard2_replica1 url=http://127.0.0.1:64250/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 1759886 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:64250/solr/routeFieldColl_shard4_replica1/ shard4
   [junit4]   2> 1759886 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard3_replica2 url=http://127.0.0.1:64249/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 1759888 INFO  (qtp569595039-19541) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.c.S.Request [routeFieldColl_shard3_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1759888 INFO  (qtp888377316-19534) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2 r:core_node7 x:routeFieldColl_shard2_replica2] 
o.a.s.c.S.Request [routeFieldColl_shard2_replica2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1759888 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 1759888 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 1759888 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1759888 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1759888 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1759888 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1759893 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:64250/solr/routeFieldColl_shard2_replica1/ shard2
   [junit4]   2> 1759893 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/ shard3
   [junit4]   2> 1759905 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1759905 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1759905 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:64249/solr/routeFieldColl_shard1_replica2/
   [junit4]   2> 1759905 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard1_replica2 url=http://127.0.0.1:64249/solr 
START replicas=[http://127.0.0.1:64248/solr/routeFieldColl_shard1_replica1/] 
nUpdates=100
   [junit4]   2> 1759905 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] o.a.s.u.PeerSync 
PeerSync: core=routeFieldColl_shard1_replica2 url=http://127.0.0.1:64249/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 1759908 INFO  (qtp569595039-19542) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1 r:core_node1 x:routeFieldColl_shard1_replica1] 
o.a.s.c.S.Request [routeFieldColl_shard1_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1759908 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 1759908 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1759908 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1759912 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:64249/solr/routeFieldColl_shard1_replica2/ shard1
   [junit4]   2> 1760024 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760024 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760025 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760024 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760057 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1760060 INFO  (qtp2107197219-19523) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard4_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard4&wt=javabin&version=2}
 status=0 QTime=2022
   [junit4]   2> 1760060 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1760060 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1760062 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica2] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard3_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard3&wt=javabin&version=2}
 status=0 QTime=2027
   [junit4]   2> 1760062 INFO  (qtp2107197219-19548) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard2_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard2&wt=javabin&version=2}
 status=0 QTime=2024
   [junit4]   2> 1760082 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1760084 INFO  (qtp370618397-19521) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica2] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard1_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2038
   [junit4]   2> 1760196 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760196 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760196 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760196 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760406 INFO  (qtp888377316-19520) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4  x:routeFieldColl_shard4_replica2] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard4_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard4&wt=javabin&version=2}
 status=0 QTime=2369
   [junit4]   2> 1760406 INFO  (qtp569595039-19529) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1  x:routeFieldColl_shard1_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard1_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2370
   [junit4]   2> 1760407 INFO  (qtp888377316-19527) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2  x:routeFieldColl_shard2_replica2] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard2_replica2&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard2&wt=javabin&version=2}
 status=0 QTime=2368
   [junit4]   2> 1760408 INFO  (qtp569595039-19540) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3  x:routeFieldColl_shard3_replica1] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf&newCollection=true&name=routeFieldColl_shard3_replica1&action=CREATE&numShards=4&collection=routeFieldColl&shard=shard3&wt=javabin&version=2}
 status=0 QTime=2370
   [junit4]   2> 1760412 INFO  (qtp888377316-19519) [n:127.0.0.1:64251_solr    
] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 1760522 INFO  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760522 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760522 INFO  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1760522 INFO  
(zkCallback-3619-thread-1-processing-n:127.0.0.1:64251_solr) 
[n:127.0.0.1:64251_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/routeFieldColl/state.json] for collection [routeFieldColl] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1761422 INFO  (qtp888377316-19519) [n:127.0.0.1:64251_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=3&router.field=shard_s&name=routeFieldColl&action=CREATE&numShards=4&wt=javabin&version=2}
 status=0 QTime=3504
   [junit4]   2> 1761433 INFO  (qtp569595039-19544) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard3_replica1]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/&wt=javabin&version=2}{add=[6
 (1569713639779205120), 7 (1569713639782350848)]} 0 1
   [junit4]   2> 1761433 INFO  (qtp569595039-19536) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1 r:core_node1 x:routeFieldColl_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard1_replica1]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard1_replica2/&wt=javabin&version=2}{add=[8
 (1569713639779205120)]} 0 1
   [junit4]   2> 1761434 INFO  (qtp370618397-19526) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3 r:core_node2 x:routeFieldColl_shard3_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard3_replica2]  
webapp=/solr path=/update 
params={_stateVer_=routeFieldColl:5&wt=javabin&version=2}{add=[6 
(1569713639779205120), 7 (1569713639782350848)]} 0 7
   [junit4]   2> 1761434 INFO  (qtp370618397-19525) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1 r:core_node8 x:routeFieldColl_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard1_replica2]  
webapp=/solr path=/update 
params={_stateVer_=routeFieldColl:5&wt=javabin&version=2}{add=[8 
(1569713639779205120)]} 0 7
   [junit4]   2> 1761439 INFO  (qtp370618397-19531) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1 r:core_node8 x:routeFieldColl_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761439 INFO  (qtp370618397-19531) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard1 r:core_node8 x:routeFieldColl_shard1_replica2] 
o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@36960393
   [junit4]   2> 1761440 INFO  (qtp569595039-19541) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1 r:core_node1 x:routeFieldColl_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761440 INFO  (qtp569595039-19541) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard1 r:core_node1 x:routeFieldColl_shard1_replica1] 
o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@717e6a7c
   [junit4]   2> 1761441 INFO  (qtp888377316-19517) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2 r:core_node7 x:routeFieldColl_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761441 INFO  (qtp888377316-19517) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2 r:core_node7 x:routeFieldColl_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1761441 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3 r:core_node2 x:routeFieldColl_shard3_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761441 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3 r:core_node2 x:routeFieldColl_shard3_replica2] 
o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@4efd1831
   [junit4]   2> 1761441 INFO  (qtp888377316-19517) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2 r:core_node7 x:routeFieldColl_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1761441 INFO  (qtp888377316-19517) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard2 r:core_node7 x:routeFieldColl_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard2_replica2]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 0
   [junit4]   2> 1761442 INFO  (qtp2107197219-19550) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2 r:core_node6 x:routeFieldColl_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761442 INFO  (qtp2107197219-19550) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2 r:core_node6 x:routeFieldColl_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1761442 INFO  (qtp2107197219-19550) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2 r:core_node6 x:routeFieldColl_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1761443 INFO  (qtp888377316-19532) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4 r:core_node3 x:routeFieldColl_shard4_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761443 INFO  (qtp888377316-19532) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4 r:core_node3 x:routeFieldColl_shard4_replica2] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1761443 INFO  (qtp569595039-19542) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761443 INFO  (qtp888377316-19532) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4 r:core_node3 x:routeFieldColl_shard4_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1761443 INFO  (qtp2107197219-19551) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4 r:core_node5 x:routeFieldColl_shard4_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1761443 INFO  (qtp2107197219-19550) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard2 r:core_node6 x:routeFieldColl_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard2_replica1]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 1
   [junit4]   2> 1761443 INFO  (qtp569595039-19542) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@5546a712
   [junit4]   2> 1761443 INFO  (qtp888377316-19532) [n:127.0.0.1:64251_solr 
c:routeFieldColl s:shard4 r:core_node3 x:routeFieldColl_shard4_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard4_replica2]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 0
   [junit4]   2> 1761443 INFO  (qtp2107197219-19551) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4 r:core_node5 x:routeFieldColl_shard4_replica1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1761444 INFO  (qtp2107197219-19551) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4 r:core_node5 x:routeFieldColl_shard4_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1761444 INFO  (qtp2107197219-19551) [n:127.0.0.1:64250_solr 
c:routeFieldColl s:shard4 r:core_node5 x:routeFieldColl_shard4_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard4_replica1]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 1
   [junit4]   2> 1761453 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3 r:core_node2 x:routeFieldColl_shard3_replica2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7fcb6430[routeFieldColl_shard3_replica2] main]
   [junit4]   2> 1761453 INFO  (qtp569595039-19542) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7cc167f[routeFieldColl_shard3_replica1] main]
   [junit4]   2> 1761454 INFO  (qtp569595039-19542) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1761454 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3 r:core_node2 x:routeFieldColl_shard3_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1761454 INFO  
(searcherExecutor-8373-thread-1-processing-n:127.0.0.1:64249_solr 
x:routeFieldColl_shard3_replica2 s:shard3 c:routeFieldColl r:core_node2) 
[n:127.0.0.1:64249_solr c:routeFieldColl s:shard3 r:core_node2 
x:routeFieldColl_shard3_replica2] o.a.s.c.SolrCore 
[routeFieldColl_shard3_replica2] Registered new searcher 
Searcher@7fcb6430[routeFieldColl_shard3_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.7.0):C2)))}
   [junit4]   2> 1761454 INFO  
(searcherExecutor-8368-thread-1-processing-n:127.0.0.1:64248_solr 
x:routeFieldColl_shard3_replica1 s:shard3 c:routeFieldColl r:core_node4) 
[n:127.0.0.1:64248_solr c:routeFieldColl s:shard3 r:core_node4 
x:routeFieldColl_shard3_replica1] o.a.s.c.SolrCore 
[routeFieldColl_shard3_replica1] Registered new searcher 
Searcher@7cc167f[routeFieldColl_shard3_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.7.0):C2)))}
   [junit4]   2> 1761454 INFO  (qtp370618397-19524) [n:127.0.0.1:64249_solr 
c:routeFieldColl s:shard3 r:core_node2 x:routeFieldColl_shard3_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard3_replica2]  
webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:64249/solr/routeFieldColl_shard3_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 13
   [junit4]   2> 1761454 INFO  (qtp569595039-19542) [n:127.0.0.1:64248_solr 
c:routeFieldColl s:shard3 r:core_node4 x:routeFieldColl_shard3_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [routeFieldColl_shard3_replica1]  
webapp=/solr path=/update params={update.distrib

[...truncated too long message...]

per... (4) -> (2)
   [junit4]   2> 1804605 INFO  
(zkCallback-3620-thread-2-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:64249_solr
   [junit4]   2> 1804607 INFO  (jetty-closer-3599-thread-4) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2232c280{/solr,null,UNAVAILABLE}
   [junit4]   2> 1804607 INFO  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 1806104 WARN  
(zkCallback-3617-thread-1-processing-n:127.0.0.1:64250_solr) 
[n:127.0.0.1:64250_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1806105 INFO  (jetty-closer-3599-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@75884cd9{/solr,null,UNAVAILABLE}
   [junit4]   2> 1806105 WARN  
(zkCallback-3618-thread-1-processing-n:127.0.0.1:64248_solr) 
[n:127.0.0.1:64248_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1806105 INFO  (jetty-closer-3599-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@49192f6b{/solr,null,UNAVAILABLE}
   [junit4]   2> 1806108 WARN  
(zkCallback-3620-thread-1-processing-n:127.0.0.1:64249_solr) 
[n:127.0.0.1:64249_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1806108 INFO  (jetty-closer-3599-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5b6df796{/solr,null,UNAVAILABLE}
   [junit4]   2> 1806109 ERROR 
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1806110 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:64246 64246
   [junit4]   2> 1806194 INFO  (Thread-3879) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:64246 64246
   [junit4]   2> 1806302 WARN  (Thread-3879) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        11      /solr/configs/conf
   [junit4]   2>        9       /solr/clusterprops.json
   [junit4]   2>        9       /solr/aliases.json
   [junit4]   2>        4       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        9       /solr/clusterstate.json
   [junit4]   2>        4       
/solr/collections/testCreateShardRepFactor/state.json
   [junit4]   2>        4       /solr/collections/routeFieldColl/state.json
   [junit4]   2>        4       /solr/collections/implicitcoll/state.json
   [junit4]   2>        4       /solr/collections/withShardField/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        32      /solr/collections
   [junit4]   2>        9       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 1806303 INFO  
(SUITE-CustomCollectionTest-seed#[DB7A130E558A4DEA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_DB7A130E558A4DEA-001
   [junit4]   2> Jun 09, 2017 8:07:07 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62), 
sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=en-SG, timezone=JST
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_131 
(64-bit)/cpus=3,threads=1,free=133420912,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldResource, 
ClassificationUpdateProcessorTest, UUIDUpdateProcessorFallbackTest, 
TestRTGBase, CdcrRequestHandlerTest, HdfsChaosMonkeyNothingIsSafeTest, 
BlockJoinFacetSimpleTest, HdfsDirectoryTest, 
ConcurrentDeleteAndCreateCollectionTest, DistributedSuggestComponentTest, 
TestMaxScoreQueryParser, TestElisionMultitermQuery, MetricUtilsTest, 
TestCustomDocTransformer, TestConfigSetImmutable, SpatialFilterTest, 
InfixSuggestersTest, DocumentAnalysisRequestHandlerTest, RollingRestartTest, 
TestDistribIDF, TestSimpleQParserPlugin, DirectSolrConnectionTest, 
TestLFUCache, TestReplicationHandler, TestSweetSpotSimilarityFactory, 
FullHLLTest, ClassificationUpdateProcessorFactoryTest, HdfsRecoverLeaseTest, 
DateFieldTest, TestLockTree, TestAnalyzedSuggestions, 
TestRequestStatusCollectionAPI, TestBinaryField, ConfigureRecoveryStrategyTest, 
TestPostingsSolrHighlighter, TestRemoteStreaming, TestFileDictionaryLookup, 
BigEndianAscendingWordDeserializerTest, OverseerModifyCollectionTest, 
ZkStateReaderTest, PeerSyncWithIndexFingerprintCachingTest, 
TestStressLiveNodes, TestReloadAndDeleteDocs, TestCSVLoader, 
RequiredFieldsTest, SmileWriterTest, StandardRequestHandlerTest, 
SpatialRPTFieldTypeTest, TestSolrFieldCacheMBean, SolrPluginUtilsTest, 
TestHttpShardHandlerFactory, ReplicationFactorTest, TestHashQParserPlugin, 
TestReplicaProperties, SuggestComponentContextFilterQueryTest, 
BadComponentTest, TestSolrDynamicMBean, LeaderInitiatedRecoveryOnCommitTest, 
TestCollectionAPI, NodeMutatorTest, DistributedFacetExistsSmallTest, 
DistributedSpellCheckComponentTest, TestBulkSchemaAPI, SOLR749Test, 
TestSolrCloudWithKerberosAlt, AssignTest, TestJsonRequest, 
XmlUpdateRequestHandlerTest, HighlighterTest, TestOnReconnectListenerSupport, 
OverseerTest, LeaderElectionTest, TestHalfAndHalfDocValues, 
QueryElevationComponentTest, TestRawResponseWriter, 
SharedFSAutoReplicaFailoverTest, OverriddenZkACLAndCredentialsProvidersTest, 
DirectSolrSpellCheckerTest, TestTolerantSearch, 
CollectionsAPIAsyncDistributedZkTest, MigrateRouteKeyTest, TestDocumentBuilder, 
TestWordDelimiterFilterFactory, TestSchemalessBufferedUpdates, 
TestReplicationHandlerBackup, ZkNodePropsTest, SimplePostToolTest, ZkCLITest, 
NumericFieldsTest, DocValuesMultiTest, TriLevelCompositeIdRoutingTest, 
ParsingFieldUpdateProcessorsTest, TestReloadDeadlock, 
AnalysisAfterCoreReloadTest, MoveReplicaTest, BlockJoinFacetDistribTest, 
TestUseDocValuesAsStored2, TestImpersonationWithHadoopAuth, TestCryptoKeys, 
TestFunctionQuery, HttpPartitionTest, SolrMetricManagerTest, 
TestTolerantUpdateProcessorRandomCloud, 
TestDistributedStatsComponentCardinality, PeerSyncTest, 
TestDFISimilarityFactory, DOMUtilTest, AnalyticsQueryTest, 
TestPseudoReturnFields, FastVectorHighlighterTest, TestExtendedDismaxParser, 
ShufflingReplicaListTransformerTest, VersionInfoTest, 
CloudExitableDirectoryReaderTest, DistributedFacetPivotLongTailTest, 
TestComplexPhraseLeadingWildcard, JvmMetricsTest, TestSortByMinMaxFunction, 
TestBinaryResponseWriter, TestMinMaxOnMultiValuedField, TestCollationField, 
TestConfigSets, BlockDirectoryTest, DocValuesTest, RulesTest, 
LeaderFailoverAfterPartitionTest, IndexSchemaRuntimeFieldTest, 
TestAddFieldRealTimeGet, TestSolrQueryResponse, 
HdfsCollectionsAPIDistributedZkTest, TestStressRecovery, 
TestReRankQParserPlugin, PrimUtilsTest, TestFieldTypeResource, 
DocumentBuilderTest, ConnectionManagerTest, TestFastLRUCache, TestDocTermOrds, 
TestSort, JSONWriterTest, TestXmlQParser, TestMultiWordSynonyms, 
TestLeaderElectionWithEmptyReplica, TestLRUCache, V2ApiIntegrationTest, 
TestCursorMarkWithoutUniqueKey, StressHdfsTest, TestSubQueryTransformer, 
DistributedQueryElevationComponentTest, ManagedSchemaRoundRobinCloudTest, 
TestBM25SimilarityFactory, TestScoreJoinQPNoScore, BasicDistributedZkTest, 
BaseCdcrDistributedZkTest, TestLazyCores, 
DocExpirationUpdateProcessorFactoryTest, TestSolrIndexConfig, 
TestRandomCollapseQParserPlugin, TestJmxIntegration, TestSolrDeletionPolicy1, 
SolrRequestParserTest, TestJettySolrRunner, TestFieldCacheReopen, 
SegmentsInfoRequestHandlerTest, TestInPlaceUpdatesStandalone, TestCharFilters, 
SoftAutoCommitTest, DeleteReplicaTest, TestPartialUpdateDeduplication, 
TestDistributedSearch, TestSolrConfigHandlerConcurrent, 
CdcrReplicationDistributedZkTest, DocValuesMissingTest, BitVectorTest, 
TestManagedSchemaAPI, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, 
SyncSliceTest, OpenCloseCoreStressTest, ShardRoutingTest, RecoveryZkTest, 
FullSolrCloudDistribCmdsTest, TestRandomDVFaceting, TestDistributedGrouping, 
TestHashPartitioner, TermVectorComponentDistributedTest, 
DistributedTermsComponentTest, SimpleFacetsTest, SolrCoreTest, 
TestGroupingSearch, DirectUpdateHandlerTest, TestIndexSearcher, 
CurrencyFieldXmlFileTest, TestCoreDiscovery, CoreAdminHandlerTest, 
SchemaVersionSpecificBehaviorTest, DefaultValueUpdateProcessorTest, 
StatelessScriptUpdateProcessorFactoryTest, XsltUpdateRequestHandlerTest, 
IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, 
TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, 
FileBasedSpellCheckerTest, TestValueSourceCache, TestIndexingPerformance, 
FieldAnalysisRequestHandlerTest, TestCSVResponseWriter, 
UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, 
PingRequestHandlerTest, ResponseLogComponentTest, MultiTermTest, SampleTest, 
TestConfig, OutputWriterTest, ExternalFileFieldSortTest, 
TestSolrCoreProperties, SpellPossibilityIteratorTest, SynonymTokenizerTest, 
TestPerFieldSimilarity, TestFastWriter, TimeZoneUtilsTest, 
TestFastOutputStream, OpenExchangeRatesOrgProviderTest, 
ChaosMonkeyNothingIsSafeTest, TestHighlightDedupGrouping, 
TestSimpleTrackingShardHandler, CleanupOldIndexTest, 
CollectionTooManyReplicasTest, ConfigSetsAPITest, CreateCollectionCleanupTest, 
CustomCollectionTest]
   [junit4] Completed [498/715 (1!)] on J0 in 49.58s, 4 tests, 1 error <<< 
FAILURES!

[...truncated 44187 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to