Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/785/

5 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
shard1 is not consistent.  Got 79 from 
http://127.0.0.1:49987/_t/e/collection1lastClient and got 68 from 
http://127.0.0.1:59523/_t/e/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 79 from 
http://127.0.0.1:49987/_t/e/collection1lastClient and got 68 from 
http://127.0.0.1:59523/_t/e/collection1
        at 
__randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:69F9FBA859143664]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1246)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1225)
        at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:165)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


REGRESSION:  
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, 
_127s.fdx, _127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, 
_127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, 
_1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, 
_1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, 
_129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, 
segments_2]}]> but 
was:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, _127s.fdx, 
_127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, 
_127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, 
_1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, 
_1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, 
_129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, 
segments_2]}, {indexVersion=1441391962566,generation=3,filelist=[_129c.fdt, 
_129c.fdx, _129c.fnm, _129c.nvd, _129c.nvm, _129c.si, _129c_Lucene50_0.doc, 
_129c_Lucene50_0.tim, _129c_Lucene50_0.tip, _12ev.cfe, _12ev.cfs, _12ev.si, 
_12ew.cfe, _12ew.cfs, _12ew.si, segments_3]}]>

Stack Trace:
java.lang.AssertionError: 
expected:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, 
_127s.fdx, _127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, 
_127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, 
_1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, 
_1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, 
_129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, 
segments_2]}]> but 
was:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, _127s.fdx, 
_127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, 
_127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, 
_1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, 
_1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, 
_129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, 
segments_2]}, {indexVersion=1441391962566,generation=3,filelist=[_129c.fdt, 
_129c.fdx, _129c.fnm, _129c.nvd, _129c.nvm, _129c.si, _129c_Lucene50_0.doc, 
_129c_Lucene50_0.tim, _129c_Lucene50_0.tip, _12ev.cfe, _12ev.cfs, _12ev.si, 
_12ew.cfe, _12ew.cfs, _12ew.si, segments_3]}]>
        at 
__randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:C47ADF4287A0559F]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at 
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.security.BasicAuthIntegrationTest.testBasics

Error Message:
expected:<200> but was:<403>

Stack Trace:
java.lang.AssertionError: expected:<200> but was:<403>
        at 
__randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:DC756A5ECF0605EC]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.security.BasicAuthIntegrationTest.doExtraTests(BasicAuthIntegrationTest.java:144)
        at 
org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testCollectionCreateSearchDelete(TestMiniSolrCloudClusterBase.java:198)
        at 
org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testBasics(TestMiniSolrCloudClusterBase.java:79)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=42701, name=collection3, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=42701, name=collection3, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46308: collection already exists: 
awholynewstresscollection_collection3_4
        at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=66562, name=collection0, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=66562, name=collection0, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:57124: Could not find collection : 
awholynewstresscollection_collection0_1
        at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10472 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/init-core-data-001
   [junit4]   2> 1602121 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[E1ADC472F7E85B9C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1602121 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[E1ADC472F7E85B9C]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1602123 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1602124 INFO  (Thread-37013) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1602124 INFO  (Thread-37013) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1602224 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:52477
   [junit4]   2> 1602224 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602225 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602228 INFO  (zkCallback-1009-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ad63253 
name:ZooKeeperConnection Watcher:127.0.0.1:52477 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602228 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602229 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602229 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1602233 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602235 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602237 INFO  (zkCallback-1010-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6a554a61 
name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602237 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602238 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602238 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1602240 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1602241 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1602243 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1602245 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1602245 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1602248 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1602248 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1602250 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602250 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602252 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1602252 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1602255 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1602255 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1602258 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1602258 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1602266 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1602266 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1602268 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1602268 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1602273 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602273 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602278 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1602278 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1602289 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1602290 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1602293 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602299 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602309 INFO  (zkCallback-1011-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@57d0a49 name:ZooKeeperConnection 
Watcher:127.0.0.1:52477 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1602309 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602310 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602310 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1602311 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602312 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602313 INFO  (zkCallback-1012-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@f453d20 name:ZooKeeperConnection 
Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1602313 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602314 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602314 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 1602314 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1602316 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 1602316 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1602318 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1602319 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1602320 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602321 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602323 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 1602324 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1602328 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 1602329 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1602330 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 1602330 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1602332 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1602332 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1602334 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602335 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602338 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1602338 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1602340 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 1602340 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1602343 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 1602343 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1602786 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1
   [junit4]   2> 1602789 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1602812 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3d79e512{/,null,AVAILABLE}
   [junit4]   2> 1602814 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@4f263076{HTTP/1.1}{127.0.0.1:57975}
   [junit4]   2> 1602814 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.Server Started @1605943ms
   [junit4]   2> 1602814 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/tempDir-001/control/data,
 hostContext=/, hostPort=57975, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores}
   [junit4]   2> 1602815 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1602815 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/'
   [junit4]   2> 1602831 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602833 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602833 INFO  (zkCallback-1013-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b5398d3 
name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602834 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602834 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602839 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1602840 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/solr.xml
   [junit4]   2> 1602860 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores
   [junit4]   2> 1602860 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 176170442
   [junit4]   2> 1602863 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/]
   [junit4]   2> 1602863 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/lib
   [junit4]   2> 1602864 WARN  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/lib).
   [junit4]   2> 1602871 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1602875 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1602875 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1602875 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1602875 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52477/solr
   [junit4]   2> 1602876 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1602876 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602876 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602878 INFO  (zkCallback-1015-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@66cfba8 name:ZooKeeperConnection 
Watcher:127.0.0.1:52477 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1602879 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602879 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602896 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 1602897 INFO  
(zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@74d4377c 
name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602897 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 1602899 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1602904 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1602909 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 1602913 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1602918 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1602920 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1602922 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1602924 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1602926 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1602927 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:57975_
   [junit4]   2> 1602928 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:57975_
   [junit4]   2> 1602930 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1602932 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 1602934 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1602934 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/94462968368857094-127.0.0.1:57975_-n_0000000000
   [junit4]   2> 1602935 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:57975_
   [junit4]   2> 1602935 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1602937 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer Overseer 
(id=94462968368857094-127.0.0.1:57975_-n_0000000000) starting
   [junit4]   2> 1602940 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1602948 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1602948 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 1602949 INFO  
(OverseerCollectionConfigSetProcessor-94462968368857094-127.0.0.1:57975_-n_0000000000)
 [n:127.0.0.1:57975_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 1602950 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1602963 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 1602964 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1602964 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.CoresLocator Looking for core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores
   [junit4]   2> 1602965 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1,
 collection=control_collection, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1602965 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/
   [junit4]   2> 1602965 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1602968 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1602969 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 1602969 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) 
[n:127.0.0.1:57975_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 1602969 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 1602971 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975";,
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1602971 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 1602972 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975";,
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1602973 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 1602973 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 1602975 INFO  
(zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1603972 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1603972 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 1603973 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 1603973 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 1603973 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 1603974 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/'
   [junit4]   2> 1603991 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.Config loaded 
config solrconfig.xml with version 0 
   [junit4]   2> 1604007 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
current version of requestparams : -1
   [junit4]   2> 1604016 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1604031 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.Config Loaded 
SolrConfig: solrconfig.xml
   [junit4]   2> 1604033 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1604039 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 1604172 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1604179 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
default search field in schema is text
   [junit4]   2> 1604180 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
unique key field: id
   [junit4]   2> 1604211 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1604216 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1604220 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 1604221 WARN  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1604221 WARN  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1604221 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 1604223 WARN  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1604223 WARN  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1604224 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1604224 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 1604224 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1604224 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/],
 dataDir=[null]
   [junit4]   2> 1604225 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@509c2215
   [junit4]   2> 1604225 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data
   [junit4]   2> 1604226 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1604226 WARN  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1604226 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/index
   [junit4]   2> 1604227 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1604227 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@d0a2efe 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@183cb0c7),segFN=segments_1,generation=1}
   [junit4]   2> 1604227 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1604228 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/
   [junit4]   2> 1604228 WARN  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.DirectoryFactory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/
 does not point to a valid data directory; skipping clean-up of old index 
directories.
   [junit4]   2> 1604237 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"nodistrib"
   [junit4]   2> 1604238 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 1604238 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1604238 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 1604238 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1604238 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-explicit"
   [junit4]   2> 1604239 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1604240 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1604240 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 1604243 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604246 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604262 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604265 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604273 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1604273 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1604304 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1604304 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1604305 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1604305 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1604308 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=38, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=88.2109375, 
floorSegmentMB=0.5576171875, forceMergeDeletesPctAllowed=3.3935385338130497, 
segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.7313505472677709
   [junit4]   2> 1604308 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@d0a2efe 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@183cb0c7),segFN=segments_1,generation=1}
   [junit4]   2> 1604308 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1604309 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening Searcher@4a0f2721[collection1] main
   [junit4]   2> 1604309 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 1604309 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 1604310 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the 
RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1604310 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1604310 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1604310 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1604311 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 1604311 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1604311 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1604311 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1604312 INFO  
(searcherExecutor-3667-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@4a0f2721[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1604312 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1604312 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version 
buckets from index
   [junit4]   2> 1604312 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket 
highest value from index
   [junit4]   2> 1604312 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1511407496193900544
   [junit4]   2> 1604314 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 
1511407496193900544
   [junit4]   2> 1604315 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1604316 INFO  
(coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) 
[n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1604317 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:57975 
collection:control_collection shard:shard1
   [junit4]   2> 1604318 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1604326 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/94462968368857094-core_node1-n_0000000000
   [junit4]   2> 1604327 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1604330 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1604330 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1604331 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1604331 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:57975/collection1/
   [junit4]   2> 1604331 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 1604331 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:57975/collection1/ has no replicas
   [junit4]   2> 1604332 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:57975/collection1/ shard1
   [junit4]   2> 1604334 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1604340 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1604345 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:57975";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1604447 INFO  
(zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1604448 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:57975/collection1/ and leader is 
http://127.0.0.1:57975/collection1/
   [junit4]   2> 1604448 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57975
   [junit4]   2> 1604448 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 1604448 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
publishing state=active
   [junit4]   2> 1604448 INFO  
(coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 1604452 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975";,
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1604453 INFO  
(OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) 
[n:127.0.0.1:57975_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975";,
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1604470 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1604488 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1604490 INFO  (zkCallback-1018-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2e504d4c 
name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1604490 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1604490 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1604490 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1604493 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 1604556 INFO  (zkCallback-1018-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1604556 INFO  
(zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1605271 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001/cores/collection1
   [junit4]   2> 1605272 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001
   [junit4]   2> 1605275 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1605280 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@678f86ea{/,null,AVAILABLE}
   [junit4]   2> 1605280 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@6b7c3082{HTTP/1.1}{127.0.0.1:49517}
   [junit4]   2> 1605280 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.e.j.s.Server Started @1608410ms
   [junit4]   2> 1605281 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/tempDir-001/jetty1,
 solrconfig=solrconfig.xml, hostContext=/, hostPort=49517, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001/cores}
   [junit4]   2> 1605281 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1605281 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001/'
   [junit4]   2> 1605297 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1605297 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1605299 INFO  (zkCallback-1019-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@55b6271 name:ZooKeeperConnection 
Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1605299 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1605299 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1605300 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.

[...truncated too long message...]

ion/leader_elect/shard2/election
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:336)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:333)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:107)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4077203 WARN  
(zkCallback-2257-thread-4-processing-n:127.0.0.1:60908_solr) 
[n:127.0.0.1:60908_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK
   [junit4]   2> 4077207 INFO  (jetty-launcher-2217-thread-4) 
[n:127.0.0.1:60908_solr c:testSolrCloudCollection s:shard2 r:core_node1 
x:testSolrCloudCollection_shard2_replica2] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@74f56eea{/solr,null,UNAVAILABLE}
   [junit4]   2> 4077211 INFO  
(TEST-BasicAuthIntegrationTest.testBasics-seed#[E1ADC472F7E85B9C]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:47492 47492
   [junit4]   2> 4077381 INFO  (Thread-61878) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:47492 47492
   [junit4]   2> 4077383 WARN  (Thread-61878) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        11      /solr/aliases.json
   [junit4]   2>        9       /solr/security.json
   [junit4]   2>        6       /solr/configs/solrCloudCollectionConfig
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        11      /solr/clusterstate.json
   [junit4]   2>        5       
/solr/collections/testSolrCloudCollection/state.json
   [junit4]   2>        3       
/solr/overseer_elect/election/94463128016125964-127.0.0.1:44854_solr-n_0000000001
   [junit4]   2>        3       /solr/security.json
   [junit4]   2>        3       
/solr/collections/testSolrCloudCollection/leader_elect/shard1/election/94463128016125961-core_node2-n_0000000000
   [junit4]   2>        3       
/solr/overseer_elect/election/94463128016125961-127.0.0.1:55346_solr-n_0000000004
   [junit4]   2>        3       
/solr/collections/testSolrCloudCollection/leader_elect/shard2/election/94463128016125962-core_node3-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/94463128016125967-127.0.0.1:50912_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        14      /solr/live_nodes
   [junit4]   2>        12      /solr/collections
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=BasicAuthIntegrationTest -Dtests.method=testBasics 
-Dtests.seed=E1ADC472F7E85B9C -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=sr_ME_#Latn -Dtests.timezone=EST5EDT -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] FAILURE 39.2s J2 | BasicAuthIntegrationTest.testBasics <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<200> but 
was:<403>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:DC756A5ECF0605EC]:0)
   [junit4]    >        at 
org.apache.solr.security.BasicAuthIntegrationTest.doExtraTests(BasicAuthIntegrationTest.java:144)
   [junit4]    >        at 
org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testCollectionCreateSearchDelete(TestMiniSolrCloudClusterBase.java:198)
   [junit4]    >        at 
org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testBasics(TestMiniSolrCloudClusterBase.java:79)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_E1ADC472F7E85B9C-001
   [junit4]   2> Sep 04, 2015 2:56:23 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=DefaultSimilarity, locale=sr_ME_#Latn, timezone=EST5EDT
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=306603720,total=510656512
   [junit4]   2> NOTE: All tests run in this JVM: [UpdateParamsTest, 
TestSolrDynamicMBean, TestDefaultStatsCache, TestPostingsSolrHighlighter, 
NoCacheHeaderTest, HdfsBasicDistributedZkTest, TestExactSharedStatsCache, 
TestScoreJoinQPNoScore, DistributedVersionInfoTest, 
FieldMutatingUpdateProcessorTest, TestAuthorizationFramework, 
TestManagedResourceStorage, HdfsSyncSliceTest, 
OverriddenZkACLAndCredentialsProvidersTest, TestFuzzyAnalyzedSuggestions, 
TestPerFieldSimilarity, BigEndianAscendingWordDeserializerTest, 
DocValuesMultiTest, TestSha256AuthenticationProvider, TestSolrDeletionPolicy1, 
OverseerCollectionConfigSetProcessorTest, TestElisionMultitermQuery, 
TestZkChroot, TestRandomRequestDistribution, SegmentsInfoRequestHandlerTest, 
VersionInfoTest, TestSweetSpotSimilarityFactory, TestCloudSchemaless, 
TestFieldResource, TestCharFilters, TestFieldSortValues, 
RAMDirectoryFactoryTest, CleanupOldIndexTest, TestDocBasedVersionConstraints, 
TestSolrCLIRunExample, TestWriterPerf, TestFastWriter, PluginInfoTest, 
TestLRUStatsCache, DistribJoinFromCollectionTest, 
SolrCoreCheckLockOnStartupTest, CollectionTooManyReplicasTest, 
CloudMLTQParserTest, RequestHandlersTest, 
DistributedQueryComponentCustomSortTest, TestLRUCache, DeleteReplicaTest, 
CollectionReloadTest, TestMiniSolrCloudCluster, TestCursorMarkWithoutUniqueKey, 
JavabinLoaderTest, OverseerStatusTest, HardAutoCommitTest, 
TestExtendedDismaxParser, ClusterStateTest, TestStressReorder, TestSolrXml, 
TestSmileRequest, DebugComponentTest, TestSearchPerf, TestTrieFacet, 
AsyncMigrateRouteKeyTest, TestSchemaSimilarityResource, PrimitiveFieldTypeTest, 
TestCSVResponseWriter, DataDrivenBlockJoinTest, MultiThreadedOCPTest, 
SuggesterTSTTest, TestCollapseQParserPlugin, DirectUpdateHandlerOptimizeTest, 
TestCoreDiscovery, SuggesterTest, MigrateRouteKeyTest, BasicDistributedZk2Test, 
CoreAdminHandlerTest, ZkNodePropsTest, TestBulkSchemaConcurrent, 
TestSolr4Spatial2, TestGroupingSearch, TestCollationField, 
TestPHPSerializedResponseWriter, TestIndexSearcher, TestAddFieldRealTimeGet, 
TestFieldTypeCollectionResource, RecoveryZkTest, QueryParsingTest, 
TestReloadAndDeleteDocs, UnloadDistributedZkTest, 
CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, 
ShardRoutingTest, TestReplicationHandler, SharedFSAutoReplicaFailoverUtilsTest, 
SimpleCollectionCreateDeleteTest, SolrCloudExampleTest, SolrXmlInZkTest, 
TestCloudPivotFacet, TestCollectionAPI, TestConfigSetsAPI, 
TestConfigSetsAPIExclusivity, TestCryptoKeys, TestLeaderElectionZkExpiry, 
TestMiniSolrCloudClusterSSL, TestReplicaProperties, 
HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, 
CoreAdminCreateDiscoverTest, SecurityConfHandlerTest, 
DistributedFacetPivotLargeTest, DistributedQueryComponentOptimizationTest, 
TestDistributedStatsComponentCardinality, TestSearcherReuse, 
TestSimpleQParserPlugin, TestStandardQParsers, TestJsonFacets, 
BasicAuthIntegrationTest]
   [junit4] Completed [518/544] on J2 in 39.52s, 1 test, 1 failure <<< FAILURES!

[...truncated 100 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987:
 There were test failures: 544 suites, 2141 tests, 2 errors, 3 failures, 29 
ignored (17 assumptions)

Total time: 200 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to