Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/804/

5 tests failed.
REGRESSION:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:
Timeout waiting for all live and active

Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
        at 
__randomizedtesting.SeedInfo.seed([2F57DB516E201E99:A703E48BC0DC7361]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:238)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:108)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


REGRESSION:  
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1443224941619,generation=2,filelist=[_5.cfe, _5.cfs, 
_5.si, _7.cfe, _7.cfs, _7.si, _8.cfe, _8.cfs, _8.si, segments_2]}]> but 
was:<[{indexVersion=1443224941619,generation=2,filelist=[_5.cfe, _5.cfs, _5.si, 
_7.cfe, _7.cfs, _7.si, _8.cfe, _8.cfs, _8.si, segments_2]}, 
{indexVersion=1443224941619,generation=3,filelist=[_5.cfe, _5.cfs, _5.si, 
_9.fdt, _9.fdx, _9.fnm, _9.nvd, _9.nvm, _9.si, _9_LuceneFixedGap_0.doc, 
_9_LuceneFixedGap_0.tib, _9_LuceneFixedGap_0.tii, segments_3]}]>

Stack Trace:
java.lang.AssertionError: 
expected:<[{indexVersion=1443224941619,generation=2,filelist=[_5.cfe, _5.cfs, 
_5.si, _7.cfe, _7.cfs, _7.si, _8.cfe, _8.cfs, _8.si, segments_2]}]> but 
was:<[{indexVersion=1443224941619,generation=2,filelist=[_5.cfe, _5.cfs, _5.si, 
_7.cfe, _7.cfs, _7.si, _8.cfe, _8.cfs, _8.si, segments_2]}, 
{indexVersion=1443224941619,generation=3,filelist=[_5.cfe, _5.cfs, _5.si, 
_9.fdt, _9.fdx, _9.fnm, _9.nvd, _9.nvm, _9.si, _9_LuceneFixedGap_0.doc, 
_9_LuceneFixedGap_0.tib, _9_LuceneFixedGap_0.tii, segments_3]}]>
        at 
__randomizedtesting.SeedInfo.seed([2F57DB516E201E99:A80C0611E68109A]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at 
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


REGRESSION:  
org.apache.solr.search.stats.TestDistribIDF.testMultiCollectionQuery

Error Message:
Doc1 score=1.6931472 Doc2 score=1.6931472 expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: Doc1 score=1.6931472 Doc2 score=1.6931472 
expected:<1> but was:<0>
        at 
__randomizedtesting.SeedInfo.seed([2F57DB516E201E99:3E241C60B2561BE5]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at 
org.apache.solr.search.stats.TestDistribIDF.testMultiCollectionQuery(TestDistribIDF.java:181)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=8434, name=collection5, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=8434, name=collection5, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:53762/c_dl/n: Could not find collection : 
awholynewstresscollection_collection5_3
        at __randomizedtesting.SeedInfo.seed([2F57DB516E201E99]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=34017, name=collection3, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=34017, name=collection3, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:59564: Could not find collection : 
awholynewstresscollection_collection3_0
        at __randomizedtesting.SeedInfo.seed([2F57DB516E201E99]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10352 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/init-core-data-001
   [junit4]   2> 1209161 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2F57DB516E201E99]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1209161 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[2F57DB516E201E99]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /c_dl/n
   [junit4]   2> 1209164 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1209165 INFO  (Thread-3621) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1209165 INFO  (Thread-3621) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1209265 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:50783
   [junit4]   2> 1209265 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1209266 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1209268 INFO  (zkCallback-871-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@638244c name:ZooKeeperConnection 
Watcher:127.0.0.1:50783 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1209268 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1209268 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1209268 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1209271 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1209271 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1209272 INFO  (zkCallback-872-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4cb1f782 
name:ZooKeeperConnection Watcher:127.0.0.1:50783/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1209272 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1209272 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1209272 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1209274 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1209276 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1209277 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1209278 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1209278 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1209281 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1209281 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1209283 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1209283 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1209284 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1209284 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1209286 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1209286 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1209287 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1209287 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1209289 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1209289 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1209290 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1209291 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1209292 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1209292 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1209294 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1209294 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1209295 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1209295 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1209298 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1209298 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1209299 INFO  (zkCallback-873-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3c8a98ab 
name:ZooKeeperConnection Watcher:127.0.0.1:50783 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1209299 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1209300 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1209300 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1209301 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1209301 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1209302 INFO  (zkCallback-874-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@618166ab 
name:ZooKeeperConnection Watcher:127.0.0.1:50783/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1209302 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1209302 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1209303 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 1209303 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1209305 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 1209305 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1209307 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1209307 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1209308 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1209309 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1209310 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 1209310 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1209312 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 1209312 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1209314 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 1209314 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1209316 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1209316 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1209317 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1209318 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1209319 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1209319 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1209321 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 1209321 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1209323 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 1209323 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1209685 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1
   [junit4]   2> 1209689 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1209693 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@24ca0c36{/c_dl/n,null,AVAILABLE}
   [junit4]   2> 1209701 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@2beeaf9b{HTTP/1.1}{127.0.0.1:36525}
   [junit4]   2> 1209702 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.Server Started @1213233ms
   [junit4]   2> 1209702 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/tempDir-001/control/data,
 hostContext=/c_dl/n, hostPort=36525, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores}
   [junit4]   2> 1209707 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1209713 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/'
   [junit4]   2> 1209736 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1209736 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1209738 INFO  (zkCallback-875-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@336b1bd3 
name:ZooKeeperConnection Watcher:127.0.0.1:50783/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1209738 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1209738 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1209739 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 1209739 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/solr.xml
   [junit4]   2> 1209745 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores
   [junit4]   2> 1209745 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1735112810
   [junit4]   2> 1209745 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/]
   [junit4]   2> 1209745 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/lib
   [junit4]   2> 1209745 WARN  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/lib).
   [junit4]   2> 1209753 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1209757 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1209758 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1209758 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1209758 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50783/solr
   [junit4]   2> 1209758 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1209758 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1209759 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1209760 INFO  (zkCallback-877-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1d1802a0 
name:ZooKeeperConnection Watcher:127.0.0.1:50783 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1209760 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1209760 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1209764 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ConnectionManager Waiting for client 
to connect to ZooKeeper
   [junit4]   2> 1209764 INFO  
(zkCallback-878-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2125c61 name:ZooKeeperConnection 
Watcher:127.0.0.1:50783/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1209764 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ConnectionManager Client is 
connected to ZooKeeper
   [junit4]   2> 1209766 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue
   [junit4]   2> 1209769 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1209772 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 1209774 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1209776 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1209779 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1209781 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1209782 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/clusterstate.json
   [junit4]   2> 1209784 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1209786 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36525_c_dl%2Fn
   [junit4]   2> 1209786 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:36525_c_dl%2Fn
   [junit4]   2> 1209788 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect
   [junit4]   2> 1209790 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 1209791 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1209791 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.LeaderElector Joined leadership 
election with path: 
/overseer_elect/election/94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000
   [junit4]   2> 1209792 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.OverseerElectionContext I am going to 
be the leader 127.0.0.1:36525_c_dl%2Fn
   [junit4]   2> 1209792 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 1209793 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer Overseer 
(id=94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) starting
   [junit4]   2> 1209796 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 1209802 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1209803 INFO  
(OverseerCollectionConfigSetProcessor-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000)
 [n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 1209803 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1209804 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer Starting to work on the main 
queue
   [junit4]   2> 1209843 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 1209843 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 1209845 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.CoresLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores
   [junit4]   2> 1209846 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1,
 collection=control_collection, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1209846 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/
   [junit4]   2> 1209846 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1209848 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1209848 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 1209848 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1209848 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 1209850 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:36525/c_dl/n";,
   [junit4]   2>   "node_name":"127.0.0.1:36525_c_dl%2Fn",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1209850 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1209851 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.o.ReplicaMutator Update state 
numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:36525/c_dl/n";,
   [junit4]   2>   "node_name":"127.0.0.1:36525_c_dl%2Fn",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1209851 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: control_collection
   [junit4]   2> 1209852 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 1209854 INFO  
(zkCallback-878-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1210851 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1210851 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1210852 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1210852 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 1210854 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 1210854 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/'
   [junit4]   2> 1210870 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1210874 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1210878 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1210885 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1210886 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1210891 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1210988 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1210995 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1210996 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1211003 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1211005 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1211007 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 1211008 WARN  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1211008 WARN  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1211008 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 1211008 WARN  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1211009 WARN  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1211009 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1211010 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 1211010 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1211010 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/],
 dataDir=[null]
   [junit4]   2> 1211010 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4bacca29
   [junit4]   2> 1211010 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/data
   [junit4]   2> 1211011 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1211011 WARN  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1211011 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/data/index
   [junit4]   2> 1211011 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=23, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 1211011 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@4ef8aa0d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c07e234),segFN=segments_1,generation=1}
   [junit4]   2> 1211011 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1211012 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36525_c_dl%2Fn 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/data/
   [junit4]   2> 1211012 WARN  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36525_c_dl%2Fn 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.DirectoryFactory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/control-001/cores/collection1/data/
 does not point to a valid data directory; skipping clean-up of old index 
directories.
   [junit4]   2> 1211015 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1211015 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1211016 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 1211018 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1211019 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1211020 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1211021 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1211024 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1211024 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1211025 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1211025 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
numVersionBuckets=65536
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.36514461836764855]
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@4ef8aa0d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c07e234),segFN=segments_1,generation=1}
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@25a45d61[collection1] 
main
   [junit4]   2> 1211026 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 1211027 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection 
configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1211027 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based 
storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1211028 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO 
with znodeBase: /configs/conf1
   [junit4]   2> 1211028 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1211028 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1211028 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 1211028 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1211029 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1211029 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1211029 INFO  
(searcherExecutor-3128-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@25a45d61[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1211029 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed 
version buckets
   [junit4]   2> 1211030 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 
65536 version buckets from index
   [junit4]   2> 1211030 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed 
version bucket highest value from index
   [junit4]   2> 1211030 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent 
updates, using new clock 1513329876236500992
   [junit4]   2> 1211032 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with 
highest version 1513329876236500992
   [junit4]   2> 1211032 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1211032 INFO  
(coreLoadExecutor-3127-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1211033 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController Register replica - core:collection1 
address:http://127.0.0.1:36525/c_dl/n collection:control_collection shard:shard1
   [junit4]   2> 1211034 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1211038 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/94583117142622214-core_node1-n_0000000000
   [junit4]   2> 1211038 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process 
for shard shard1
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to 
continue.
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try 
and sync
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:36525/c_dl/n/collection1/
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:36525/c_dl/n/collection1/ 
has no replicas
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:36525/c_dl/n/collection1/ shard1
   [junit4]   2> 1211041 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1211041 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 1211044 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader 
registration node
   [junit4]   2> 1211046 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:36525/c_dl/n";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1211149 INFO  
(zkCallback-878-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1211197 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController We are 
http://127.0.0.1:36525/c_dl/n/collection1/ and leader is 
http://127.0.0.1:36525/c_dl/n/collection1/
   [junit4]   2> 1211197 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 
baseURL=http://127.0.0.1:36525/c_dl/n
   [junit4]   2> 1211197 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1211197 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1211197 INFO  
(coreZkRegister-3121-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn 
x:collection1 s:shard1 c:control_collection r:core_node1) 
[n:127.0.0.1:36525_c_dl%2Fn c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading 
it from system property
   [junit4]   2> 1211199 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:36525/c_dl/n";,
   [junit4]   2>   "node_name":"127.0.0.1:36525_c_dl%2Fn",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1211200 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.o.ReplicaMutator Update state 
numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:36525/c_dl/n";,
   [junit4]   2>   "node_name":"127.0.0.1:36525_c_dl%2Fn",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1211302 INFO  
(zkCallback-878-thread-1-processing-n:127.0.0.1:36525_c_dl%2Fn) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1211350 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1211350 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1211352 INFO  (zkCallback-880-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@244b500f 
name:ZooKeeperConnection Watcher:127.0.0.1:50783/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1211352 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1211352 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1211352 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1211354 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 1211354 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1211355 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1211355 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1211356 INFO  (zkCallback-881-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@551c355c 
name:ZooKeeperConnection Watcher:127.0.0.1:50783/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1211356 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1211356 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1211361 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 1211361 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: collection1
   [junit4]   2> 1211463 INFO  
(OverseerStateUpdate-94583117142622214-127.0.0.1:36525_c_dl%2Fn-n_0000000000) 
[n:127.0.0.1:36525_c_dl%2Fn    ] o.a.s.c.o.ZkStateWriter going to 
create_collection /collections/collection1/state.json
   [junit4]   2> 1211701 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/shard-1-001/cores/collection1
   [junit4]   2> 1211701 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/shard-1-001
   [junit4]   2> 1211702 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1211704 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@14a699b0{/c_dl/n,null,AVAILABLE}
   [junit4]   2> 1211705 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@13ea7088{HTTP/1.1}{127.0.0.1:40537}
   [junit4]   2> 1211705 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.e.j.s.Server Started @1215237ms
   [junit4]   2> 1211705 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/tempDir-001/jetty1,
 solrconfig=solrconfig.xml, hostContext=/c_dl/n, hostPort=40537, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2F57DB516E201E99-001/shard-1-001/cores}
   [juni

[...truncated too long message...]

llback-2034-thread-1-processing-n:127.0.0.1:59983_solr) [n:127.0.0.1:59983_solr 
   ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to 
ZK
   [junit4]   2> 4152080 INFO  (jetty-launcher-2025-thread-2) 
[n:127.0.0.1:59983_solr c:collection2_local s:shard1 r:core_node2 
x:collection2_local_shard1_replica1] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@58ead2cd{/solr,null,UNAVAILABLE}
   [junit4]   2> 4153513 WARN  
(zkCallback-2038-thread-1-processing-n:127.0.0.1:43160_solr) 
[n:127.0.0.1:43160_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK
   [junit4]   2> 4153514 INFO  (jetty-launcher-2025-thread-3) 
[n:127.0.0.1:43160_solr c:collection2 s:shard1 r:core_node1 
x:collection2_shard1_replica1] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3d77c623{/solr,null,UNAVAILABLE}
   [junit4]   2> 4153516 INFO  
(TEST-TestDistribIDF.testMultiCollectionQuery-seed#[2F57DB516E201E99]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:37425 37425
   [junit4]   2> 4153845 INFO  (Thread-55383) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:37425 37425
   [junit4]   2> 4153846 WARN  (Thread-55383) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2>        3       /solr/security.json
   [junit4]   2>        3       /solr/configs/conf1
   [junit4]   2>        2       /solr/configs/conf2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2>        2       /solr/collections/collection2_local/state.json
   [junit4]   2>        2       /solr/collections/collection1_local/state.json
   [junit4]   2>        2       /solr/collections/collection1/state.json
   [junit4]   2>        2       /solr/collections/collection2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/live_nodes
   [junit4]   2>        4       /solr/collections
   [junit4]   2> 
   [junit4]   2> 4153846 INFO  
(TEST-TestDistribIDF.testMultiCollectionQuery-seed#[2F57DB516E201E99]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testMultiCollectionQuery
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistribIDF 
-Dtests.method=testMultiCollectionQuery -Dtests.seed=2F57DB516E201E99 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=el_GR -Dtests.timezone=Etc/GMT-7 -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] FAILURE 14.2s J2 | TestDistribIDF.testMultiCollectionQuery <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc1 score=1.6931472 
Doc2 score=1.6931472 expected:<1> but was:<0>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2F57DB516E201E99:3E241C60B2561BE5]:0)
   [junit4]    >        at 
org.apache.solr.search.stats.TestDistribIDF.testMultiCollectionQuery(TestDistribIDF.java:181)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4153849 INFO  
(SUITE-TestDistribIDF-seed#[2F57DB516E201E99]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_2F57DB516E201E99-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): 
{range_facet_l_dv=Lucene50(blocksize=128), 
_version_=PostingsFormat(name=Asserting), multiDefault=Lucene50(blocksize=128), 
cat=Lucene50(blocksize=128), intDefault=PostingsFormat(name=Asserting), 
id=Lucene50(blocksize=128), range_facet_i_dv=Lucene50(blocksize=128), 
_route_=PostingsFormat(name=Direct), range_facet_l=Lucene50(blocksize=128), 
timestamp=Lucene50(blocksize=128)}, 
docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), 
range_facet_i_dv=DocValuesFormat(name=Lucene50), 
timestamp=DocValuesFormat(name=Lucene50)}, sim=ClassicSimilarity, locale=el_GR, 
timezone=Etc/GMT-7
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=216515584,total=488112128
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestSha256AuthenticationProvider, TestRecovery, TestIndexingPerformance, 
OverseerCollectionConfigSetProcessorTest, SuggesterTSTTest, 
TestHashQParserPlugin, TestPerFieldSimilarity, PrimitiveFieldTypeTest, 
AssignTest, DocValuesMultiTest, DirectUpdateHandlerTest, 
TestReRankQParserPlugin, SolrCoreCheckLockOnStartupTest, TestIndexSearcher, 
QueryParsingTest, TestScoreJoinQPNoScore, SystemInfoHandlerTest, 
TestReversedWildcardFilterFactory, UUIDFieldTest, TestSolrXml, 
TestXIncludeConfig, StatsComponentTest, DistributedFacetPivotSmallAdvancedTest, 
TestExpandComponent, RecoveryZkTest, UnloadDistributedZkTest, 
OverriddenZkACLAndCredentialsProvidersTest, TestHighFrequencyDictionaryFactory, 
ConcurrentDeleteAndCreateCollectionTest, DistributedDebugComponentTest, 
RegexBoostProcessorTest, BasicAuthIntegrationTest, 
StatelessScriptUpdateProcessorFactoryTest, HdfsWriteToMultipleCollectionsTest, 
TestSolrIndexConfig, TestManagedSynonymFilterFactory, TestSmileRequest, 
CdcrUpdateLogTest, TermVectorComponentDistributedTest, NoCacheHeaderTest, 
TestManagedResource, ShowFileRequestHandlerTest, TestStressReorder, 
TestShardHandlerFactory, XmlUpdateRequestHandlerTest, PluginInfoTest, 
TestGroupingSearch, TestDefaultStatsCache, BinaryUpdateRequestHandlerTest, 
CloudMLTQParserTest, TestExtendedDismaxParser, SecurityConfHandlerTest, 
SimpleFacetsTest, DistributedFacetPivotSmallTest, BasicDistributedZk2Test, 
TestSolrCLIRunExample, CdcrVersionReplicationTest, UpdateParamsTest, 
AsyncMigrateRouteKeyTest, DirectUpdateHandlerOptimizeTest, LeaderElectionTest, 
ParsingFieldUpdateProcessorsTest, SuggesterWFSTTest, OverseerTaskQueueTest, 
AutoCommitTest, QueryResultKeyTest, TestConfigReload, TestSolr4Spatial2, 
BadIndexSchemaTest, TestWriterPerf, SolrXmlInZkTest, TestCSVResponseWriter, 
CursorMarkTest, RequestHandlersTest, TestMinMaxOnMultiValuedField, 
HdfsDirectoryFactoryTest, TestDocBasedVersionConstraints, 
AnalyticsMergeStrategyTest, HighlighterConfigTest, 
TestDynamicFieldCollectionResource, SharedFSAutoReplicaFailoverUtilsTest, 
RecoveryAfterSoftCommitTest, TestMiniSolrCloudClusterBase, 
TestSolrConfigHandler, TestRandomRequestDistribution, TestZkChroot, 
TestElisionMultitermQuery, ChaosMonkeySafeLeaderTest, 
CollectionsAPIDistributedZkTest, TestReplicationHandler, PeerSyncTest, 
TestFiltering, DebugComponentTest, LukeRequestHandlerTest, 
FieldAnalysisRequestHandlerTest, LoggingHandlerTest, TestCollationField, 
MBeansHandlerTest, CSVRequestHandlerTest, SolrIndexConfigTest, 
TestSolrDeletionPolicy2, SampleTest, TestBinaryField, 
TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, DirectSolrConnectionTest, 
SpellPossibilityIteratorTest, TestCodecSupport, SynonymTokenizerTest, 
TestSweetSpotSimilarityFactory, TestLMJelinekMercerSimilarityFactory, 
TestDefaultSimilarityFactory, TestFastWriter, ScriptEngineTest, 
PreAnalyzedFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestUtils, 
DistributedMLTComponentTest, TestCursorMarkWithoutUniqueKey, 
TestDistributedMissingSort, TestSimpleTrackingShardHandler, 
TestJettySolrRunner, AliasIntegrationTest, CleanupOldIndexTest, 
CollectionReloadTest, DeleteInactiveReplicaTest, DeleteShardTest, 
DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, 
LeaderFailoverAfterPartitionTest, LeaderInitiatedRecoveryOnCommitTest, 
MigrateRouteKeyTest, OverseerRolesTest, SharedFSAutoReplicaFailoverTest, 
TestReplicaProperties, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, 
HdfsSyncSliceTest, HdfsThreadLeakTest, ZkStateReaderTest, ZkStateWriterTest, 
TestConfigOverlay, TestConfigSetProperties, TestInfoStreamLogging, 
TestSolrDynamicMBean, RequestLoggingTest, TestReplicationHandlerBackup, 
TestReqParamsAPI, CoreAdminCreateDiscoverTest, CoreAdminRequestStatusTest, 
CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, 
SegmentsInfoRequestHandlerTest, DistributedFacetPivotLargeTest, 
DistributedQueryComponentCustomSortTest, 
DistributedQueryComponentOptimizationTest, 
TestDistributedStatsComponentCardinality, TestSearcherReuse, 
TestSimpleQParserPlugin, TestStressUserVersions, TestTrieFacet, TestOrdValues, 
TestSortByMinMaxFunction, BJQParserTest, TestDistribIDF]
   [junit4] Completed [517/546] on J2 in 22.42s, 2 tests, 1 failure <<< 
FAILURES!

[...truncated 106 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987:
 There were test failures: 546 suites (8 ignored), 2145 tests, 2 errors, 3 
failures, 29 ignored (17 assumptions) [seed: 2F57DB516E201E99]

Total time: 194 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to