Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/691/

3 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:52180/wbk: Error CREATEing SolrCore 
'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:52180/wbk: Error CREATEing SolrCore 
'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:325)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:442)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:188)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.TestSolrCloudWithKerberos.testKerberizedSolr

Error Message:
No live SolrServers available to handle this 
request:[http://127.0.0.1:60188/q_d/m, http://127.0.0.1:46611/q_d/m, 
http://127.0.0.1:42177/q_d/m, http://127.0.0.1:47725/q_d/m, 
http://127.0.0.1:42066/q_d/m]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:60188/q_d/m, 
http://127.0.0.1:46611/q_d/m, http://127.0.0.1:42177/q_d/m, 
http://127.0.0.1:47725/q_d/m, http://127.0.0.1:42066/q_d/m]
        at 
__randomizedtesting.SeedInfo.seed([9D5CFD4E3AB72D52:36452B8970D6ED65]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:152)
        at 
org.apache.solr.cloud.TestSolrCloudWithKerberos.testKerberizedSolr(TestSolrCloudWithKerberos.java:159)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:42177/q_d/m: Expected mime type 
application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 </title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /q_d/m/admin/collections. Reason:
<pre>    org.apache.solr.common.SolrException: Error during request 
authentication, </pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>

        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:529)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
        ... 47 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=82118, name=collection3, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=82118, name=collection3, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:33550: Could not find collection : 
awholynewstresscollection_collection3_4
        at __randomizedtesting.SeedInfo.seed([9D5CFD4E3AB72D52]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)




Build Log:
[...truncated 21249 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/init-core-data-001
   [junit4]   2> 2122952 T12684 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 2122963 T12684 oejsh.ContextHandler.doStart Started 
o.e.j.s.ServletContextHandler@33ae2453{/wbk,null,AVAILABLE}
   [junit4]   2> 2122964 T12684 oejs.AbstractConnector.doStart Started 
ServerConnector@19bd951a{HTTP/1.1}{127.0.0.1:44414}
   [junit4]   2> 2122964 T12684 oejs.Server.doStart Started @2124843ms
   [junit4]   2> 2123002 T12684 oasc.SolrResourceLoader.addToClassLoader WARN 
Can't find (or read) directory to add to classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/control-001/lib).
   [junit4]   2> 2124335 T12716 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2124335 T12716 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2124336 T12716 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2124336 T12716 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2124338 T12716 n:127.0.0.1:44414_wbk x:collection1 
oasc.SolrCore.initIndex WARN [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/control-001/cores/collection1/data/index' doesn't exist. 
Creating new index...
   [junit4]   2> 2124752 T12684 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 2124754 T12684 oejsh.ContextHandler.doStart Started 
o.e.j.s.ServletContextHandler@780837a1{/wbk,null,AVAILABLE}
   [junit4]   2> 2124754 T12684 oejs.AbstractConnector.doStart Started 
ServerConnector@653e53d1{HTTP/1.1}{127.0.0.1:52180}
   [junit4]   2> 2124755 T12684 oejs.Server.doStart Started @2126634ms
   [junit4]   2> 2124775 T12684 oasc.SolrResourceLoader.addToClassLoader WARN 
Can't find (or read) directory to add to classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-1-001/lib).
   [junit4]   2> 2126997 T12744 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2126997 T12744 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2126998 T12744 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2126998 T12744 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2126999 T12744 n:127.0.0.1:52180_wbk x:collection1 
oasc.SolrCore.initIndex WARN [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-1-001/cores/collection1/data/index' doesn't exist. 
Creating new index...
   [junit4]   2> 2127428 T12684 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 2127435 T12684 oejsh.ContextHandler.doStart Started 
o.e.j.s.ServletContextHandler@1c927d03{/wbk,null,AVAILABLE}
   [junit4]   2> 2127437 T12684 oejs.AbstractConnector.doStart Started 
ServerConnector@2e5b2e05{HTTP/1.1}{127.0.0.1:45916}
   [junit4]   2> 2127437 T12684 oejs.Server.doStart Started @2129317ms
   [junit4]   2> 2127466 T12684 oasc.SolrResourceLoader.addToClassLoader WARN 
Can't find (or read) directory to add to classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-2-001/lib).
   [junit4]   2> 2128743 T12766 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2128743 T12766 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2128744 T12766 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2128744 T12766 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2128745 T12766 n:127.0.0.1:45916_wbk x:collection1 
oasc.SolrCore.initIndex WARN [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-2-001/cores/collection1/data/index' doesn't exist. 
Creating new index...
   [junit4]   2> 2129159 T12684 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 2129169 T12684 oejsh.ContextHandler.doStart Started 
o.e.j.s.ServletContextHandler@7acc5b15{/wbk,null,AVAILABLE}
   [junit4]   2> 2129170 T12684 oejs.AbstractConnector.doStart Started 
ServerConnector@4dc27805{HTTP/1.1}{127.0.0.1:35980}
   [junit4]   2> 2129173 T12684 oejs.Server.doStart Started @2131052ms
   [junit4]   2> 2129196 T12684 oasc.SolrResourceLoader.addToClassLoader WARN 
Can't find (or read) directory to add to classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-3-001/lib).
   [junit4]   2> 2131428 T12788 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2131430 T12788 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2131431 T12788 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2131431 T12788 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2131433 T12788 n:127.0.0.1:35980_wbk x:collection1 
oasc.SolrCore.initIndex WARN [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-3-001/cores/collection1/data/index' doesn't exist. 
Creating new index...
   [junit4]   2> 2131875 T12684 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 2131878 T12684 oejsh.ContextHandler.doStart Started 
o.e.j.s.ServletContextHandler@189fc684{/wbk,null,AVAILABLE}
   [junit4]   2> 2131879 T12684 oejs.AbstractConnector.doStart Started 
ServerConnector@163b457b{HTTP/1.1}{127.0.0.1:36146}
   [junit4]   2> 2131879 T12684 oejs.Server.doStart Started @2133758ms
   [junit4]   2> 2131904 T12684 oasc.SolrResourceLoader.addToClassLoader WARN 
Can't find (or read) directory to add to classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-4-001/lib).
   [junit4]   2> 2134193 T12813 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2134193 T12813 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2134194 T12813 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2134194 T12813 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2134195 T12813 n:127.0.0.1:36146_wbk x:collection1 
oasc.SolrCore.initIndex WARN [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 9D5CFD4E3AB72D52-001/shard-4-001/cores/collection1/data/index' doesn't exist. 
Creating new index...
   [junit4]   2> 2134305 T12819 n:127.0.0.1:44414_wbk c:nodes_used_collection 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"nodes_used_collection",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2135735 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2135736 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2135737 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2135738 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136329 T12775 n:127.0.0.1:35980_wbk 
x:nodes_used_collection_shard2_replica2 oasc.SolrCore.initIndex WARN 
[nodes_used_collection_shard2_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/nodes_used_collection_shard2_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2136379 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2136380 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136381 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2136381 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136382 T12700 n:127.0.0.1:44414_wbk 
x:nodes_used_collection_shard1_replica2 oasc.SolrCore.initIndex WARN 
[nodes_used_collection_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/nodes_used_collection_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2136400 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2136400 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136401 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2136401 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136403 T12800 n:127.0.0.1:36146_wbk 
x:nodes_used_collection_shard2_replica1 oasc.SolrCore.initIndex WARN 
[nodes_used_collection_shard2_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/nodes_used_collection_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2136417 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2136417 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136418 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2136418 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2136419 T12732 n:127.0.0.1:52180_wbk 
x:nodes_used_collection_shard1_replica1 oasc.SolrCore.initIndex WARN 
[nodes_used_collection_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/nodes_used_collection_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2137537 T12853 n:127.0.0.1:44414_wbk c:awholynewcollection_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "maxShardsPerNode":"1",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> ASYNC  NEW_CORE C1087 name=collection1 
org.apache.solr.core.SolrCore@68bd4b03 
url=http://127.0.0.1:35980/wbk/collection1 node=127.0.0.1:35980_wbk 
C1087_STATE=coll:collection1 core:collection1 props:{core=collection1, 
base_url=http://127.0.0.1:35980/wbk, node_name=127.0.0.1:35980_wbk, 
state=recovering}
   [junit4]   2> 2138506 T12793 n:127.0.0.1:35980_wbk c:collection1 s:shard2 
x:collection1 C1087 oasu.PeerSync.sync WARN no frame of reference to tell if 
we've missed updates
   [junit4]   2> 2138969 T12733 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2138969 T12733 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2138970 T12733 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2138971 T12733 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2138972 T12733 n:127.0.0.1:52180_wbk 
x:awholynewcollection_0_shard2_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_0_shard2_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/awholynewcollection_0_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2139019 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2139019 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2139020 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2139021 T12700 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2139022 T12700 n:127.0.0.1:44414_wbk 
x:awholynewcollection_0_shard1_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_0_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewcollection_0_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2139162 T12861 n:127.0.0.1:44414_wbk c:awholynewcollection_1 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_1",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"1",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2140801 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2140802 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2140805 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2140806 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2140807 T12735 n:127.0.0.1:52180_wbk 
x:awholynewcollection_1_shard1_replica2 oasc.SolrCore.initIndex WARN 
[awholynewcollection_1_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/awholynewcollection_1_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2140809 T12804 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2140809 T12804 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2140810 T12804 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2140811 T12804 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2140813 T12804 n:127.0.0.1:36146_wbk 
x:awholynewcollection_1_shard1_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_1_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewcollection_1_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2140862 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2140863 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2140864 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2140865 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2140866 T12775 n:127.0.0.1:35980_wbk 
x:awholynewcollection_1_shard1_replica3 oasc.SolrCore.initIndex WARN 
[awholynewcollection_1_shard1_replica3] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_1_shard1_replica3/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> ASYNC  NEW_CORE C1088 name=collection1 
org.apache.solr.core.SolrCore@57a6ae5e 
url=http://127.0.0.1:36146/wbk/collection1 node=127.0.0.1:36146_wbk 
C1088_STATE=coll:collection1 core:collection1 props:{core=collection1, 
base_url=http://127.0.0.1:36146/wbk, node_name=127.0.0.1:36146_wbk, 
state=recovering}
   [junit4]   2> 2141322 T12818 n:127.0.0.1:36146_wbk c:collection1 s:shard1 
x:collection1 C1088 oasu.PeerSync.sync WARN no frame of reference to tell if 
we've missed updates
   [junit4]   2> 2141923 T12874 n:127.0.0.1:44414_wbk c:awholynewcollection_2 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_2",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"1",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2143491 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2143491 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2143493 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2143493 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2143499 T12754 n:127.0.0.1:45916_wbk 
x:awholynewcollection_2_shard1_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_2_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-2-001/cores/awholynewcollection_2_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2143599 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2143600 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2143601 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2143601 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2143602 T12777 n:127.0.0.1:35980_wbk 
x:awholynewcollection_2_shard1_replica2 oasc.SolrCore.initIndex WARN 
[awholynewcollection_2_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_2_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> ASYNC  NEW_CORE C1089 
name=nodes_used_collection_shard2_replica1 
org.apache.solr.core.SolrCore@56d92ad 
url=http://127.0.0.1:36146/wbk/nodes_used_collection_shard2_replica1 
node=127.0.0.1:36146_wbk C1089_STATE=coll:nodes_used_collection 
core:nodes_used_collection_shard2_replica1 
props:{core=nodes_used_collection_shard2_replica1, 
base_url=http://127.0.0.1:36146/wbk, node_name=127.0.0.1:36146_wbk, 
state=recovering}
   [junit4]   2> 2144448 T12839 n:127.0.0.1:36146_wbk c:nodes_used_collection 
s:shard2 x:nodes_used_collection_shard2_replica1 C1089 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1090 
name=nodes_used_collection_shard1_replica1 
org.apache.solr.core.SolrCore@74bb1bf8 
url=http://127.0.0.1:52180/wbk/nodes_used_collection_shard1_replica1 
node=127.0.0.1:52180_wbk C1090_STATE=coll:nodes_used_collection 
core:nodes_used_collection_shard1_replica1 
props:{core=nodes_used_collection_shard1_replica1, 
base_url=http://127.0.0.1:52180/wbk, node_name=127.0.0.1:52180_wbk, 
state=recovering}
   [junit4]   2> 2144480 T12841 n:127.0.0.1:52180_wbk c:nodes_used_collection 
s:shard1 x:nodes_used_collection_shard1_replica1 C1090 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> 2144662 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_3 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_3",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"1",
   [junit4]   2>          "numShards":"5",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2146427 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146427 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146428 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146428 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146430 T12731 n:127.0.0.1:52180_wbk 
x:awholynewcollection_3_shard1_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_3_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/awholynewcollection_3_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2146539 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146539 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146547 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146547 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146548 T12757 n:127.0.0.1:45916_wbk 
x:awholynewcollection_3_shard2_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_3_shard2_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-2-001/cores/awholynewcollection_3_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2146582 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146583 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146585 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146586 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146590 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146590 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146592 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146592 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146594 T12701 n:127.0.0.1:44414_wbk 
x:awholynewcollection_3_shard4_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_3_shard4_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewcollection_3_shard4_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2146602 T12776 n:127.0.0.1:35980_wbk 
x:awholynewcollection_3_shard3_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_3_shard3_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_3_shard3_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2146609 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146609 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146610 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2146611 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2146612 T12802 n:127.0.0.1:36146_wbk 
x:awholynewcollection_3_shard5_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_3_shard5_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewcollection_3_shard5_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2146746 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_4 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_4",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"4",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "maxShardsPerNode":"3",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2148664 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148664 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148671 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148671 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148691 T12775 n:127.0.0.1:35980_wbk 
x:awholynewcollection_4_shard1_replica4 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard1_replica4] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_4_shard1_replica4/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2148871 T12803 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148872 T12803 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> ASYNC  NEW_CORE C1091 
name=awholynewcollection_1_shard1_replica2 
org.apache.solr.core.SolrCore@ea16688 
url=http://127.0.0.1:52180/wbk/awholynewcollection_1_shard1_replica2 
node=127.0.0.1:52180_wbk C1091_STATE=coll:awholynewcollection_1 
core:awholynewcollection_1_shard1_replica2 
props:{core=awholynewcollection_1_shard1_replica2, 
base_url=http://127.0.0.1:52180/wbk, node_name=127.0.0.1:52180_wbk, 
state=recovering}
   [junit4]   2> 2148873 T12870 n:127.0.0.1:52180_wbk c:awholynewcollection_1 
s:shard1 x:awholynewcollection_1_shard1_replica2 C1091 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> 2148952 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148952 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148953 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148953 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148954 T12778 n:127.0.0.1:35980_wbk 
x:awholynewcollection_4_shard3_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard3_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_4_shard3_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2148954 T12803 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148955 T12803 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148956 T12803 n:127.0.0.1:36146_wbk 
x:awholynewcollection_4_shard3_replica3 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard3_replica3] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewcollection_4_shard3_replica3/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2148959 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148959 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148960 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2148960 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2148962 T12801 n:127.0.0.1:36146_wbk 
x:awholynewcollection_4_shard1_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewcollection_4_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> ASYNC  NEW_CORE C1092 
name=awholynewcollection_1_shard1_replica3 
org.apache.solr.core.SolrCore@1e31238 
url=http://127.0.0.1:35980/wbk/awholynewcollection_1_shard1_replica3 
node=127.0.0.1:35980_wbk C1092_STATE=coll:awholynewcollection_1 
core:awholynewcollection_1_shard1_replica3 
props:{core=awholynewcollection_1_shard1_replica3, 
base_url=http://127.0.0.1:35980/wbk, node_name=127.0.0.1:35980_wbk, 
state=recovering}
   [junit4]   2> 2148974 T12872 n:127.0.0.1:35980_wbk c:awholynewcollection_1 
s:shard1 x:awholynewcollection_1_shard1_replica3 C1092 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> 2149012 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149013 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149014 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149014 T12754 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149015 T12754 n:127.0.0.1:45916_wbk 
x:awholynewcollection_4_shard3_replica2 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard3_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-2-001/cores/awholynewcollection_4_shard3_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149040 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149041 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149042 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149042 T12735 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149044 T12755 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149044 T12755 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149048 T12755 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149049 T12755 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149049 T12735 n:127.0.0.1:52180_wbk 
x:awholynewcollection_4_shard1_replica2 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/awholynewcollection_4_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149052 T12755 n:127.0.0.1:45916_wbk 
x:awholynewcollection_4_shard2_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard2_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-2-001/cores/awholynewcollection_4_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149057 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149057 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149058 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149059 T12802 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149060 T12802 n:127.0.0.1:36146_wbk 
x:awholynewcollection_4_shard2_replica2 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard2_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewcollection_4_shard2_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149063 T12702 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149063 T12702 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149064 T12702 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149064 T12702 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149082 T12702 n:127.0.0.1:44414_wbk 
x:awholynewcollection_4_shard2_replica4 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard2_replica4] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewcollection_4_shard2_replica4/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149109 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149109 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149112 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149112 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149114 T12703 n:127.0.0.1:44414_wbk 
x:awholynewcollection_4_shard1_replica3 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard1_replica3] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewcollection_4_shard1_replica3/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149127 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149128 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149128 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149129 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149129 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149130 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149131 T12732 n:127.0.0.1:52180_wbk 
x:awholynewcollection_4_shard2_replica3 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard2_replica3] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/awholynewcollection_4_shard2_replica3/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2149138 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2149139 T12731 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2149141 T12731 n:127.0.0.1:52180_wbk 
x:awholynewcollection_4_shard3_replica4 oasc.SolrCore.initIndex WARN 
[awholynewcollection_4_shard3_replica4] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/awholynewcollection_4_shard3_replica4/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2150510 T12685 oasc.ZkTestServer$ZKServerMain.runFromConfig 
WARN Watch limit violations: 
   [junit4]   2>        Maximum concurrent create/delete watches above limit:
   [junit4]   2>        
   [junit4]   2>                10      /solr/aliases.json
   [junit4]   2>                10      /solr/clusterstate.json
   [junit4]   2>                5       
/solr/collections/awholynewcollection_3/state.json
   [junit4]   2>                5       /solr/configs/conf1
   [junit4]   2>                5       
/solr/collections/awholynewcollection_4/state.json
   [junit4]   2>                4       
/solr/collections/nodes_used_collection/state.json
   [junit4]   2>                4       /solr/collections/collection1/state.json
   [junit4]   2>                3       
/solr/collections/awholynewcollection_1/state.json
   [junit4]   2>                2       
/solr/collections/awholynewcollection_0/state.json
   [junit4]   2>                2       
/solr/collections/awholynewcollection_2/state.json
   [junit4]   2>        
   [junit4]   2>        Maximum concurrent children watches above limit:
   [junit4]   2>        
   [junit4]   2>                10      /solr/live_nodes
   [junit4]   2>        
   [junit4]   2> ASYNC  NEW_CORE C1093 
name=awholynewcollection_2_shard1_replica2 
org.apache.solr.core.SolrCore@27337360 
url=http://127.0.0.1:35980/wbk/awholynewcollection_2_shard1_replica2 
node=127.0.0.1:35980_wbk C1093_STATE=coll:awholynewcollection_2 
core:awholynewcollection_2_shard1_replica2 
props:{core=awholynewcollection_2_shard1_replica2, 
base_url=http://127.0.0.1:35980/wbk, node_name=127.0.0.1:35980_wbk, 
state=recovering}
   [junit4]   2> 2151661 T12881 n:127.0.0.1:35980_wbk c:awholynewcollection_2 
s:shard1 x:awholynewcollection_2_shard1_replica2 C1093 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1094 
name=awholynewcollection_4_shard3_replica3 
org.apache.solr.core.SolrCore@60759183 
url=http://127.0.0.1:36146/wbk/awholynewcollection_4_shard3_replica3 
node=127.0.0.1:36146_wbk C1094_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard3_replica3 
props:{core=awholynewcollection_4_shard3_replica3, 
base_url=http://127.0.0.1:36146/wbk, node_name=127.0.0.1:36146_wbk, 
state=recovering}
   [junit4]   2> 2157091 T12938 n:127.0.0.1:36146_wbk c:awholynewcollection_4 
s:shard3 x:awholynewcollection_4_shard3_replica3 C1094 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1095 
name=awholynewcollection_4_shard1_replica1 
org.apache.solr.core.SolrCore@37d840fd 
url=http://127.0.0.1:36146/wbk/awholynewcollection_4_shard1_replica1 
node=127.0.0.1:36146_wbk C1095_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard1_replica1 
props:{core=awholynewcollection_4_shard1_replica1, 
base_url=http://127.0.0.1:36146/wbk, node_name=127.0.0.1:36146_wbk, 
state=recovering}
   [junit4]   2> 2157098 T12937 n:127.0.0.1:36146_wbk c:awholynewcollection_4 
s:shard1 x:awholynewcollection_4_shard1_replica1 C1095 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1096 
name=awholynewcollection_4_shard3_replica2 
org.apache.solr.core.SolrCore@7fbe507e 
url=http://127.0.0.1:45916/wbk/awholynewcollection_4_shard3_replica2 
node=127.0.0.1:45916_wbk C1096_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard3_replica2 
props:{core=awholynewcollection_4_shard3_replica2, 
base_url=http://127.0.0.1:45916/wbk, node_name=127.0.0.1:45916_wbk, 
state=recovering}
   [junit4]   2> 2157157 T12941 n:127.0.0.1:45916_wbk c:awholynewcollection_4 
s:shard3 x:awholynewcollection_4_shard3_replica2 C1096 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1097 
name=awholynewcollection_4_shard2_replica2 
org.apache.solr.core.SolrCore@55f3213a 
url=http://127.0.0.1:36146/wbk/awholynewcollection_4_shard2_replica2 
node=127.0.0.1:36146_wbk C1097_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard2_replica2 
props:{core=awholynewcollection_4_shard2_replica2, 
base_url=http://127.0.0.1:36146/wbk, node_name=127.0.0.1:36146_wbk, 
state=recovering}
   [junit4]   2> 2157161 T12943 n:127.0.0.1:36146_wbk c:awholynewcollection_4 
s:shard2 x:awholynewcollection_4_shard2_replica2 C1097 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1098 
name=awholynewcollection_4_shard2_replica4 
org.apache.solr.core.SolrCore@78982983 
url=http://127.0.0.1:44414/wbk/awholynewcollection_4_shard2_replica4 
node=127.0.0.1:44414_wbk C1098_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard2_replica4 
props:{core=awholynewcollection_4_shard2_replica4, 
base_url=http://127.0.0.1:44414/wbk, node_name=127.0.0.1:44414_wbk, 
state=recovering}
   [junit4]   2> 2157226 T12948 n:127.0.0.1:44414_wbk c:awholynewcollection_4 
s:shard2 x:awholynewcollection_4_shard2_replica4 C1098 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1099 
name=awholynewcollection_4_shard1_replica2 
org.apache.solr.core.SolrCore@202b0fb4 
url=http://127.0.0.1:52180/wbk/awholynewcollection_4_shard1_replica2 
node=127.0.0.1:52180_wbk C1099_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard1_replica2 
props:{core=awholynewcollection_4_shard1_replica2, 
base_url=http://127.0.0.1:52180/wbk, node_name=127.0.0.1:52180_wbk, 
state=recovering}
   [junit4]   2> 2157234 T12945 n:127.0.0.1:52180_wbk c:awholynewcollection_4 
s:shard1 x:awholynewcollection_4_shard1_replica2 C1099 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1100 
name=awholynewcollection_4_shard1_replica3 
org.apache.solr.core.SolrCore@3e5a65cc 
url=http://127.0.0.1:44414/wbk/awholynewcollection_4_shard1_replica3 
node=127.0.0.1:44414_wbk C1100_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard1_replica3 
props:{core=awholynewcollection_4_shard1_replica3, 
base_url=http://127.0.0.1:44414/wbk, node_name=127.0.0.1:44414_wbk, 
state=recovering}
   [junit4]   2> 2157250 T12947 n:127.0.0.1:44414_wbk c:awholynewcollection_4 
s:shard1 x:awholynewcollection_4_shard1_replica3 C1100 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1101 
name=awholynewcollection_4_shard2_replica3 
org.apache.solr.core.SolrCore@39d5dd0a 
url=http://127.0.0.1:52180/wbk/awholynewcollection_4_shard2_replica3 
node=127.0.0.1:52180_wbk C1101_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard2_replica3 
props:{core=awholynewcollection_4_shard2_replica3, 
base_url=http://127.0.0.1:52180/wbk, node_name=127.0.0.1:52180_wbk, 
state=recovering}
   [junit4]   2> 2157255 T12951 n:127.0.0.1:52180_wbk c:awholynewcollection_4 
s:shard2 x:awholynewcollection_4_shard2_replica3 C1101 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> ASYNC  NEW_CORE C1102 
name=awholynewcollection_4_shard3_replica4 
org.apache.solr.core.SolrCore@512b46bf 
url=http://127.0.0.1:52180/wbk/awholynewcollection_4_shard3_replica4 
node=127.0.0.1:52180_wbk C1102_STATE=coll:awholynewcollection_4 
core:awholynewcollection_4_shard3_replica4 
props:{core=awholynewcollection_4_shard3_replica4, 
base_url=http://127.0.0.1:52180/wbk, node_name=127.0.0.1:52180_wbk, 
state=recovering}
   [junit4]   2> 2157270 T12952 n:127.0.0.1:52180_wbk c:awholynewcollection_4 
s:shard3 x:awholynewcollection_4_shard3_replica4 C1102 oasu.PeerSync.sync WARN 
no frame of reference to tell if we've missed updates
   [junit4]   2> 2157800 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : reload , {
   [junit4]   2>          "name":"awholynewcollection_0",
   [junit4]   2>          "operation":"reload"}
   [junit4]   2> 2158112 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2158113 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2158114 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2158115 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2158342 T12704 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2158342 T12704 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2158347 T12704 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2158347 T12704 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2159038 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : delete , {
   [junit4]   2>          "name":"awholynewcollection_0",
   [junit4]   2>          "operation":"delete"}
   [junit4]   2> 2160285 T12883 n:127.0.0.1:44414_wbk c:unknown_collection 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : delete , {
   [junit4]   2>          "name":"unknown_collection",
   [junit4]   2>          "operation":"delete"}
   [junit4]   2> 2160299 T12883 n:127.0.0.1:44414_wbk c:unknown_collection 
oasc.SolrException.log ERROR Collection: unknown_collection operation: delete 
failed:org.apache.solr.common.SolrException: Could not find collection : 
unknown_collection
   [junit4]   2>                at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:164)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor.collectionCmd(OverseerCollectionProcessor.java:2698)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor.deleteCollection(OverseerCollectionProcessor.java:1128)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2893)
   [junit4]   2>                at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>        
   [junit4]   2> 2160332 T12883 n:127.0.0.1:44414_wbk 
c:acollectionafterbaddelete oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"acollectionafterbaddelete",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2162070 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2162070 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2162072 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2162073 T12732 n:127.0.0.1:52180_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2162086 T12732 n:127.0.0.1:52180_wbk 
x:acollectionafterbaddelete_shard1_replica2 oasc.SolrCore.initIndex WARN 
[acollectionafterbaddelete_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-1-001/cores/acollectionafterbaddelete_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2162193 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2162193 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2162195 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2162195 T12757 n:127.0.0.1:45916_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2162196 T12757 n:127.0.0.1:45916_wbk 
x:acollectionafterbaddelete_shard1_replica1 oasc.SolrCore.initIndex WARN 
[acollectionafterbaddelete_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-2-001/cores/acollectionafterbaddelete_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> ASYNC  NEW_CORE C1103 
name=acollectionafterbaddelete_shard1_replica1 
org.apache.solr.core.SolrCore@6605b6d5 
url=http://127.0.0.1:45916/wbk/acollectionafterbaddelete_shard1_replica1 
node=127.0.0.1:45916_wbk C1103_STATE=coll:acollectionafterbaddelete 
core:acollectionafterbaddelete_shard1_replica1 
props:{core=acollectionafterbaddelete_shard1_replica1, 
base_url=http://127.0.0.1:45916/wbk, node_name=127.0.0.1:45916_wbk, 
state=recovering}
   [junit4]   2> 2170322 T13028 n:127.0.0.1:45916_wbk 
c:acollectionafterbaddelete s:shard1 
x:acollectionafterbaddelete_shard1_replica1 C1103 oasu.PeerSync.sync WARN no 
frame of reference to tell if we've missed updates
   [junit4]   2> 2170393 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_5 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_5",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "maxShardsPerNode":"1",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2170401 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_5 
oasc.SolrException.log ERROR Collection: awholynewcollection_5 operation: 
create failed:org.apache.solr.common.SolrException: Cannot create collection 
awholynewcollection_5. Value of maxShardsPerNode is 1, and the number of nodes 
currently live or live and part of your createNodeSet is 5. This allows a 
maximum of 5 to be created. Value of numShards is 3 and value of 
replicationFactor is 2. This requires 6 shards to be created (higher than the 
allowed number)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor.createCollection(OverseerCollectionProcessor.java:2352)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:562)
   [junit4]   2>                at 
org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2893)
   [junit4]   2>                at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>        
   [junit4]   2> 2170434 T12883 n:127.0.0.1:44414_wbk c:awholynewcollection_6 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewcollection_6",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"1",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"4",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          
"createNodeSet":"127.0.0.1:44414_wbk,127.0.0.1:35980_wbk",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2172123 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172123 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172126 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172126 T12776 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172134 T12776 n:127.0.0.1:35980_wbk 
x:awholynewcollection_6_shard1_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_6_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_6_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2172153 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172153 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172177 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172178 T12701 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172179 T12701 n:127.0.0.1:44414_wbk 
x:awholynewcollection_6_shard4_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_6_shard4_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewcollection_6_shard4_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2172221 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172222 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172223 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172223 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172228 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172228 T12778 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172229 T12778 n:127.0.0.1:35980_wbk 
x:awholynewcollection_6_shard3_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_6_shard3_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewcollection_6_shard3_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2172228 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2172232 T12703 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2172236 T12703 n:127.0.0.1:44414_wbk 
x:awholynewcollection_6_shard2_replica1 oasc.SolrCore.initIndex WARN 
[awholynewcollection_6_shard2_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewcollection_6_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2172962 T12883 n:127.0.0.1:44414_wbk 
c:awholynewstresscollection_collection5_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewstresscollection_collection5_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2172962 T12874 n:127.0.0.1:44414_wbk 
c:awholynewstresscollection_collection2_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewstresscollection_collection2_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2172974 T12861 n:127.0.0.1:44414_wbk 
c:awholynewstresscollection_collection3_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewstresscollection_collection3_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2172986 T12853 n:127.0.0.1:44414_wbk 
c:awholynewstresscollection_collection0_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewstresscollection_collection0_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2173038 T12819 n:127.0.0.1:44414_wbk 
c:awholynewstresscollection_collection1_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewstresscollection_collection1_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2173038 T13077 n:127.0.0.1:44414_wbk 
c:awholynewstresscollection_collection4_0 
oasc.OverseerCollectionProcessor.processMessage WARN 
OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "name":"awholynewstresscollection_collection4_0",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "replicationFactor":"3",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "operation":"create"}
   [junit4]   2> 2173632 T13076 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2173632 T13076 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2173633 T13076 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2173634 T13076 n:127.0.0.1:44414_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2173642 T13076 n:127.0.0.1:44414_wbk 
x:awholynewstresscollection_collection5_0_shard1_replica1 
oasc.SolrCore.initIndex WARN 
[awholynewstresscollection_collection5_0_shard1_replica1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/control-001/cores/awholynewstresscollection_collection5_0_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2173695 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2173695 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2173697 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2173697 T12801 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2173698 T12801 n:127.0.0.1:36146_wbk 
x:awholynewstresscollection_collection3_0_shard1_replica3 
oasc.SolrCore.initIndex WARN 
[awholynewstresscollection_collection3_0_shard1_replica3] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewstresscollection_collection3_0_shard1_replica3/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2174509 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2174509 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2174511 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2174511 T12777 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2174512 T12777 n:127.0.0.1:35980_wbk 
x:awholynewstresscollection_collection5_0_shard1_replica3 
oasc.SolrCore.initIndex WARN 
[awholynewstresscollection_collection5_0_shard1_replica3] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-3-001/cores/awholynewstresscollection_collection5_0_shard1_replica3/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2174519 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2174519 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2174521 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2174521 T12800 n:127.0.0.1:36146_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2174522 T12800 n:127.0.0.1:36146_wbk 
x:awholynewstresscollection_collection5_0_shard1_replica2 
oasc.SolrCore.initIndex WARN 
[awholynewstresscollection_collection5_0_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest
 
9D5CFD4E3AB72D52-001/shard-4-001/cores/awholynewstresscollection_collection5_0_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 2174876 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2174877 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2174878 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 2174879 T12775 n:127.0.0.1:35980_wbk 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 2174939 T12775 n:127.0.0.1:35980_wbk 
x:awholynewstresscollection_collection4_0_shard1_replica2 
oasc.SolrCore.initIndex WARN 
[awholynewstresscollection_collection4_0_shard1_replica2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/so

[...truncated too long message...]

torUtil.java:148)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer/queue
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:90)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:84)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.<init>(DistributedQueue.java:69)
   [junit4]   2>        ... 20 more
   [junit4]   2> 
   [junit4]   2> 3635223 T15999 oejs.AbstractConnector.doStop Stopped 
ServerConnector@a8a4c9e{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 3635224 T15999 oejsh.ContextHandler.doStop Stopped 
o.e.j.s.ServletContextHandler@178cc26d{/q_d/m,null,UNAVAILABLE}
   [junit4]   2> 3635400 T16007 oasc.ZkTestServer$ZKServerMain.runFromConfig 
WARN Watch limit violations: 
   [junit4]   2>        Maximum concurrent create/delete watches above limit:
   [junit4]   2>        
   [junit4]   2>                7       /solr/aliases.json
   [junit4]   2>                7       /solr/clusterstate.json
   [junit4]   2>                5       /solr/configs/conf1
   [junit4]   2>        
   [junit4]   2>        Maximum concurrent children watches above limit:
   [junit4]   2>        
   [junit4]   2>                7       /solr/live_nodes
   [junit4]   2>                4       /solr/overseer/collection-queue-work
   [junit4]   2>                3       /solr/overseer/queue
   [junit4]   2>        
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestSolrCloudWithKerberos -Dtests.method=testKerberizedSolr 
-Dtests.seed=9D5CFD4E3AB72D52 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale= -Dtests.timezone=Mexico/BajaNorte -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   33.1s J1 | TestSolrCloudWithKerberos.testKerberizedSolr <<<
   [junit4]    > Throwable #1: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:60188/q_d/m, 
http://127.0.0.1:46611/q_d/m, http://127.0.0.1:42177/q_d/m, 
http://127.0.0.1:47725/q_d/m, http://127.0.0.1:42066/q_d/m]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9D5CFD4E3AB72D52:36452B8970D6ED65]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:152)
   [junit4]    >        at 
org.apache.solr.cloud.TestSolrCloudWithKerberos.testKerberizedSolr(TestSolrCloudWithKerberos.java:159)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:42177/q_d/m: Expected mime type 
application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" 
content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 500 </title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 500</h2>
   [junit4]    > <p>Problem accessing /q_d/m/admin/collections. Reason:
   [junit4]    > <pre>    org.apache.solr.common.SolrException: Error during 
request authentication, </pre></p>
   [junit4]    > <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:529)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
   [junit4]    >        ... 47 more
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithKerberos
 9D5CFD4E3AB72D52-001
   [junit4]   2> 33137 T15998 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: 
codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=1, maxDocsPerChunk=790, blockSize=638), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=1, blockSize=638)), sim=DefaultSimilarity, locale=, 
timezone=Mexico/BajaNorte
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_25 (64-bit)/cpus=4,threads=1,free=53278080,total=500695040
   [junit4]   2> NOTE: All tests run in this JVM: 
[DocumentAnalysisRequestHandlerTest, TestLRUCache, TestManagedSchema, 
TestStressVersions, JSONWriterTest, ChaosMonkeySafeLeaderTest, 
TestSuggestSpellingConverter, TestComplexPhraseQParserPlugin, 
TestAtomicUpdateErrorCases, OverseerStatusTest, TestOmitPositions, 
TestDynamicFieldResource, SpatialFilterTest, DocValuesMultiTest, 
TestDistribDocBasedVersion, TestElisionMultitermQuery, TestRandomMergePolicy, 
SuggesterTSTTest, DistributedMLTComponentTest, 
CollectionsAPIAsyncDistributedZkTest, TestRebalanceLeaders, TestCoreDiscovery, 
HdfsDirectoryTest, ZkControllerTest, SolrCloudExampleTest, FileUtilsTest, 
QueryResultKeyTest, SpellingQueryConverterTest, MigrateRouteKeyTest, 
RequestLoggingTest, RecoveryAfterSoftCommitTest, SystemInfoHandlerTest, 
TestSolrDeletionPolicy2, AnalysisAfterCoreReloadTest, TestCloudManagedSchema, 
NoCacheHeaderTest, TestBulkSchemaConcurrent, RAMDirectoryFactoryTest, 
DistribCursorPagingTest, TestConfigSets, TestSearchPerf, 
TestSimpleTrackingShardHandler, TestLMDirichletSimilarityFactory, 
SolrPluginUtilsTest, RollingRestartTest, CacheHeaderTest, UpdateParamsTest, 
IndexSchemaRuntimeFieldTest, ZkStateWriterTest, TestRecoveryHdfs, 
DistributedSuggestComponentTest, ConcurrentDeleteAndCreateCollectionTest, 
HdfsLockFactoryTest, TestSchemaVersionResource, SolrXmlInZkTest, 
TestShardHandlerFactory, TestFoldingMultitermQuery, TestCloudPivotFacet, 
TestSolrCoreProperties, TestFuzzyAnalyzedSuggestions, HighlighterMaxOffsetTest, 
TestFastLRUCache, CollectionsAPIDistributedZkTest, ResourceLoaderTest, 
WordBreakSolrSpellCheckerTest, ShardRoutingTest, TestAuthorizationFramework, 
CollectionReloadTest, ScriptEngineTest, LukeRequestHandlerTest, 
TestAnalyzedSuggestions, CurrencyFieldOpenExchangeTest, TestManagedResource, 
TestUniqueKeyFieldResource, TestSolrCloudWithKerberos]
   [junit4] Completed [409/502] on J1 in 33.68s, 1 test, 1 error <<< FAILURES!

[...truncated 297 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:229:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:512:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1415:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:973:
 There were test failures: 502 suites, 1984 tests, 3 errors, 20 ignored (10 
assumptions)

Total time: 176 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No artifacts from Lucene-Solr-NightlyTests-trunk #679 to compare, so performing 
full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to