Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/656/

3 tests failed.
REGRESSION:  
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=7042, name=Thread-3262, 
state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=7042, name=Thread-3262, state=RUNNABLE, 
group=TGRP-FullSolrCloudDistribCmdsTest]
        at 
__randomizedtesting.SeedInfo.seed([EA393A22F1FBC792:6BDFB43A86A4A7AE]:0)
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: http://127.0.0.1:26091/hg_qmd/collection1
        at __randomizedtesting.SeedInfo.seed([EA393A22F1FBC792]:0)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:380)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: http://127.0.0.1:26091/hg_qmd/collection1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:579)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:378)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:465)
        ... 4 more


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create 
core [halfcollection_shard1_replica1] Caused by: Could not get shard id for 
core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error 
CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this 
request:[http://127.0.0.1:20635/zmsxn, http://127.0.0.1:20640/zmsxn, 
http://127.0.0.1:20615/zmsxn]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:20635/zmsxn, 
http://127.0.0.1:20640/zmsxn, http://127.0.0.1:20615/zmsxn]
        at 
__randomizedtesting.SeedInfo.seed([EA393A22F1FBC792:6BDFB43A86A4A7AE]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:1015)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:793)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:736)
        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : customcollreplicadeletion/a/core_node2
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:354)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:313)
        ... 46 more




Build Log:
[...truncated 11977 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/init-core-data-001
   [junit4]   2> 350699 T988 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(false) and clientAuth (true)
   [junit4]   2> 350699 T988 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /
   [junit4]   2> 350707 T988 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 350708 T988 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 350709 T989 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 350809 T988 oasc.ZkTestServer.run start zk server on port:61302
   [junit4]   2> 350810 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 350811 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 350815 T995 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7f2af4a3 
name:ZooKeeperConnection Watcher:127.0.0.1:61302 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 350815 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 350816 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 350816 T988 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 350819 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 350820 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 350822 T997 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@256582ad 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 350823 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 350823 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 350823 T988 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 350826 T988 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 350828 T988 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 350830 T988 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 350832 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 350833 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 350836 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 350837 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 350840 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 350841 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 350843 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 350844 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 350846 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 350847 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 350849 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 350849 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 350851 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 350852 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 350854 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 350855 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 350857 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 350857 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 350859 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 350860 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 350862 T988 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 350863 T988 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 352294 T988 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 352299 T988 oejs.AbstractConnector.doStart Started 
[email protected]:61321
   [junit4]   2> 352300 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 352300 T988 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 352300 T988 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002
   [junit4]   2> 352301 T988 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/'
   [junit4]   2> 352332 T988 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solr.xml
   [junit4]   2> 352387 T988 oasc.CoreContainer.<init> New CoreContainer 
1578828210
   [junit4]   2> 352387 T988 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/]
   [junit4]   2> 352388 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 352389 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 352389 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 352389 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 352389 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 352390 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 352390 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 352390 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 352391 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 352391 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 352391 T988 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 352392 T988 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 352392 T988 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 352392 T988 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 352393 T988 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:61302/solr
   [junit4]   2> 352393 T988 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 352393 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 352394 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 352396 T1008 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3f0c7d62 
name:ZooKeeperConnection Watcher:127.0.0.1:61302 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 352397 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 352397 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 352400 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 352401 T1010 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@30a3a5a3 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 352401 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 352403 T988 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 352405 T988 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 352407 T988 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 352409 T988 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 352411 T988 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 352413 T988 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 352414 T988 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:61321_
   [junit4]   2> 352415 T988 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:61321_
   [junit4]   2> 352417 T988 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 352418 T988 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 352419 T988 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 352421 T988 oasc.OverseerElectionContext.runLeaderProcess I am 
going to be the leader 127.0.0.1:61321_
   [junit4]   2> 352422 T988 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 352423 T988 oasc.Overseer.start Overseer 
(id=92670987772559363-127.0.0.1:61321_-n_0000000000) starting
   [junit4]   2> 352425 T988 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 352431 T988 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 352432 T1012 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 352432 T988 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 352435 T988 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 352436 T988 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 352439 T1011 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 352441 T988 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 352442 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 352442 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 352443 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 352445 T1016 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@390ff1eb 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 352445 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 352445 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 352446 T988 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 352448 T988 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 352449 T988 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 352449 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 352450 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 352451 T1018 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1076021c 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 352451 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 352451 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 352454 T1019 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 352456 T1011 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: collection1
   [junit4]   2> 352457 T1011 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 352457 T1011 
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 352459 T1011 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 352460 T1019 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 352461 T1020 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 353400 T988 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 353401 T988 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 353404 T988 oejs.AbstractConnector.doStart Started 
[email protected]:61326
   [junit4]   2> 353404 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 353405 T988 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 353405 T988 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-003
   [junit4]   2> 353405 T988 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-003/'
   [junit4]   2> 353436 T988 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-003/solr.xml
   [junit4]   2> 353523 T988 oasc.CoreContainer.<init> New CoreContainer 
2123948909
   [junit4]   2> 353524 T988 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-003/]
   [junit4]   2> 353525 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 353525 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 353525 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 353525 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 353526 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 353526 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 353526 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 353527 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 353527 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 353527 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 353528 T988 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 353528 T988 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 353528 T988 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 353529 T988 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 353529 T988 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:61302/solr
   [junit4]   2> 353529 T988 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 353530 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 353530 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 353532 T1031 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@677b4a09 
name:ZooKeeperConnection Watcher:127.0.0.1:61302 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 353533 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 353534 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 353536 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 353538 T1033 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@629ec43d 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 353538 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 353544 T988 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 354549 T988 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:61326_
   [junit4]   2> 354550 T988 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:61326_
   [junit4]   2> 354555 T988 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 354563 T988 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 354564 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 356210 T988 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 356211 T988 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 356214 T988 oejs.AbstractConnector.doStart Started 
[email protected]:61337
   [junit4]   2> 356215 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 356215 T988 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 356216 T988 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004
   [junit4]   2> 356216 T988 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/'
   [junit4]   2> 356251 T988 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solr.xml
   [junit4]   2> 356310 T988 oasc.CoreContainer.<init> New CoreContainer 
1850568814
   [junit4]   2> 356310 T988 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/]
   [junit4]   2> 356312 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 356312 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 356312 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 356312 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 356313 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 356313 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 356313 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 356314 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 356314 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 356314 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 356315 T988 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 356315 T988 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 356315 T988 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 356316 T988 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 356316 T988 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:61302/solr
   [junit4]   2> 356316 T988 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 356317 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 356317 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 356319 T1046 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e107e55 
name:ZooKeeperConnection Watcher:127.0.0.1:61302 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 356320 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 356321 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 356323 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 356324 T1048 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@50a31981 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 356324 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 356329 T988 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 357334 T988 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:61337_
   [junit4]   2> 357335 T988 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:61337_
   [junit4]   2> 357339 T988 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 357345 T988 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 357345 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 358574 T988 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 358575 T988 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 358578 T988 oejs.AbstractConnector.doStart Started 
[email protected]:61344
   [junit4]   2> 358578 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 358579 T988 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 358579 T988 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005
   [junit4]   2> 358579 T988 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/'
   [junit4]   2> 358610 T988 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solr.xml
   [junit4]   2> 358665 T988 oasc.CoreContainer.<init> New CoreContainer 
608407948
   [junit4]   2> 358665 T988 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/]
   [junit4]   2> 358666 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 358666 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 358667 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 358667 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 358667 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 358668 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 358668 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 358668 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 358668 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 358669 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 358669 T988 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 358670 T988 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 358670 T988 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 358670 T988 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 358671 T988 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:61302/solr
   [junit4]   2> 358671 T988 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 358671 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 358672 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 358673 T1061 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@500890ed 
name:ZooKeeperConnection Watcher:127.0.0.1:61302 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 358674 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 358675 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 358677 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 358679 T1063 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@b2dc371 name:ZooKeeperConnection 
Watcher:127.0.0.1:61302/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 358679 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 358684 T988 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 359688 T988 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:61344_
   [junit4]   2> 359689 T988 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:61344_
   [junit4]   2> 359693 T988 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 359699 T988 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 359700 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 361014 T988 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 361016 T988 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 361019 T988 oejs.AbstractConnector.doStart Started 
[email protected]:61352
   [junit4]   2> 361019 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 361019 T988 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 361020 T988 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006
   [junit4]   2> 361020 T988 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/'
   [junit4]   2> 361051 T988 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solr.xml
   [junit4]   2> 361105 T988 oasc.CoreContainer.<init> New CoreContainer 
921279017
   [junit4]   2> 361106 T988 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/]
   [junit4]   2> 361107 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 361107 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 361107 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 361108 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 361108 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 361108 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 361109 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 361109 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 361109 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 361109 T988 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 361110 T988 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 361110 T988 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 361111 T988 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 361111 T988 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 361111 T988 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:61302/solr
   [junit4]   2> 361112 T988 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 361112 T988 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 361113 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 361114 T1076 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@228815e9 
name:ZooKeeperConnection Watcher:127.0.0.1:61302 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 361115 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 361116 T988 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 361118 T988 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 361119 T1078 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@56138b49 
name:ZooKeeperConnection Watcher:127.0.0.1:61302/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 361119 T988 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 361124 T988 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 362129 T988 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:61352_
   [junit4]   2> 362130 T988 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:61352_
   [junit4]   2> 362134 T988 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 362139 T988 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 362140 T988 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 362152 T1024 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
router.field=myOwnField&action=CREATE&collection.configName=conf1&version=2&wt=javabin&numShards=2&name=solrj_collection&replicationFactor=2
   [junit4]   2> 362154 T1019 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 362155 T1012 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 362157 T1081 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 362158 T1081 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 362158 T1081 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 362161 T1019 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 362163 T1011 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: solrj_collection
   [junit4]   2> 362164 T1011 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
solrj_collection with shards [shard1, shard2]
   [junit4]   2> 362164 T1011 
oasc.Overseer$ClusterStateUpdater.createCollection state version 
solrj_collection 1
   [junit4]   2> 362166 T1019 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362166 T1020 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362166 T1064 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362167 T1049 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362167 T1034 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362166 T1079 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362261 T1081 oasc.OverseerCollectionProcessor.createCollection 
Creating SolrCores for new collection solrj_collection, shardNames [shard1, 
shard2] , replicationFactor : 2
   [junit4]   2> 362262 T1081 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:61321_
   [junit4]   2> 362263 T1081 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:61344_
   [junit4]   2> 362265 T1081 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:61337_
   [junit4]   2> 362266 T1081 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:61352_
   [junit4]   2> 362267 T1002 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection=solrj_collection&action=CREATE&collection.configName=conf1&version=2&qt=/admin/cores&shard=shard1&wt=javabin&numShards=2&name=solrj_collection_shard1_replica1
   [junit4]   2> 362268 T1038 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection=solrj_collection&action=CREATE&collection.configName=conf1&version=2&qt=/admin/cores&shard=shard2&wt=javabin&numShards=2&name=solrj_collection_shard2_replica1
   [junit4]   2> 362267 T1053 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection=solrj_collection&action=CREATE&collection.configName=conf1&version=2&qt=/admin/cores&shard=shard1&wt=javabin&numShards=2&name=solrj_collection_shard1_replica2
   [junit4]   2> 362269 T1068 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection=solrj_collection&action=CREATE&collection.configName=conf1&version=2&qt=/admin/cores&shard=shard2&wt=javabin&numShards=2&name=solrj_collection_shard2_replica2
   [junit4]   2> 362272 T1053 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 362272 T1002 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 362272 T1068 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 362273 T1019 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 362272 T1038 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 362274 T1068 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 362273 T1002 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 362273 T1053 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 362275 T1038 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 362276 T1011 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "base_url":"http://127.0.0.1:61344";,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:61344_"}
   [junit4]   2> 362279 T1011 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "base_url":"http://127.0.0.1:61321";,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:61321_"}
   [junit4]   2> 362280 T1019 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 362281 T1011 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "base_url":"http://127.0.0.1:61352";,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:61352_"}
   [junit4]   2> 362283 T1011 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "base_url":"http://127.0.0.1:61337";,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:61337_"}
   [junit4]   2> 362285 T1019 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 362286 T1019 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362286 T1049 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362286 T1020 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362286 T1034 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362286 T1079 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 362286 T1064 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 363275 T1002 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 363275 T1068 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 363276 T1038 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 363276 T1053 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 363276 T1002 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 363277 T1053 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 363277 T1038 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 363277 T1068 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 363279 T1038 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 363278 T1053 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 363278 T1002 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 363280 T1053 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 363279 T1038 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 363279 T1068 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 363281 T1053 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 363280 T1002 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 363282 T1053 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/'
   [junit4]   2> 363283 T1002 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 363282 T1038 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 363281 T1068 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 363284 T1038 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/'
   [junit4]   2> 363283 T1002 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/'
   [junit4]   2> 363284 T1068 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 363286 T1068 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/'
   [junit4]   2> 363342 T1053 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 363347 T1038 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 363355 T1068 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 363359 T1002 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 363404 T1053 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 363406 T1053 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 363409 T1038 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 363411 T1038 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 363419 T1053 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 363420 T1068 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 363422 T1068 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 363423 T1002 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 363424 T1038 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 363424 T1002 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 363434 T1068 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 363438 T1002 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 363876 T1053 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 363885 T1038 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 363889 T1053 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 363893 T1053 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 363894 T1038 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 363898 T1038 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 363899 T1002 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 363900 T1068 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 363907 T1002 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 363909 T1053 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363911 T1002 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 363913 T1068 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 363914 T1038 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363916 T1053 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363917 T1068 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 363919 T1038 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363921 T1053 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363923 T1053 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363925 T1053 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363926 T1053 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363926 T1038 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363927 T1053 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363927 T1038 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363928 T1053 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363928 T1038 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363929 T1053 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 363929 T1038 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363930 T1002 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363930 T1053 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 363931 T1038 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363931 T1038 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363931 T1053 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica2] Opening new SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/data/
   [junit4]   2> 363932 T1038 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 363932 T1053 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3cc5a37d
   [junit4]   2> 363933 T1038 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 363934 T1038 oasc.SolrCore.<init> 
[solrj_collection_shard2_replica1] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/data/
   [junit4]   2> 363934 T1038 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3cc5a37d
   [junit4]   2> 363936 T1053 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/data
   [junit4]   2> 363936 T1068 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363936 T1002 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363937 T1038 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/data
   [junit4]   2> 363937 T1053 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 363938 T1053 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard1_replica2] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 363938 T1038 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 363939 T1038 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard2_replica1] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 363940 T1053 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-005/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 363941 T1053 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=46, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=53.876953125, 
floorSegmentMB=1.5595703125, forceMergeDeletesPctAllowed=27.52080108617267, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 363942 T1068 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 363942 T1038 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-004/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 363942 T1002 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363943 T1038 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=46, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=53.876953125, 
floorSegmentMB=1.5595703125, forceMergeDeletesPctAllowed=27.52080108617267, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 363944 T1002 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363944 T1002 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363945 T1002 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363946 T1002 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363947 T1068 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363947 T1002 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363948 T1068 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363948 T1002 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 363948 T1068 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363949 T1002 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 363949 T1068 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 363950 T1002 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica1] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/data/
   [junit4]   2> 363951 T1002 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3cc5a37d
   [junit4]   2> 363951 T1068 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 363951 T1068 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 363952 T1068 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 363952 T1068 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 363953 T1068 oasc.SolrCore.<init> 
[solrj_collection_shard2_replica2] Opening new SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/data/
   [junit4]   2> 363953 T1068 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@3cc5a37d
   [junit4]   2> 363953 T1002 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/data
   [junit4]   2> 363955 T1002 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 363955 T1002 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard1_replica1] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 363956 T1068 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/data
   [junit4]   2> 363957 T1068 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 363958 T1002 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-002/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 363958 T1068 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard2_replica2] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 363958 T1002 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=46, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=53.876953125, 
floorSegmentMB=1.5595703125, forceMergeDeletesPctAllowed=27.52080108617267, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 363961 T1068 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/tempDir-006/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 363961 T1068 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=46, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=53.876953125, 
floorSegmentMB=1.5595703125, forceMergeDeletesPctAllowed=27.52080108617267, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 363962 T1053 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-001
 
lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-001)),segFN=segments_1,generation=1}
   [junit4]   2> 363963 T1038 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-002
 
lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-002)),segFN=segments_1,generation=1}
   [junit4]   2> 363963 T1053 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 363963 T1038 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 363965 T1002 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-003
 
lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-003)),segFN=segments_1,generation=1}
   [junit4]   2> 363966 T1002 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 363968 T1068 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-004
 
lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-EA393A22F1FBC792-001/index-MMapDirectory-004)),segFN=segments_1,generation=1}
   [junit4]   2> 363969 T1068 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 363971 T1038 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 363972 T1038 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 363972 T1053 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 363973 T1002 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 363972 T1038 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 363973 T1002 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 363973 T1053 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 363974 T1002 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 363974 T1038 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 363975 T1068 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 363975 T1002 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 363975 T1053 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 363976 T1002 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 

[...truncated too long message...]

eeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 3046807 T23343 oaz.ClientCnxn$EventThread.processEvent ERROR 
Error while calling watcher  java.util.concurrent.RejectedExecutionException: 
Task java.util.concurrent.FutureTask@116b5967 rejected from 
java.util.concurrent.ThreadPoolExecutor@6c2936e[Terminated, pool size = 0, 
active threads = 0, queued tasks = 0, completed tasks = 4]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 3046807 T23343 oaz.ClientCnxn$EventThread.processEvent ERROR 
Error while calling watcher  java.util.concurrent.RejectedExecutionException: 
Task java.util.concurrent.FutureTask@66b512a2 rejected from 
java.util.concurrent.ThreadPoolExecutor@6c2936e[Terminated, pool size = 0, 
active threads = 0, queued tasks = 0, completed tasks = 4]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=DeleteLastCustomShardedReplicaTest -Dtests.method=testDistribSearch 
-Dtests.seed=EA393A22F1FBC792 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=es_VE -Dtests.timezone=Etc/UCT -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR    137s J1 | 
DeleteLastCustomShardedReplicaTest.testDistribSearch <<<
   [junit4]    > Throwable #1: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:20635/zmsxn, 
http://127.0.0.1:20640/zmsxn, http://127.0.0.1:20615/zmsxn]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([EA393A22F1FBC792:6BDFB43A86A4A7AE]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:1015)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:793)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:736)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : customcollreplicadeletion/a/core_node2
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:354)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:313)
   [junit4]    >        ... 46 more
   [junit4]   2> 3046825 T23279 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-EA393A22F1FBC792-001
   [junit4]   2> 136611 T23278 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50), 
sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_VE, 
timezone=Etc/UCT
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=1,free=110330360,total=489684992
   [junit4]   2> NOTE: All tests run in this JVM: [TestSystemIdResolver, 
TestManagedResource, TestComponentsName, TestFastOutputStream, StressHdfsTest, 
TestCollationField, TestZkChroot, TestCodecSupport, 
TestPartialUpdateDeduplication, PeerSyncTest, TestFunctionQuery, 
TestIntervalFaceting, TestRandomMergePolicy, TestClassNameShortening, 
ShowFileRequestHandlerTest, TestManagedSchemaFieldTypeResource, 
SortByFunctionTest, VMParamsZkACLAndCredentialsProvidersTest, 
SignatureUpdateProcessorFactoryTest, PreAnalyzedFieldTest, TestDocumentBuilder, 
SystemInfoHandlerTest, TestShardHandlerFactory, HttpPartitionTest, 
TestNoOpRegenerator, TestCollationFieldDocValues, DirectSolrSpellCheckerTest, 
ClusterStateTest, TestHighFrequencyDictionaryFactory, 
DistributedSuggestComponentTest, HighlighterMaxOffsetTest, 
ExternalFileFieldSortTest, TestSweetSpotSimilarityFactory, AddBlockUpdateTest, 
PrimitiveFieldTypeTest, OpenCloseCoreStressTest, JSONWriterTest, 
SharedFSAutoReplicaFailoverUtilsTest, SolrCoreCheckLockOnStartupTest, 
DebugComponentTest, ExternalCollectionsTest, SolrRequestParserTest, 
TestSchemaVersionResource, TestManagedSchemaFieldResource, 
TestFieldCollectionResource, TestAddFieldRealTimeGet, 
TestBM25SimilarityFactory, SuggesterFSTTest, CoreAdminRequestStatusTest, 
TestLFUCache, TestRecovery, MBeansHandlerTest, ClusterStateUpdateTest, 
LeaderElectionTest, ZkSolrClientTest, TestRandomDVFaceting, ZkCLITest, 
TestDistributedSearch, AutoCommitTest, TestDistributedGrouping, 
TermVectorComponentDistributedTest, HardAutoCommitTest, 
SpellCheckComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, 
TestFiltering, TestLazyCores, TestIndexSearcher, SoftAutoCommitTest, 
TestExtendedDismaxParser, DocValuesTest, SuggesterTSTTest, SuggesterTest, 
TestTrie, SuggesterWFSTTest, NoCacheHeaderTest, TestAtomicUpdateErrorCases, 
DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, 
DocValuesMultiTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestWriterPerf, 
RequestHandlersTest, TestValueSourceCache, TermVectorComponentTest, 
RequiredFieldsTest, FastVectorHighlighterTest, LoggingHandlerTest, 
SolrPluginUtilsTest, ReturnFieldsTest, QueryParsingTest, CSVRequestHandlerTest, 
TestQuerySenderListener, TestQuerySenderNoQuery, SolrIndexConfigTest, 
TestBinaryField, DirectSolrConnectionTest, SpellPossibilityIteratorTest, 
TestXIncludeConfig, TestPerFieldSimilarity, 
TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, 
URLClassifyProcessorTest, SpellingQueryConverterTest, DOMUtilTest, 
ZkNodePropsTest, FileUtilsTest, TestDistributedMissingSort, 
CloudExitableDirectoryReaderTest, DeleteLastCustomShardedReplicaTest]
   [junit4] Completed on J1 in 136.89s, 1 test, 1 error <<< FAILURES!

[...truncated 377 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1359:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:966:
 There were test failures: 437 suites, 1798 tests, 3 errors, 54 ignored (9 
assumptions)

Total time: 191 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #654
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 695028327 bytes
Compression is 0.0%
Took 1 min 57 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to