Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/655/

2 tests failed.
REGRESSION:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create 
core [halfcollection_shard1_replica1] Caused by: Could not get shard id for 
core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error 
CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


REGRESSION:  
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this 
request:[http://127.0.0.1:45467/gkx/d, http://127.0.0.1:45475/gkx/d, 
http://127.0.0.1:45472/gkx/d]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:45467/gkx/d, 
http://127.0.0.1:45475/gkx/d, http://127.0.0.1:45472/gkx/d]
        at 
__randomizedtesting.SeedInfo.seed([F6FA1D3B30CEE5AD:771C932347918591]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:1015)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:793)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:736)
        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : customcollreplicadeletion/a/core_node1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:354)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:313)
        ... 46 more




Build Log:
[...truncated 12523 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/init-core-data-001
   [junit4]   2> 1680130 T4419 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(false) and clientAuth (false)
   [junit4]   2> 1680131 T4419 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /
   [junit4]   2> 1680135 T4419 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 1680136 T4419 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1680137 T4420 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1680236 T4419 oasc.ZkTestServer.run start zk server on 
port:18019
   [junit4]   2> 1680237 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1680238 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1680241 T4426 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@39530c47 
name:ZooKeeperConnection Watcher:127.0.0.1:18019 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1680241 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1680242 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1680242 T4419 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1680245 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1680246 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1680247 T4428 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@45e408e1 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1680247 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1680248 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1680248 T4419 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 1680250 T4419 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 1680252 T4419 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 1680253 T4419 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 1680255 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1680256 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 1680258 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1680259 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 1680361 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1680361 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1680363 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1680364 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 1680365 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1680366 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 1680367 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1680368 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 1680369 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1680370 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 1680372 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1680372 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 1680374 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1680374 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1680376 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1680376 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 1680378 T4419 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1680378 T4419 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 1681261 T4419 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1681266 T4419 oejs.AbstractConnector.doStart Started 
[email protected]:18022
   [junit4]   2> 1681266 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1681266 T4419 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1681267 T4419 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002
   [junit4]   2> 1681267 T4419 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/'
   [junit4]   2> 1681296 T4419 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solr.xml
   [junit4]   2> 1681349 T4419 oasc.CoreContainer.<init> New CoreContainer 
218078697
   [junit4]   2> 1681350 T4419 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/]
   [junit4]   2> 1681351 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 1681351 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 1681351 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1681351 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1681351 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 1681352 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1681352 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1681352 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1681352 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1681353 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1681353 T4419 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1681353 T4419 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1681354 T4419 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1681354 T4419 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1681354 T4419 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:18019/solr
   [junit4]   2> 1681354 T4419 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1681355 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1681355 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1681357 T4439 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@61d832a9 
name:ZooKeeperConnection Watcher:127.0.0.1:18019 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1681358 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1681358 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1681360 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1681361 T4441 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2d8a4039 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1681362 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1681364 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1681366 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1681368 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1681370 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1681372 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1681373 T4419 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1681375 T4419 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18022_
   [junit4]   2> 1681375 T4419 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:18022_
   [junit4]   2> 1681377 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1681378 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1681380 T4419 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1681381 T4419 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:18022_
   [junit4]   2> 1681382 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1681383 T4419 oasc.Overseer.start Overseer 
(id=92665024459571203-127.0.0.1:18022_-n_0000000000) starting
   [junit4]   2> 1681385 T4419 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1681390 T4419 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1681391 T4443 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1681391 T4419 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1681393 T4419 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1681394 T4419 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1681396 T4442 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1681400 T4419 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
   [junit4]   2> 1681401 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1681402 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1681402 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1681403 T4447 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@70e66856 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1681404 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1681404 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1681405 T4419 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1681408 T4419 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 1681408 T4419 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 1681409 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1681409 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1681410 T4449 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6d412ec6 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1681411 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1681411 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1681413 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1681415 T4442 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
collection1
   [junit4]   2> 1681415 T4442 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 1681415 T4442 
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 1681417 T4442 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 1681418 T4450 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1681418 T4451 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1682622 T4419 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 1682622 T4419 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1682625 T4419 oejs.AbstractConnector.doStart Started 
[email protected]:18027
   [junit4]   2> 1682626 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1682626 T4419 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1682626 T4419 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003
   [junit4]   2> 1682626 T4419 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/'
   [junit4]   2> 1682656 T4419 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solr.xml
   [junit4]   2> 1682720 T4419 oasc.CoreContainer.<init> New CoreContainer 
805463138
   [junit4]   2> 1682721 T4419 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/]
   [junit4]   2> 1682722 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 1682722 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 1682722 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1682722 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1682722 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 1682723 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1682723 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1682723 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1682723 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1682724 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1682724 T4419 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1682724 T4419 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1682725 T4419 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1682725 T4419 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1682725 T4419 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:18019/solr
   [junit4]   2> 1682725 T4419 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1682726 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1682727 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1682728 T4462 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6d0c768d 
name:ZooKeeperConnection Watcher:127.0.0.1:18019 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682729 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1682730 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1682732 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1682733 T4464 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@61db2e42 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682733 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1682738 T4419 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1683742 T4419 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18027_
   [junit4]   2> 1683743 T4419 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:18027_
   [junit4]   2> 1683746 T4419 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1683751 T4419 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
   [junit4]   2> 1683751 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1684853 T4419 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 1684855 T4419 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1684858 T4419 oejs.AbstractConnector.doStart Started 
[email protected]:18030
   [junit4]   2> 1684858 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1684858 T4419 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1684859 T4419 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-004
   [junit4]   2> 1684859 T4419 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-004/'
   [junit4]   2> 1684888 T4419 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-004/solr.xml
   [junit4]   2> 1684940 T4419 oasc.CoreContainer.<init> New CoreContainer 
1895587558
   [junit4]   2> 1684940 T4419 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-004/]
   [junit4]   2> 1684941 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 1684941 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 1684941 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1684942 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1684942 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 1684942 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1684942 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1684943 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1684943 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1684943 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1684944 T4419 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1684944 T4419 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1684944 T4419 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1684944 T4419 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1684945 T4419 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:18019/solr
   [junit4]   2> 1684945 T4419 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1684945 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1684946 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1684947 T4477 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@48ba87fd 
name:ZooKeeperConnection Watcher:127.0.0.1:18019 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1684948 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1684949 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1684951 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1684952 T4479 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@474976f6 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1684952 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1684957 T4419 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1685961 T4419 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18030_
   [junit4]   2> 1685962 T4419 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:18030_
   [junit4]   2> 1685965 T4419 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1685970 T4419 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
   [junit4]   2> 1685970 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1687170 T4419 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 1687171 T4419 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1687174 T4419 oejs.AbstractConnector.doStart Started 
[email protected]:18033
   [junit4]   2> 1687174 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1687175 T4419 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1687175 T4419 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-005
   [junit4]   2> 1687175 T4419 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-005/'
   [junit4]   2> 1687204 T4419 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-005/solr.xml
   [junit4]   2> 1687256 T4419 oasc.CoreContainer.<init> New CoreContainer 
231547783
   [junit4]   2> 1687257 T4419 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-005/]
   [junit4]   2> 1687257 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 1687258 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 1687258 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1687258 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1687258 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 1687259 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1687259 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1687259 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1687259 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1687259 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1687260 T4419 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1687260 T4419 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1687260 T4419 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1687261 T4419 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1687261 T4419 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:18019/solr
   [junit4]   2> 1687261 T4419 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1687262 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1687262 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1687264 T4492 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@16d77b25 
name:ZooKeeperConnection Watcher:127.0.0.1:18019 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1687265 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1687265 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1687268 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1687268 T4494 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@68ca3777 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1687269 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1687274 T4419 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1688278 T4419 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18033_
   [junit4]   2> 1688279 T4419 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:18033_
   [junit4]   2> 1688283 T4419 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1688288 T4419 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
   [junit4]   2> 1688288 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1689389 T4419 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 1689390 T4419 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1689393 T4419 oejs.AbstractConnector.doStart Started 
[email protected]:18037
   [junit4]   2> 1689394 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1689394 T4419 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1689394 T4419 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-006
   [junit4]   2> 1689395 T4419 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-006/'
   [junit4]   2> 1689424 T4419 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-006/solr.xml
   [junit4]   2> 1689477 T4419 oasc.CoreContainer.<init> New CoreContainer 
1472260477
   [junit4]   2> 1689477 T4419 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-006/]
   [junit4]   2> 1689478 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 1689478 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 1689478 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1689479 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1689479 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 1689479 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1689479 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1689480 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1689480 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1689480 T4419 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1689481 T4419 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1689481 T4419 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1689481 T4419 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1689481 T4419 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1689482 T4419 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:18019/solr
   [junit4]   2> 1689482 T4419 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1689482 T4419 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1689483 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1689484 T4507 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3a213a8d 
name:ZooKeeperConnection Watcher:127.0.0.1:18019 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1689485 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1689486 T4419 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1689488 T4419 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1689489 T4509 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4492315f 
name:ZooKeeperConnection Watcher:127.0.0.1:18019/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1689489 T4419 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1689494 T4419 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1690498 T4419 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18037_
   [junit4]   2> 1690499 T4419 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:18037_
   [junit4]   2> 1690503 T4419 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1690507 T4419 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
   [junit4]   2> 1690508 T4419 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1690511 T4456 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
replicationFactor=2&collection.configName=conf1&wt=javabin&version=2&numShards=2&router.field=myOwnField&action=CREATE&name=solrj_collection
   [junit4]   2> 1690512 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 1690513 T4443 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 1690515 T4512 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 1690515 T4512 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 1690516 T4512 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 1690518 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1690520 T4442 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
solrj_collection
   [junit4]   2> 1690521 T4442 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
solrj_collection with shards [shard1, shard2]
   [junit4]   2> 1690521 T4442 
oasc.Overseer$ClusterStateUpdater.createCollection state version 
solrj_collection 1
   [junit4]   2> 1690523 T4510 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690523 T4465 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690523 T4450 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690523 T4495 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690523 T4451 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690523 T4480 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690618 T4512 
oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new 
collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 1690619 T4512 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard1_replica1 as part of slice shard1 of collection 
solrj_collection on 127.0.0.1:18022_
   [junit4]   2> 1690619 T4512 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard1_replica2 as part of slice shard1 of collection 
solrj_collection on 127.0.0.1:18027_
   [junit4]   2> 1690622 T4512 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard2_replica1 as part of slice shard2 of collection 
solrj_collection on 127.0.0.1:18037_
   [junit4]   2> 1690624 T4434 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection=solrj_collection&collection.configName=conf1&wt=javabin&version=2&numShards=2&action=CREATE&name=solrj_collection_shard1_replica1&shard=shard1
   [junit4]   2> 1690624 T4459 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection=solrj_collection&collection.configName=conf1&wt=javabin&version=2&numShards=2&action=CREATE&name=solrj_collection_shard1_replica2&shard=shard1
   [junit4]   2> 1690624 T4512 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard2_replica2 as part of slice shard2 of collection 
solrj_collection on 127.0.0.1:18033_
   [junit4]   2> 1690625 T4499 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection=solrj_collection&collection.configName=conf1&wt=javabin&version=2&numShards=2&action=CREATE&name=solrj_collection_shard2_replica1&shard=shard2
   [junit4]   2> 1690626 T4434 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 1690627 T4484 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection=solrj_collection&collection.configName=conf1&wt=javabin&version=2&numShards=2&action=CREATE&name=solrj_collection_shard2_replica2&shard=shard2
   [junit4]   2> 1690627 T4434 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1690627 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1690628 T4459 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 1690628 T4499 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 1690629 T4459 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1690629 T4499 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1690629 T4484 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 1690631 T4484 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1690631 T4442 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "node_name":"127.0.0.1:18022_",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "base_url":"http://127.0.0.1:18022"}
   [junit4]   2> 1690633 T4442 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "node_name":"127.0.0.1:18027_",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "base_url":"http://127.0.0.1:18027"}
   [junit4]   2> 1690634 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1690635 T4442 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "node_name":"127.0.0.1:18037_",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "base_url":"http://127.0.0.1:18037"}
   [junit4]   2> 1690637 T4442 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "node_name":"127.0.0.1:18033_",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "base_url":"http://127.0.0.1:18033"}
   [junit4]   2> 1690638 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1690639 T4450 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690639 T4451 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690639 T4510 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690639 T4495 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690639 T4480 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1690639 T4465 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1691769 T4459 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 1691769 T4459 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1691770 T4459 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1691770 T4459 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1691771 T4459 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1691771 T4459 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/'
   [junit4]   2> 1691821 T4459 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1691868 T4459 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1691882 T4434 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 1691882 T4499 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 1691882 T4484 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 1691883 T4499 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1691882 T4434 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1691884 T4499 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1691884 T4434 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1691884 T4434 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1691883 T4484 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1691884 T4499 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1691885 T4484 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1691886 T4484 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1691885 T4434 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1691886 T4499 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1691886 T4484 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1691886 T4434 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/'
   [junit4]   2> 1691887 T4484 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-005/solrj_collection_shard2_replica2/'
   [junit4]   2> 1691887 T4499 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-006/solrj_collection_shard2_replica1/'
   [junit4]   2> 1691942 T4434 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1691947 T4499 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1691953 T4484 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1691969 T4459 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1691980 T4459 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 1692006 T4434 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1692007 T4434 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1692012 T4499 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1692016 T4484 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1692018 T4434 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 1692113 T4499 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1692117 T4484 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1692125 T4499 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 1692128 T4484 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 1692410 T4459 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1692423 T4459 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1692426 T4459 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1692435 T4434 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1692436 T4459 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1692441 T4459 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1692443 T4434 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1692445 T4459 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1692446 T4434 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1692446 T4459 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1692449 T4459 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1692449 T4459 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1692450 T4459 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1692451 T4459 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1692451 T4459 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 1692451 T4459 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1692452 T4459 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica2] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/data/
   [junit4]   2> 1692452 T4459 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@33313e93
   [junit4]   2> 1692454 T4459 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/data
   [junit4]   2> 1692454 T4459 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 1692455 T4459 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard1_replica2] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1692455 T4459 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-003/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 1692456 T4459 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@39d29be6
   [junit4]   2> 1692457 T4459 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-5d52b347)),segFN=segments_1,generation=1}
   [junit4]   2> 1692457 T4459 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1692458 T4434 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1692463 T4459 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1692463 T4434 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1692463 T4459 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1692464 T4459 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1692464 T4459 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1692465 T4459 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1692465 T4459 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1692466 T4459 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1692466 T4459 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1692466 T4459 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1692467 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1692468 T4434 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1692468 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1692468 T4434 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1692469 T4434 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1692469 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1692469 T4434 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1692470 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 1692470 T4434 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1692471 T4434 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1692471 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 1692471 T4434 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 1692471 T4459 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1692472 T4434 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1692472 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 1692472 T4434 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica1] Opening new SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/data/
   [junit4]   2> 1692473 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 1692473 T4434 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@33313e93
   [junit4]   2> 1692474 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1692474 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1692474 T4434 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/data
   [junit4]   2> 1692475 T4459 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1692475 T4434 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 1692476 T4434 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard1_replica1] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1692476 T4434 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest-F6FA1D3B30CEE5AD-001/tempDir-002/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 1692477 T4434 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@700a4fdc
   [junit4]   2> 1692478 T4434 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70b698aa)),segFN=segments_1,generation=1}
   [junit4]   2> 1692478 T4434 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1692484 T4434 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1692484 T4434 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1692485 T4434 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1692485 T4434 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1692485 T4434 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1692486 T4434 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1692486 T4434 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1692487 T4434 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1692487 T4434 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1692488 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1692488 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1692489 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1692490 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 1692490 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 1692491 T4434 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1692491 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 1692492 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 1692492 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1692493 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1692494 T4434 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1692499 T4459 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692500 T4434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692502 T4459 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692510 T4434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692512 T4459 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692513 T4434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692515 T4459 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692516 T4434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1692524 T4434 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 1692524 T4459 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 1692524 T4434 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 1692525 T4459 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 1692526 T4434 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=13, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=47.4541015625, 
floorSegmentMB=1.3125, forceMergeDeletesPctAllowed=14.847135228332702, 
segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1692526 T4459 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=13, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=47.4541015625, 
floorSegmentMB=1.3125, forceMergeDeletesPctAllowed=14.847135228332702, 
segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1692526 T4434 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70b698aa)),segFN=segments_1,generation=1}
   [junit4]   2> 1692527 T4459 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-5d52b347)),segFN=segments_1,generation=1}
   [junit4]   2> 1692527 T4434 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1692527 T4459 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1692528 T4434 oass.SolrIndexSearcher.<init> Opening 
Searcher@6c24e1fe[solrj_collection_shard1_replica1] main
   [junit4]   2> 1692528 T4459 oass.SolrIndexSearcher.<init> Opening 
Searcher@279e7d4[solrj_collection_shard1_replica2] main
   [junit4]   2> 1692529 T4434 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1692529 T4459 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1692530 T4434 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1692530 T4459 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1692530 T4434 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1692530 T4459 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1692531 T4434 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1692531 T4459 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1692532 T4434 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 1692532 T4459 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 1692532 T4434 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1692533 T4459 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1692533 T4434 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1692534 T4459 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1692534 T4434 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1692534 T4459 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1692535 T4434 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 1692535 T4459 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 1692537 T4434 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1692537 T4434 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1692538 T4434 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 1692538 T4459 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1692538 T4459 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 1692541 T4518 oasc.SolrCore.registerSearcher 
[solrj_collection_shard1_replica1] Registered new searcher 
Searcher@6c24e1fe[solrj_collection_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1692542 T4517 oasc.SolrCore.registerSearcher 
[solrj_collection_shard1_replica2] Registered new searcher 
Searcher@279e7d4[solrj_collection_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1692545 T4434 oasc.CoreContainer.registerCore registering 
core: solrj_collection_shard1_replica1
   [junit4]   2> 1692546 T4434 oasc.ZkController.register Register replica - 
core:solrj_collection_shard1_replica1 address:http://127.0.0.1:18022 
collection:solrj_collection shard:shard1
   [junit4]   2> 1692546 T4459 oasc.CoreContainer.registerCore registering 
core: solrj_collection_shard1_replica2
   [junit4]   2> 1692547 T4434 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 1692547 T4459 oasc.ZkController.register Register replica - 
core:solrj_collection_shard1_replica2 address:http://127.0.0.1:18027 
collection:solrj_collection shard:shard1
   [junit4]   2> 1692548 T4459 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 1692551 T4434 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 1692553 T4450 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1692553 T4434 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 1692553 T4434 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C722 name=solrj_collection_shard1_replica1 
org.apache.solr.core.SolrCore@3357631e 
url=http://127.0.0.1:18022/solrj_collection_shard1_replica1 
node=127.0.0.1:18022_ C722_STATE=coll:solrj_collection 
core:solrj_collection_shard1_replica1 props:{node_name=127.0.0.1:18022_, 
state=down, core=solrj_collection_shard1_replica1, 
base_url=http://127.0.0.1:18022}
   [junit4]   2> 1692554 T4434 C722 P18022 oasc.SyncStrategy.sync Sync replicas 
to http://127.0.0.1:18022/solrj_collection_shard1_replica1/
   [junit4]   2> 1692554 T4434 C722 P18022 oasu.PeerSync.sync PeerSync: 
core=solrj_collection_shard1_replica1 url=http://127.0.0.1:18022 START 
replicas=[http://127.0.0.1:18027/solrj_collection_shard1_replica2/] nUpdates=100
   [junit4]   2> 1692555 T4434 C722 P18022 oasu.PeerSync.sync PeerSync: 
core=solrj_collection_shard1_replica1 url=http://127.0.0.1:18022 DONE.  We have 
no versions.  sync failed.
   [junit4]   2> 1692556 T4434 C722 P18022 oasc.SyncStrategy.syncReplicas 
Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1692556 T4434 oasc.ShardLeaderElectionContext.runLeaderProcess 
We failed sync, but we have no versions - we can't sync in that case - we were 
active before, so become leader anyway
   [junit4]   2> 1692557 T4434 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: http://127.0.0.1:18022/solrj_collection_shard1_replica1/ 
shard1
   [junit4]   2> 1692557 T4434 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection/leaders/shard1
   [junit4]   2> ASYNC  NEW_CORE C723 name=solrj_collection_shard1_replica2 
org.apache.solr.core.SolrCore@53a1e519 
url=http://127.0.0.1:18027/solrj_collection_shard1_replica2 
node=127.0.0.1:18027_ C723_STATE=coll:solrj_collection 
core:solrj_collection_shard1_replica2 props:{node_name=127.0.0.1:18027_, 
state=down, core=solrj_collection_shard1_replica2, 
base_url=http://127.0.0.1:18027}
   [junit4]   2> 1692558 T4460 C723 P18027 oasc.SolrCore.execute 
[solrj_collection_shard1_replica2] webapp= path=/get 
params={qt=/get&distrib=false&wt=javabin&version=2&getVersions=100} status=0 
QTime=1 
   [junit4]   2> 1692559 T4450 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1692559 T4451 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1692559 T4510 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1692559 T4465 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:No

[...truncated too long message...]

 T10228 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 2928521 T10228 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:45459 45459
   [junit4]   2> 2928725 T10229 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:45459 45459
   [junit4]   2> 2928824 T10292 oaz.ClientCnxn$EventThread.processEvent ERROR 
Error while calling watcher  java.util.concurrent.RejectedExecutionException: 
Task java.util.concurrent.FutureTask@1e6b173a rejected from 
java.util.concurrent.ThreadPoolExecutor@8c1f070[Terminated, pool size = 0, 
active threads = 0, queued tasks = 0, completed tasks = 5]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 2928825 T10292 oaz.ClientCnxn$EventThread.processEvent ERROR 
Error while calling watcher  java.util.concurrent.RejectedExecutionException: 
Task java.util.concurrent.FutureTask@2dd39fc4 rejected from 
java.util.concurrent.ThreadPoolExecutor@8c1f070[Terminated, pool size = 0, 
active threads = 0, queued tasks = 0, completed tasks = 5]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 2928825 T10292 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@52c4149d 
name:ZooKeeperConnection Watcher:127.0.0.1:45459/solr got event WatchedEvent 
state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 2928825 T10292 oascc.ConnectionManager.process 
Client->ZooKeeper status change trigger but we are already closed
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=DeleteLastCustomShardedReplicaTest -Dtests.method=testDistribSearch 
-Dtests.seed=F6FA1D3B30CEE5AD -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=ga_IE -Dtests.timezone=Asia/Ust-Nera 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR    135s J2 | 
DeleteLastCustomShardedReplicaTest.testDistribSearch <<<
   [junit4]    > Throwable #1: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:45467/gkx/d, 
http://127.0.0.1:45475/gkx/d, http://127.0.0.1:45472/gkx/d]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F6FA1D3B30CEE5AD:771C932347918591]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:1015)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:793)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:736)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : customcollreplicadeletion/a/core_node1
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:354)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:313)
   [junit4]    >        ... 46 more
   [junit4]   2> 2928835 T10228 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-F6FA1D3B30CEE5AD-001
   [junit4]   2> 134677 T10227 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, 
docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, 
locale=ga_IE, timezone=Asia/Ust-Nera
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=1,free=124428160,total=422051840
   [junit4]   2> NOTE: All tests run in this JVM: 
[DefaultValueUpdateProcessorTest, ModifyConfFileTest, TestDistributedSearch, 
DateMathParserTest, TestStandardQParsers, TestRandomDVFaceting, 
TestLuceneMatchVersion, TestReversedWildcardFilterFactory, EnumFieldTest, 
RegexBoostProcessorTest, OverseerRolesTest, 
CollectionsAPIAsyncDistributedZkTest, QueryResultKeyTest, 
TestManagedSynonymFilterFactory, TestPerFieldSimilarity, 
UpdateRequestProcessorFactoryTest, RemoteQueryErrorTest, TestCloudInspectUtil, 
TestSolrQueryParserResource, ZkNodePropsTest, TestReplicaProperties, 
TestSortingResponseWriter, RAMDirectoryFactoryTest, CurrencyFieldXmlFileTest, 
AliasIntegrationTest, TestManagedSchema, HdfsWriteToMultipleCollectionsTest, 
OpenExchangeRatesOrgProviderTest, BasicFunctionalityTest, ShardSplitTest, 
TestMultiCoreConfBootstrap, TestFieldTypeResource, IndexSchemaTest, 
CopyFieldTest, TestPseudoReturnFields, SolrXmlInZkTest, 
LeaderInitiatedRecoveryOnCommitTest, LeaderElectionIntegrationTest, 
TestSolrQueryParser, TestInfoStreamLogging, TestMaxScoreQueryParser, 
TestDistributedMissingSort, TestDocBasedVersionConstraints, 
TestIndexingPerformance, BinaryUpdateRequestHandlerTest, TestStressRecovery, 
PolyFieldTest, TestHighlightDedupGrouping, HdfsChaosMonkeySafeLeaderTest, 
TestAnalyzeInfixSuggestions, TestSolr4Spatial, TestJmxMonitoredMap, 
UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, JSONWriterTest, 
QueryParsingTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, 
PingRequestHandlerTest, SearchHandlerTest, HighlighterConfigTest, 
UpdateParamsTest, SolrIndexConfigTest, MultiTermTest, NumericFieldsTest, 
TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, 
ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestPhraseSuggestions, 
SpellPossibilityIteratorTest, TestCharFilters, EchoParamsTest, 
TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, 
TestIBSimilarityFactory, TestDefaultSimilarityFactory, 
LegacyHTMLStripCharFilterTest, PluginInfoTest, TestFastLRUCache, 
TestSuggestSpellingConverter, DOMUtilTest, TestDocumentBuilder, TestRTGBase, 
DistributedIntervalFacetingTest, DeleteLastCustomShardedReplicaTest]
   [junit4] Completed on J2 in 135.47s, 1 test, 1 error <<< FAILURES!

[...truncated 310 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962:
 There were test failures: 437 suites, 1797 tests, 2 errors, 54 ignored (9 
assumptions)

Total time: 230 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #654
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 679426569 bytes
Compression is 0.0%
Took 2 min 0 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to