Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2164/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:51595, 
http://127.0.0.1:51649, http://127.0.0.1:51608, http://127.0.0.1:51584, 
http://127.0.0.1:51589]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:51595, http://127.0.0.1:51649, 
http://127.0.0.1:51608, http://127.0.0.1:51584, http://127.0.0.1:51589]
        at 
__randomizedtesting.SeedInfo.seed([A984496287D2D1C:8B7ECA8E5F224D20]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:332)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
        at 
org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:172)
        at 
org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:145)
        at 
org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : delLiveColl/shard1/core_node1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:353)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:312)
        ... 47 more




Build Log:
[...truncated 11576 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/init-core-data-001
   [junit4]   2> 1746501 T24929 oas.SolrTestCaseJ4.buildSSLConfig Randomized 
ssl (false) and clientAuth (false)
   [junit4]   2> 1746502 T24929 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /
   [junit4]   2> 1746508 T24929 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 1746509 T24929 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1746510 T24930 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1746610 T24929 oasc.ZkTestServer.run start zk server on 
port:51451
   [junit4]   2> 1746611 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1746612 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1746616 T24936 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2a8561f0 
name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1746616 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1746617 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1746617 T24929 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1746620 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1746622 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1746623 T24938 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@52a92d33 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1746624 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1746624 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1746624 T24929 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 1746627 T24929 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 1746629 T24929 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 1746630 T24929 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 1746632 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1746633 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 1746635 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1746636 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 1746738 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1746739 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1746740 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1746741 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 1746743 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1746744 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 1746745 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1746746 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 1746748 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1746749 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 1746750 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1746751 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 1746753 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1746753 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1746755 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1746756 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 1746757 T24929 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1746758 T24929 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 1748394 T24929 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1748399 T24929 oejs.AbstractConnector.doStart Started 
[email protected]:51584
   [junit4]   2> 1748400 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1748400 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1748400 T24929 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002
   [junit4]   2> 1748401 T24929 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/'
   [junit4]   2> 1748457 T24929 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/solr.xml
   [junit4]   2> 1748499 T24929 oasc.CorePropertiesLocator.<init> 
Config-defined core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002
   [junit4]   2> 1748499 T24929 oasc.CoreContainer.<init> New CoreContainer 
230586081
   [junit4]   2> 1748500 T24929 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/]
   [junit4]   2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1748501 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1748502 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1748503 T24929 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1748503 T24929 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1748503 T24929 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1748504 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1748504 T24929 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:51451/solr
   [junit4]   2> 1748504 T24929 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1748504 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1748505 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1748506 T24949 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@536eb4d3 
name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1748507 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1748508 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1748510 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1748510 T24951 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4dad8dde 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1748510 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1748512 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1748514 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1748516 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1748517 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1748519 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1748521 T24929 oascc.SolrZkClient.makePath makePath: 
/live_nodes
   [junit4]   2> 1748522 T24929 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51584_
   [junit4]   2> 1748522 T24929 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:51584_
   [junit4]   2> 1748524 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1748525 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1748526 T24929 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1748527 T24929 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:51584_
   [junit4]   2> 1748527 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1748529 T24929 oasc.Overseer.start Overseer 
(id=92593852723822595-127.0.0.1:51584_-n_0000000000) starting
   [junit4]   2> 1748530 T24929 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1748535 T24929 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1748536 T24953 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1748536 T24929 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1748537 T24929 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1748538 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1748540 T24952 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1748542 T24929 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002
   [junit4]   2> 1748544 T24929 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/conf/
   [junit4]   2> 1749575 T24929 oasc.CorePropertiesLocator.discover Found 1 
core definitions
   [junit4]   2> 1749576 T24929 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 1749577 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1749577 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1749578 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1749579 T24957 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7e390df name:ZooKeeperConnection 
Watcher:127.0.0.1:51451/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1749580 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1749580 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1749582 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1749584 T24929 oasc.ChaosMonkey.monkeyLog monkey: init - 
expire sessions:false cause connection loss:false
   [junit4]   2> 1749585 T24929 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 1749585 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1749586 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1749587 T24959 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@22a05cea 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1749587 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1749587 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1749590 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1749592 T24952 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
collection1
   [junit4]   2> 1749593 T24952 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 1749593 T24952 
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 1749595 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection 
/collections/collection1/state.json
   [junit4]   2> 1749596 T24960 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1749596 T24961 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1750764 T24929 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 1750765 T24929 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1750768 T24929 oejs.AbstractConnector.doStart Started 
[email protected]:51589
   [junit4]   2> 1750769 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1750769 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1750769 T24929 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003
   [junit4]   2> 1750769 T24929 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/'
   [junit4]   2> 1750804 T24929 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/solr.xml
   [junit4]   2> 1750857 T24929 oasc.CorePropertiesLocator.<init> 
Config-defined core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003
   [junit4]   2> 1750858 T24929 oasc.CoreContainer.<init> New CoreContainer 
292044262
   [junit4]   2> 1750858 T24929 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/]
   [junit4]   2> 1750859 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1750859 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1750860 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1750861 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1750861 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1750861 T24929 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1750862 T24929 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1750862 T24929 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1750862 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1750862 T24929 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:51451/solr
   [junit4]   2> 1750863 T24929 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1750863 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1750864 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1750865 T24972 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@52b7cff7 
name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1750866 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1750866 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1750868 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1750869 T24974 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@409c76d6 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1750869 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1750874 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1751877 T24929 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51589_
   [junit4]   2> 1751878 T24929 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:51589_
   [junit4]   2> 1751881 T24929 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1751885 T24929 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003
   [junit4]   2> 1751896 T24929 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/conf/
   [junit4]   2> 1753099 T24929 oasc.CorePropertiesLocator.discover Found 1 
core definitions
   [junit4]   2> 1753103 T24929 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 1753103 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1754018 T24929 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 1754019 T24929 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1754022 T24929 oejs.AbstractConnector.doStart Started 
[email protected]:51595
   [junit4]   2> 1754022 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1754023 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1754023 T24929 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004
   [junit4]   2> 1754023 T24929 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/'
   [junit4]   2> 1754055 T24929 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/solr.xml
   [junit4]   2> 1754100 T24929 oasc.CorePropertiesLocator.<init> 
Config-defined core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004
   [junit4]   2> 1754100 T24929 oasc.CoreContainer.<init> New CoreContainer 
208789375
   [junit4]   2> 1754101 T24929 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/]
   [junit4]   2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1754102 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1754103 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1754104 T24929 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1754104 T24929 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1754104 T24929 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1754105 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1754105 T24929 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:51451/solr
   [junit4]   2> 1754105 T24929 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1754105 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1754106 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1754107 T24987 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@808113b name:ZooKeeperConnection 
Watcher:127.0.0.1:51451 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1754108 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1754109 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1754111 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1754112 T24989 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@21778113 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1754112 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1754116 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1755120 T24929 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51595_
   [junit4]   2> 1755121 T24929 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:51595_
   [junit4]   2> 1755125 T24929 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1755129 T24929 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004
   [junit4]   2> 1755870 T24929 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-004/conf/
   [junit4]   2> 1755986 T24929 oasc.CorePropertiesLocator.discover Found 1 
core definitions
   [junit4]   2> 1755987 T24929 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 1755988 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1756884 T24929 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 1756885 T24929 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1756888 T24929 oejs.AbstractConnector.doStart Started 
[email protected]:51608
   [junit4]   2> 1756888 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1756889 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1756889 T24929 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005
   [junit4]   2> 1756889 T24929 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/'
   [junit4]   2> 1756919 T24929 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/solr.xml
   [junit4]   2> 1756980 T24929 oasc.CorePropertiesLocator.<init> 
Config-defined core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005
   [junit4]   2> 1756980 T24929 oasc.CoreContainer.<init> New CoreContainer 
1097821943
   [junit4]   2> 1756981 T24929 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/]
   [junit4]   2> 1756982 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1756982 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1756983 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1756983 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1756983 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1756984 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1756984 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1756984 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1756985 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1756985 T24929 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1756986 T24929 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1756986 T24929 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1756986 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1756987 T24929 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:51451/solr
   [junit4]   2> 1756987 T24929 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1756988 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1756989 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1756990 T25002 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ade3bb0 
name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1756991 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1756991 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1756993 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1756995 T25004 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6ad8e96a 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1756995 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1757000 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1758004 T24929 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51608_
   [junit4]   2> 1758005 T24929 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:51608_
   [junit4]   2> 1758009 T24929 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1758013 T24929 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005
   [junit4]   2> 1759066 T24929 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/conf/
   [junit4]   2> 1759080 T24929 oasc.CorePropertiesLocator.discover Found 1 
core definitions
   [junit4]   2> 1759081 T24929 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 1759082 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1760248 T24929 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 1760248 T24929 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1760251 T24929 oejs.AbstractConnector.doStart Started 
[email protected]:51649
   [junit4]   2> 1760252 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1760252 T24929 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1760252 T24929 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006
   [junit4]   2> 1760252 T24929 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/'
   [junit4]   2> 1760283 T24929 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/solr.xml
   [junit4]   2> 1760327 T24929 oasc.CorePropertiesLocator.<init> 
Config-defined core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006
   [junit4]   2> 1760327 T24929 oasc.CoreContainer.<init> New CoreContainer 
133676098
   [junit4]   2> 1760327 T24929 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/]
   [junit4]   2> 1760328 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1760328 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1760329 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1760330 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1760330 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1760330 T24929 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1760331 T24929 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1760331 T24929 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1760331 T24929 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1760331 T24929 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1760332 T24929 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:51451/solr
   [junit4]   2> 1760332 T24929 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1760332 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1760333 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1760334 T25017 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@19689524 
name:ZooKeeperConnection Watcher:127.0.0.1:51451 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1760335 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760336 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1760338 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1760339 T25019 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6d7c72bb 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1760339 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760343 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1761347 T24929 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51649_
   [junit4]   2> 1761348 T24929 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:51649_
   [junit4]   2> 1761352 T24929 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1761357 T24929 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006
   [junit4]   2> 1761385 T24929 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/conf/
   [junit4]   2> 1762648 T24929 oasc.CorePropertiesLocator.discover Found 1 
core definitions
   [junit4]   2> 1762649 T24929 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 1762649 T24929 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1762651 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1762651 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1762652 T25023 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@79bdecc1 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1762653 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1762653 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1762655 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1762656 T24929 
oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with 
stateFormat=2: delLiveColl
   [junit4]   2> 1762656 T24929 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1762657 T24929 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1762658 T25025 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e44ef88 
name:ZooKeeperConnection Watcher:127.0.0.1:51451/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1762658 T24929 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1762658 T24929 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1762659 T24929 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1762663 T25009 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
wt=javabin&numShards=2&name=delLiveColl&stateFormat=2&version=2&maxShardsPerNode=2&replicationFactor=2&action=CREATE
   [junit4]   2> 1762664 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 1762664 T24953 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"delLiveColl",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2"}
   [junit4]   2> 1762665 T25026 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"delLiveColl",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "maxShardsPerNode":"2",
   [junit4]   2>          "stateFormat":"2"}
   [junit4]   2> 1762666 T25026 oasc.OverseerCollectionProcessor.createConfNode 
Only one config set found in zk - using it:conf1
   [junit4]   2> 1762667 T25026 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/delLiveColl 
   [junit4]   2> 1762667 T25026 oascc.SolrZkClient.makePath makePath: 
/collections/delLiveColl
   [junit4]   2> 1762669 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1762671 T24952 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
delLiveColl
   [junit4]   2> 1762671 T24952 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
delLiveColl with shards [shard1, shard2]
   [junit4]   2> 1762672 T24952 
oasc.Overseer$ClusterStateUpdater.createCollection state version delLiveColl 2
   [junit4]   2> 1762673 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection 
/collections/delLiveColl/state.json
   [junit4]   2> 1762674 T24960 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T24990 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T25028 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T25005 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T25027 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T24961 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T25020 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762674 T24975 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1762769 T25026 
oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new 
collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 1762770 T25026 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl 
on 127.0.0.1:51589_
   [junit4]   2> 1762770 T25026 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl 
on 127.0.0.1:51584_
   [junit4]   2> 1762772 T25026 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl 
on 127.0.0.1:51649_
   [junit4]   2> 1762773 T25026 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl 
on 127.0.0.1:51608_
   [junit4]   2> 1762773 T24967 oasha.CoreAdminHandler.handleCreateAction core 
create command 
wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard1_replica1&version=2&collection=delLiveColl&shard=shard1&action=CREATE
   [junit4]   2> 1762773 T24945 oasha.CoreAdminHandler.handleCreateAction core 
create command 
wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard1_replica2&version=2&collection=delLiveColl&shard=shard1&action=CREATE
   [junit4]   2> 1762774 T25010 oasha.CoreAdminHandler.handleCreateAction core 
create command 
wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard2_replica1&version=2&collection=delLiveColl&shard=shard2&action=CREATE
   [junit4]   2> 1762775 T24996 oasha.CoreAdminHandler.handleCreateAction core 
create command 
wt=javabin&qt=/admin/cores&numShards=2&collection.configName=conf1&name=delLiveColl_shard2_replica2&version=2&collection=delLiveColl&shard=shard2&action=CREATE
   [junit4]   2> 1762776 T24945 oasc.ZkController.publish publishing 
core=delLiveColl_shard1_replica2 state=down collection=delLiveColl
   [junit4]   2> 1762776 T24967 oasc.ZkController.publish publishing 
core=delLiveColl_shard1_replica1 state=down collection=delLiveColl
   [junit4]   2> 1762777 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1762778 T24996 oasc.ZkController.publish publishing 
core=delLiveColl_shard2_replica2 state=down collection=delLiveColl
   [junit4]   2> 1762778 T24945 oasc.ZkController.preRegister Registering watch 
for external collection delLiveColl
   [junit4]   2> 1762778 T25010 oasc.ZkController.publish publishing 
core=delLiveColl_shard2_replica1 state=down collection=delLiveColl
   [junit4]   2> 1762778 T24967 oasc.ZkController.preRegister Registering watch 
for external collection delLiveColl
   [junit4]   2> 1762779 T24967 oascc.ZkStateReader.addZkWatch addZkWatch 
delLiveColl
   [junit4]   2> 1762779 T24967 oascc.ZkStateReader.addZkWatch Updating 
collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 1762780 T24996 oasc.ZkController.preRegister Registering watch 
for external collection delLiveColl
   [junit4]   2> 1762780 T24996 oascc.ZkStateReader.addZkWatch addZkWatch 
delLiveColl
   [junit4]   2> 1762780 T25010 oasc.ZkController.preRegister Registering watch 
for external collection delLiveColl
   [junit4]   2> 1762780 T24952 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:51584_",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"delLiveColl",
   [junit4]   2>          "base_url":"http://127.0.0.1:51584";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "core":"delLiveColl_shard1_replica2"}
   [junit4]   2> 1762780 T25010 oascc.ZkStateReader.addZkWatch addZkWatch 
delLiveColl
   [junit4]   2> 1762780 T24996 oascc.ZkStateReader.addZkWatch Updating 
collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 1762780 T24967 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 0 
   [junit4]   2> 1762781 T25010 oascc.ZkStateReader.addZkWatch Updating 
collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 1762781 T24967 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1762782 T24996 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 0 
   [junit4]   2> 1762782 T24996 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1762782 T25010 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 0 
   [junit4]   2> 1762782 T25010 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1762785 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection 
/collections/delLiveColl/state.json
   [junit4]   2> 1762785 T24975 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762785 T25020 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762785 T25005 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762786 T25020 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 1 
   [junit4]   2> 1762786 T24975 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 1 
   [junit4]   2> 1762786 T25005 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 1 
   [junit4]   2> 1762786 T24945 oascc.ZkStateReader.addZkWatch addZkWatch 
delLiveColl
   [junit4]   2> 1762787 T24945 oascc.ZkStateReader.addZkWatch Updating 
collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 1762788 T24945 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 1 
   [junit4]   2> 1762788 T24945 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1762788 T24945 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for delLiveColl_shard1_replica2
   [junit4]   2> 1762788 T24945 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:delLiveColl
   [junit4]   2> 1762789 T24945 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1762789 T24945 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/delLiveColl
   [junit4]   2> 1762790 T24945 oascc.ZkStateReader.readConfigName 
path=/collections/delLiveColl configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1762790 T24952 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 1 
   [junit4]   2> 1762790 T24945 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/'
   [junit4]   2> 1762790 T24952 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:51589_",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"delLiveColl",
   [junit4]   2>          "base_url":"http://127.0.0.1:51589";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "core":"delLiveColl_shard1_replica1"}
   [junit4]   2> 1762792 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1762792 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection 
/collections/delLiveColl/state.json
   [junit4]   2> 1762792 T24960 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762792 T24975 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762792 T25005 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762792 T25020 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762793 T24975 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 2 
   [junit4]   2> 1762793 T25020 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 2 
   [junit4]   2> 1762793 T25005 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 2 
   [junit4]   2> 1762794 T24960 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 2 
   [junit4]   2> 1762796 T24952 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 2 
   [junit4]   2> 1762796 T24952 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:51608_",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"delLiveColl",
   [junit4]   2>          "base_url":"http://127.0.0.1:51608";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "core":"delLiveColl_shard2_replica2"}
   [junit4]   2> 1762797 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1762798 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection 
/collections/delLiveColl/state.json
   [junit4]   2> 1762798 T24975 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762798 T25020 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762798 T24960 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762798 T25005 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762800 T25020 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 3 
   [junit4]   2> 1762799 T24975 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 3 
   [junit4]   2> 1762800 T25005 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 3 
   [junit4]   2> 1762801 T24960 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 3 
   [junit4]   2> 1762803 T24952 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 3 
   [junit4]   2> 1762803 T24952 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "node_name":"127.0.0.1:51649_",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "collection":"delLiveColl",
   [junit4]   2>          "base_url":"http://127.0.0.1:51649";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "core":"delLiveColl_shard2_replica1"}
   [junit4]   2> 1762804 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1762804 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection 
/collections/delLiveColl/state.json
   [junit4]   2> 1762805 T25020 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762805 T25005 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762805 T24960 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762805 T25020 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 4 
   [junit4]   2> 1762805 T24975 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1762806 T25005 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 4 
   [junit4]   2> 1762806 T24975 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 4 
   [junit4]   2> 1762806 T24960 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 4 
   [junit4]   2> 1762900 T24945 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1762940 T24945 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1762941 T24945 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1762949 T24945 oass.IndexSchema.readSchema 
[delLiveColl_shard1_replica2] Schema name=test
   [junit4]   2> 1763256 T24945 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1763265 T24945 oass.IndexSchema.readSchema default search 
field in schema is text
   [junit4]   2> 1763267 T24945 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1763275 T24945 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1763278 T24945 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1763281 T24945 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1763282 T24945 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1763284 T24945 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1763284 T24945 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1763285 T24945 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1763285 T24945 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1763285 T24945 oasc.CoreContainer.create Creating SolrCore 
'delLiveColl_shard1_replica2' using configuration from collection delLiveColl
   [junit4]   2> 1763286 T24945 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1763286 T24945 oasc.SolrCore.<init> 
[delLiveColl_shard1_replica2] Opening new SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/
   [junit4]   2> 1763286 T24945 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@65a20e1a
   [junit4]   2> 1763287 T24945 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data
   [junit4]   2> 1763287 T24945 oasc.SolrCore.getNewIndexDir New index 
directory detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/index/
   [junit4]   2> 1763288 T24945 oasc.SolrCore.initIndex WARN 
[delLiveColl_shard1_replica2] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1763288 T24945 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-002/delLiveColl_shard1_replica2/data/index
   [junit4]   2> 1763288 T24945 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6717345245057039]
   [junit4]   2> 1763289 T24945 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-bc3f98a)),segFN=segments_1,generation=1}
   [junit4]   2> 1763289 T24945 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1763293 T24945 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1763293 T24945 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1763293 T24945 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1763294 T24945 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1763295 T24945 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1763295 T24945 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1763295 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1763296 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1763296 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1763297 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 1763297 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 1763297 T24945 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1763298 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 1763298 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 1763298 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1763299 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1763299 T24945 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1763319 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1763320 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1763322 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1763323 T24945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1763329 T24945 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 1763329 T24945 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 1763329 T24945 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1763330 T24945 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-bc3f98a)),segFN=segments_1,generation=1}
   [junit4]   2> 1763330 T24945 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1763330 T24945 oass.SolrIndexSearcher.<init> Opening 
Searcher@4d01e87f[delLiveColl_shard1_replica2] main
   [junit4]   2> 1763331 T24945 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/delLiveColl
   [junit4]   2> 1763331 T24945 oascc.ZkStateReader.readConfigName 
path=/collections/delLiveColl configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1763332 T24945 oasr.ManagedResourceStorage.newStorageIO 
Setting up ZooKeeper-based storage for the RestManager with znodeBase: 
/configs/conf1
   [junit4]   2> 1763332 T24945 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1763332 T24945 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 1763332 T24945 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1763333 T24945 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1763333 T24945 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1763334 T24945 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 1763335 T24945 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1763335 T24945 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1763336 T24945 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 1763338 T25033 oasc.SolrCore.registerSearcher 
[delLiveColl_shard1_replica2] Registered new searcher 
Searcher@4d01e87f[delLiveColl_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1763340 T24945 oasc.CoreContainer.registerCore registering 
core: delLiveColl_shard1_replica2
   [junit4]   2> 1763340 T24945 oasc.ZkController.register Register replica - 
core:delLiveColl_shard1_replica2 address:http://127.0.0.1:51584 
collection:delLiveColl shard:shard1
   [junit4]   2> 1763341 T24945 oascc.SolrZkClient.makePath makePath: 
/collections/delLiveColl/leader_elect/shard1/election
   [junit4]   2> 1763345 T24945 
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for 
shard shard1
   [junit4]   2> 1763346 T24960 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1763347 T24945 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see 
more replicas up for shard shard1: total=2 found=1 timeoutin=7.0177747E15ms
   [junit4]   2> 1763349 T24952 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 4 
   [junit4]   2> 1763351 T24952 
oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection 
/collections/delLiveColl/state.json
   [junit4]   2> 1763351 T24960 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1763351 T25020 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1763351 T24975 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1763351 T25005 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 1763352 T25020 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 5 
   [junit4]   2> 1763352 T25005 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 5 
   [junit4]   2> 1763352 T24975 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 5 
   [junit4]   2> 1763352 T24960 oascc.ZkStateReader.updateWatchedCollection 
Updating data for delLiveColl to ver 5 
   [junit4]   2> 1763782 T24996 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for delLiveColl_shard2_replica2
   [junit4]   2> 1763782 T24967 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for delLiveColl_shard1_replica1
   [junit4]   2> 1763783 T24996 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:delLiveColl
   [junit4]   2> 1763783 T25010 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for delLiveColl_shard2_replica1
   [junit4]   2> 1763784 T24996 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1763783 T24967 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:delLiveColl
   [junit4]   2> 1763784 T24996 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/delLiveColl
   [junit4]   2> 1763784 T25010 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:delLiveColl
   [junit4]   2> 1763785 T24967 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1763785 T25010 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1763785 T24996 oascc.ZkStateReader.readConfigName 
path=/collections/delLiveColl configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1763786 T25010 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/delLiveColl
   [junit4]   2> 1763785 T24967 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/delLiveColl
   [junit4]   2> 1763786 T24996 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-005/delLiveColl_shard2_replica2/'
   [junit4]   2> 1763787 T25010 oascc.ZkStateReader.readConfigName 
path=/collections/delLiveColl configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1763787 T24967 oascc.ZkStateReader.readConfigName 
path=/collections/delLiveColl configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1763787 T25010 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/'
   [junit4]   2> 1763787 T24967 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/'
   [junit4]   2> 1763830 T24996 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1763857 T24967 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1763861 T25010 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 1763881 T24996 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1763897 T24967 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1763919 T25010 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1763982 T24996 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1763989 T24996 oass.IndexSchema.readSchema 
[delLiveColl_shard2_replica2] Schema name=test
   [junit4]   2> 1763998 T24967 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1764005 T24967 oass.IndexSchema.readSchema 
[delLiveColl_shard1_replica1] Schema name=test
   [junit4]   2> 1764027 T25010 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1764040 T25010 oass.IndexSchema.readSchema 
[delLiveColl_shard2_replica1] Schema name=test
   [junit4]   2> 1764341 T24967 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1764346 T24967 oass.IndexSchema.readSchema default search 
field in schema is text
   [junit4]   2> 1764348 T24967 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1764357 T24967 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1764360 T24967 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1764363 T24996 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1764364 T24967 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1764364 T24967 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1764365 T24967 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1764365 T24967 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1764366 T24967 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1764366 T24967 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1764366 T24967 oasc.CoreContainer.create Creating SolrCore 
'delLiveColl_shard1_replica1' using configuration from collection delLiveColl
   [junit4]   2> 1764366 T24967 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1764367 T24967 oasc.SolrCore.<init> 
[delLiveColl_shard1_replica1] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data/
   [junit4]   2> 1764367 T24967 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@65a20e1a
   [junit4]   2> 1764367 T24996 oass.IndexSchema.readSchema default search 
field in schema is text
   [junit4]   2> 1764368 T24967 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data
   [junit4]   2> 1764368 T24967 oasc.SolrCore.getNewIndexDir New index 
directory detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data/index/
   [junit4]   2> 1764368 T24967 oasc.SolrCore.initIndex WARN 
[delLiveColl_shard1_replica1] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-003/delLiveColl_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1764369 T24967 oasc.CachingDirecto

[...truncated too long message...]

  [junit4]   2> 1965134 T24929 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1965134 T24929 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1965137 T24929 oasc.SolrCore.closeSearcher 
[delLiveColl_shard2_replica1] Closing main searcher on request.
   [junit4]   2> 1965137 T24929 oasc.CachingDirectoryFactory.close Closing 
MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1965138 T24929 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data/index
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data/index;done=false>>]
   [junit4]   2> 1965138 T24929 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data/index
   [junit4]   2> 1965138 T24929 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data;done=false>>]
   [junit4]   2> 1965139 T24929 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001/tempDir-006/delLiveColl_shard2_replica1/data
   [junit4]   2> 1965140 T24929 oasc.Overseer.close Overseer 
(id=92593852723822605-127.0.0.1:51649_-n_0000000004) closing
   [junit4]   2> 1965140 T25080 oasc.Overseer$ClusterStateUpdater.run Overseer 
Loop exiting : 127.0.0.1:51649_
   [junit4]   2> 1965144 T25020 oascc.ZkStateReader$3.process WARN ZooKeeper 
watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1965145 T24929 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 1970111 T24929 oas.SolrTestCaseJ4.tearDown ###Ending 
testDistribSearch
   [junit4]   2> 1970114 T24929 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:51451 51451
   [junit4]   2> 1970200 T24930 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:51451 51451
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DeleteReplicaTest 
-Dtests.method=testDistribSearch -Dtests.seed=A984496287D2D1C 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=pt_BR 
-Dtests.timezone=Asia/Tehran -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    224s J0 | DeleteReplicaTest.testDistribSearch <<<
   [junit4]    > Throwable #1: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:51595, http://127.0.0.1:51649, 
http://127.0.0.1:51608, http://127.0.0.1:51584, http://127.0.0.1:51589]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([A984496287D2D1C:8B7ECA8E5F224D20]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:332)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:172)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:145)
   [junit4]    >        at 
org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : delLiveColl/shard1/core_node1
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:353)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:312)
   [junit4]    >        ... 47 more
   [junit4]   2> 1970271 T24929 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-A984496287D2D1C-001
   [junit4]   2> 223776 T24928 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, 
docValues:{}, sim=DefaultSimilarity, locale=pt_BR, timezone=Asia/Tehran
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=1,free=168501032,total=534249472
   [junit4]   2> NOTE: All tests run in this JVM: 
[DistributedSuggestComponentTest, TestFuzzyAnalyzedSuggestions, 
TestPhraseSuggestions, SuggestComponentTest, DistributedExpandComponentTest, 
TestHighFrequencyDictionaryFactory, TestExtendedDismaxParser, 
LeaderInitiatedRecoveryOnCommitTest, SOLR749Test, TestDistributedSearch, 
SimpleFacetsTest, HardAutoCommitTest, TestExceedMaxTermLength, TestFiltering, 
ClusterStateUpdateTest, TestQuerySenderListener, IndexSchemaRuntimeFieldTest, 
OutputWriterTest, FileUtilsTest, FullSolrCloudDistribCmdsTest, 
HttpPartitionTest, MBeansHandlerTest, 
OverriddenZkACLAndCredentialsProvidersTest, XmlUpdateRequestHandlerTest, 
DateRangeFieldTest, TestFaceting, TestValueSourceCache, 
PreAnalyzedUpdateProcessorTest, PluginInfoTest, TestBinaryResponseWriter, 
DOMUtilTest, TestDocSet, TestWordDelimiterFilterFactory, 
TestCopyFieldCollectionResource, SearchHandlerTest, IndexBasedSpellCheckerTest, 
TestClassNameShortening, TestDistributedGrouping, 
DeleteLastCustomShardedReplicaTest, TestElisionMultitermQuery, 
SpellCheckCollatorTest, TestDocBasedVersionConstraints, TestInitParams, 
ResourceLoaderTest, TestCharFilters, PathHierarchyTokenizerFactoryTest, 
FileBasedSpellCheckerTest, CollectionsAPIAsyncDistributedZkTest, PeerSyncTest, 
TestQueryTypes, TestStressVersions, SpellingQueryConverterTest, 
TestLuceneMatchVersion, TestZkChroot, MultiThreadedOCPTest, 
DistributedIntervalFacetingTest, TestManagedSchemaDynamicFieldResource, 
LeaderElectionIntegrationTest, TermVectorComponentDistributedTest, 
DeleteReplicaTest]
   [junit4] Completed on J0 in 224.07s, 1 test, 1 error <<< FAILURES!

[...truncated 537 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:524:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:472:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1360:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:962:
 There were test failures: 437 suites, 1785 tests, 1 error, 58 ignored (23 
assumptions)

Total time: 58 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #2162
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 156493687 bytes
Compression is 0.0%
Took 29 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to