Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/675/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([C412F994C135E7A4]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([C412F994C135E7A4]:0)


REGRESSION:  
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=601, name=Thread-303, 
state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=601, name=Thread-303, state=RUNNABLE, 
group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: http://127.0.0.1:52394/sea/wc/collection1
        at __randomizedtesting.SeedInfo.seed([C412F994C135E7A4]:0)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:380)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: http://127.0.0.1:52394/sea/wc/collection1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:579)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
        at 
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:378)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:465)
        ... 4 more




Build Log:
[...truncated 11895 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/init-core-data-001
   [junit4]   2> 71267 T87 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /sea/wc
   [junit4]   2> 71275 T87 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 71292 T87 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 71306 T88 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 71606 T87 oasc.ZkTestServer.run start zk server on port:52387
   [junit4]   2> 71621 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 71949 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 72022 T89 oazs.NIOServerCnxn.doIO WARN Exception causing close 
of session 0x0 due to java.io.IOException: ZooKeeperServer not running
   [junit4]   2> 73557 T93 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2277ed0a 
name:ZooKeeperConnection Watcher:127.0.0.1:52387 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 73558 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 73559 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 73571 T87 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 73723 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 73724 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 73726 T96 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2616aa35 
name:ZooKeeperConnection Watcher:127.0.0.1:52387/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 73726 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 73727 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 73734 T87 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 73739 T87 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 73743 T87 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 73746 T87 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 73750 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 73751 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 73757 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 73758 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 73762 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 73763 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 73767 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 73767 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 73771 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 73772 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 73776 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 73777 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 73780 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 73781 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 73785 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 73786 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 73790 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 73791 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 73795 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 73796 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 73799 T87 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 73800 T87 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 76176 T87 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 76182 T87 oejs.AbstractConnector.doStart Started 
[email protected]:52394
   [junit4]   2> 76183 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 76183 T87 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 76184 T87 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002
   [junit4]   2> 76184 T87 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/'
   [junit4]   2> 76240 T87 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/solr.xml
   [junit4]   2> 76346 T87 oasc.CoreContainer.<init> New CoreContainer 111057813
   [junit4]   2> 76347 T87 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/]
   [junit4]   2> 76348 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 76349 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 76349 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 76350 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 76350 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 76350 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 76351 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 76351 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 76352 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 76352 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 76353 T87 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 76353 T87 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 76354 T87 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 76354 T87 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 76355 T87 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:52387/solr
   [junit4]   2> 76402 T87 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 76403 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 76404 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 76406 T107 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4b3cb3b7 
name:ZooKeeperConnection Watcher:127.0.0.1:52387 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 76407 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 76407 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 76428 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 76430 T109 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@635cf46e 
name:ZooKeeperConnection Watcher:127.0.0.1:52387/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 76430 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 76462 T87 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 76488 T87 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 76502 T87 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 76507 T87 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 76512 T87 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 76544 T87 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 76547 T87 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:52394_sea%2Fwc
   [junit4]   2> 76560 T87 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:52394_sea%2Fwc
   [junit4]   2> 76565 T87 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 76568 T87 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 76571 T87 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 76603 T87 oasc.OverseerElectionContext.runLeaderProcess I am 
going to be the leader 127.0.0.1:52394_sea%2Fwc
   [junit4]   2> 76604 T87 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 76607 T87 oasc.Overseer.start Overseer 
(id=92796262108823555-127.0.0.1:52394_sea%2Fwc-n_0000000000) starting
   [junit4]   2> 76651 T87 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 76693 T87 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 76718 T111 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 76719 T87 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 76723 T87 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 76725 T87 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 76768 T110 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 76795 T113 oasc.ZkController.publish publishing 
core=collection1 state=down collection=control_collection
   [junit4]   2> 76795 T113 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 76817 T113 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 76826 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 76864 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "base_url":"http://127.0.0.1:52394/sea/wc";,
   [junit4]   2>          "shard":null,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "node_name":"127.0.0.1:52394_sea%2Fwc",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down"}
   [junit4]   2> 76864 T110 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection control_collection with shards [shard1]
   [junit4]   2> 76900 T110 oasc.Overseer$ClusterStateUpdater.createCollection 
state version control_collection 1
   [junit4]   2> 76919 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 76944 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 77818 T113 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 77818 T113 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:control_collection
   [junit4]   2> 77819 T113 oasc.ZkController.createCollectionZkNode Collection 
zkNode exists
   [junit4]   2> 77819 T113 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/control_collection
   [junit4]   2> 77821 T113 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 77822 T113 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/collection1/'
   [junit4]   2> 77824 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/collection1/lib/classes/'
 to classloader
   [junit4]   2> 77825 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/collection1/lib/README'
 to classloader
   [junit4]   2> 77825 T113 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 78024 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 78081 T113 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 78083 T113 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 78107 T113 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 78534 T113 oass.IndexSchema.readSchema default search field in 
schema is text
   [junit4]   2> 78538 T113 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 78540 T113 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 78547 T113 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 78600 T113 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection control_collection
   [junit4]   2> 78601 T113 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 78601 T113 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-002/collection1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/control/data/
   [junit4]   2> 78602 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@56c244e1
   [junit4]   2> 78618 T113 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/control/data
   [junit4]   2> 78619 T113 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/control/data/index/
   [junit4]   2> 78619 T113 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/control/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 78621 T113 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/control/data/index
   [junit4]   2> 78621 T113 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=2, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=29.490234375, 
floorSegmentMB=0.4833984375, forceMergeDeletesPctAllowed=4.8675051890866605, 
segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 78627 T113 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/index-SimpleFSDirectory-001
 
lockFactory=org.apache.lucene.store.NativeFSLockFactory@130eff16),segFN=segments_1,generation=1}
   [junit4]   2> 78628 T113 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 78635 T113 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 78636 T113 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 78636 T113 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 78636 T113 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 78637 T113 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 78637 T113 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 78637 T113 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 78638 T113 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 78638 T113 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 78644 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 78645 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 78646 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 78647 T113 oasc.RequestHandlers.initHandlersFromConfig created 
standard: solr.StandardRequestHandler
   [junit4]   2> 78647 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/get: solr.RealTimeGetHandler
   [junit4]   2> 78648 T113 oasc.RequestHandlers.initHandlersFromConfig adding 
lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 78648 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/replication: solr.ReplicationHandler
   [junit4]   2> 78649 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/update: solr.UpdateRequestHandler
   [junit4]   2> 78649 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 78650 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 78651 T113 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 78666 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 78668 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 78669 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 78671 T113 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 78677 T113 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 78677 T113 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 78678 T113 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=27, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=65.0048828125, 
floorSegmentMB=1.6357421875, forceMergeDeletesPctAllowed=22.63027189867615, 
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.6989415891536771
   [junit4]   2> 78681 T113 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/index-SimpleFSDirectory-001
 
lockFactory=org.apache.lucene.store.NativeFSLockFactory@130eff16),segFN=segments_1,generation=1}
   [junit4]   2> 78681 T113 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 78682 T113 oass.SolrIndexSearcher.<init> Opening 
Searcher@64894954[collection1] main
   [junit4]   2> 78682 T113 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/control_collection
   [junit4]   2> 78684 T113 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 78684 T113 oasr.ManagedResourceStorage.newStorageIO Setting up 
ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 78697 T113 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 78697 T113 oasr.RestManager.init Initializing RestManager with 
initArgs: {}
   [junit4]   2> 78698 T113 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 78698 T113 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 78699 T113 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 78700 T113 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 78703 T113 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 78703 T113 oasr.ManagedResourceStorage$JsonStorage.store Saved 
JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 78703 T113 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 78709 T115 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@64894954[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 78721 T113 oasc.CoreContainer.registerCore registering core: 
collection1
   [junit4]   2> 78722 T118 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:52394/sea/wc 
collection:control_collection shard:shard1
   [junit4]   2> 78723 T87 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 78723 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 78761 T118 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 78765 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 78766 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 78769 T120 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@726f539b 
name:ZooKeeperConnection Watcher:127.0.0.1:52387/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 78770 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 78770 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 78773 T87 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 78773 T118 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 78777 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 78778 T118 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 78778 T118 oasc.ShardLeaderElectionContext.runLeaderProcess I 
may be the new leader - try and sync
   [junit4]   2> 78784 T87 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> ASYNC  NEW_CORE C50 name=collection1 
org.apache.solr.core.SolrCore@5fc12f83 
url=http://127.0.0.1:52394/sea/wc/collection1 node=127.0.0.1:52394_sea%2Fwc 
C50_STATE=coll:control_collection core:collection1 props:{core=collection1, 
base_url=http://127.0.0.1:52394/sea/wc, node_name=127.0.0.1:52394_sea%2Fwc, 
state=down}
   [junit4]   2> 78786 T118 C50 P52394 oasc.SyncStrategy.sync Sync replicas to 
http://127.0.0.1:52394/sea/wc/collection1/
   [junit4]   2> 78786 T118 C50 P52394 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 78787 T118 C50 P52394 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:52394/sea/wc/collection1/ has no replicas
   [junit4]   2> 78787 T118 oasc.ShardLeaderElectionContext.runLeaderProcess I 
am the new leader: http://127.0.0.1:52394/sea/wc/collection1/ shard1
   [junit4]   2> 78791 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 78792 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 78808 T118 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 78817 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 78928 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 78928 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 78971 T118 oasc.ZkController.register We are 
http://127.0.0.1:52394/sea/wc/collection1/ and leader is 
http://127.0.0.1:52394/sea/wc/collection1/
   [junit4]   2> 78972 T118 oasc.ZkController.register No LogReplay needed for 
core=collection1 baseURL=http://127.0.0.1:52394/sea/wc
   [junit4]   2> 78972 T118 oasc.ZkController.checkRecovery I am the leader, no 
recovery necessary
   [junit4]   2> 78972 T118 oasc.ZkController.publish publishing 
core=collection1 state=active collection=control_collection
   [junit4]   2> 78972 T118 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 78975 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 78982 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "base_url":"http://127.0.0.1:52394/sea/wc";,
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "node_name":"127.0.0.1:52394_sea%2Fwc",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"active"}
   [junit4]   2> 79089 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 79089 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 80029 T87 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 80035 T87 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 80038 T87 oejs.AbstractConnector.doStart Started 
[email protected]:52404
   [junit4]   2> 80039 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 80039 T87 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 80039 T87 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003
   [junit4]   2> 80040 T87 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/'
   [junit4]   2> 80087 T87 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/solr.xml
   [junit4]   2> 80172 T87 oasc.CoreContainer.<init> New CoreContainer 
1989347316
   [junit4]   2> 80172 T87 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/]
   [junit4]   2> 80173 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 80174 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 80174 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 80174 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 80175 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 80175 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 80175 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 80175 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 80176 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 80176 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 80176 T87 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 80177 T87 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 80177 T87 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 80177 T87 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 80178 T87 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:52387/solr
   [junit4]   2> 80178 T87 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 80178 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 80179 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 80181 T132 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2eef60fd 
name:ZooKeeperConnection Watcher:127.0.0.1:52387 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 80182 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 80182 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 80185 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 80186 T134 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7d237c08 
name:ZooKeeperConnection Watcher:127.0.0.1:52387/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 80187 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 80195 T87 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 81200 T87 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:52404_sea%2Fwc
   [junit4]   2> 81202 T87 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:52404_sea%2Fwc
   [junit4]   2> 81208 T87 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 81224 T136 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 81224 T136 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 81226 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 81226 T136 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 81231 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:52404/sea/wc";,
   [junit4]   2>          "shard":null,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "node_name":"127.0.0.1:52404_sea%2Fwc",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down"}
   [junit4]   2> 81231 T110 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 81231 T110 oasc.Overseer$ClusterStateUpdater.createCollection 
state version collection1 1
   [junit4]   2> 81232 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard2
   [junit4]   2> 81237 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 81237 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 81237 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 82227 T136 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 82228 T136 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:collection1
   [junit4]   2> 82229 T136 oasc.ZkController.createCollectionZkNode Collection 
zkNode exists
   [junit4]   2> 82229 T136 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/collection1
   [junit4]   2> 82231 T136 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 82231 T136 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/collection1/'
   [junit4]   2> 82233 T136 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 82234 T136 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/collection1/lib/classes/'
 to classloader
   [junit4]   2> 82235 T136 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/collection1/lib/README'
 to classloader
   [junit4]   2> 82309 T136 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 82363 T136 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 82366 T136 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 82387 T136 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 82784 T136 oass.IndexSchema.readSchema default search field in 
schema is text
   [junit4]   2> 82787 T136 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 82789 T136 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 82795 T136 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 82835 T136 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 82836 T136 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 82836 T136 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-003/collection1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty1/
   [junit4]   2> 82836 T136 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@56c244e1
   [junit4]   2> 82837 T136 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty1
   [junit4]   2> 82838 T136 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty1/index/
   [junit4]   2> 82838 T136 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty1/index'
 doesn't exist. Creating new index...
   [junit4]   2> 82840 T136 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty1/index
   [junit4]   2> 82841 T136 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=2, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=29.490234375, 
floorSegmentMB=0.4833984375, forceMergeDeletesPctAllowed=4.8675051890866605, 
segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 82847 T136 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/index-SimpleFSDirectory-002
 
lockFactory=org.apache.lucene.store.NativeFSLockFactory@130eff16),segFN=segments_1,generation=1}
   [junit4]   2> 82848 T136 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 82860 T136 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 82861 T136 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 82861 T136 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 82862 T136 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 82862 T136 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 82862 T136 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 82863 T136 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 82863 T136 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 82863 T136 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 82866 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 82867 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 82869 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 82871 T136 oasc.RequestHandlers.initHandlersFromConfig created 
standard: solr.StandardRequestHandler
   [junit4]   2> 82872 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/get: solr.RealTimeGetHandler
   [junit4]   2> 82873 T136 oasc.RequestHandlers.initHandlersFromConfig adding 
lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 82873 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/replication: solr.ReplicationHandler
   [junit4]   2> 82875 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/update: solr.UpdateRequestHandler
   [junit4]   2> 82876 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 82877 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 82879 T136 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 82898 T136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 82900 T136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 82902 T136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 82904 T136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 82909 T136 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 82909 T136 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 82912 T136 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=27, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=65.0048828125, 
floorSegmentMB=1.6357421875, forceMergeDeletesPctAllowed=22.63027189867615, 
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.6989415891536771
   [junit4]   2> 82915 T136 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/index-SimpleFSDirectory-002
 
lockFactory=org.apache.lucene.store.NativeFSLockFactory@130eff16),segFN=segments_1,generation=1}
   [junit4]   2> 82915 T136 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 82916 T136 oass.SolrIndexSearcher.<init> Opening 
Searcher@dad2271[collection1] main
   [junit4]   2> 82916 T136 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/collection1
   [junit4]   2> 82918 T136 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 82918 T136 oasr.ManagedResourceStorage.newStorageIO Setting up 
ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 82919 T136 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 82919 T136 oasr.RestManager.init Initializing RestManager with 
initArgs: {}
   [junit4]   2> 82919 T136 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 82921 T136 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 82921 T136 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 82921 T136 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 82922 T136 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 82936 T137 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@dad2271[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 82945 T136 oasc.CoreContainer.registerCore registering core: 
collection1
   [junit4]   2> 82946 T140 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:52404/sea/wc collection:collection1 
shard:shard2
   [junit4]   2> 82947 T87 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 82948 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 82948 T140 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 82955 T140 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard2
   [junit4]   2> 82957 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 82958 T140 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 82958 T140 oasc.ShardLeaderElectionContext.runLeaderProcess I 
may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C51 name=collection1 
org.apache.solr.core.SolrCore@3963f7b 
url=http://127.0.0.1:52404/sea/wc/collection1 node=127.0.0.1:52404_sea%2Fwc 
C51_STATE=coll:collection1 core:collection1 props:{core=collection1, 
base_url=http://127.0.0.1:52404/sea/wc, node_name=127.0.0.1:52404_sea%2Fwc, 
state=down}
   [junit4]   2> 82958 T140 C51 P52404 oasc.SyncStrategy.sync Sync replicas to 
http://127.0.0.1:52404/sea/wc/collection1/
   [junit4]   2> 82959 T140 C51 P52404 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 82959 T140 C51 P52404 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:52404/sea/wc/collection1/ has no replicas
   [junit4]   2> 82960 T140 oasc.ShardLeaderElectionContext.runLeaderProcess I 
am the new leader: http://127.0.0.1:52404/sea/wc/collection1/ shard2
   [junit4]   2> 82960 T140 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard2
   [junit4]   2> 82965 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 82965 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 82965 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 82981 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 82985 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 82985 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 82986 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 83018 T140 oasc.ZkController.register We are 
http://127.0.0.1:52404/sea/wc/collection1/ and leader is 
http://127.0.0.1:52404/sea/wc/collection1/
   [junit4]   2> 83019 T140 oasc.ZkController.register No LogReplay needed for 
core=collection1 baseURL=http://127.0.0.1:52404/sea/wc
   [junit4]   2> 83019 T140 oasc.ZkController.checkRecovery I am the leader, no 
recovery necessary
   [junit4]   2> 83020 T140 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 83020 T140 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 83023 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 83030 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:52404/sea/wc";,
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "node_name":"127.0.0.1:52404_sea%2Fwc",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"active"}
   [junit4]   2> 83137 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 83137 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 83137 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 84161 T87 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 84162 T87 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 84164 T87 oejs.AbstractConnector.doStart Started 
[email protected]:52407
   [junit4]   2> 84165 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 84165 T87 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 84165 T87 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004
   [junit4]   2> 84166 T87 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/'
   [junit4]   2> 84196 T87 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/solr.xml
   [junit4]   2> 84256 T87 oasc.CoreContainer.<init> New CoreContainer 374324116
   [junit4]   2> 84256 T87 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/]
   [junit4]   2> 84257 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 84258 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 84258 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 84258 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 84258 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 84259 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 84259 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 84259 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 84259 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 84260 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 84260 T87 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 84261 T87 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 84261 T87 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 84261 T87 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 84261 T87 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:52387/solr
   [junit4]   2> 84262 T87 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 84262 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 84263 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 84265 T151 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4ca3fcfd 
name:ZooKeeperConnection Watcher:127.0.0.1:52387 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 84265 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 84265 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 84267 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 84269 T153 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4e193d70 
name:ZooKeeperConnection Watcher:127.0.0.1:52387/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 84269 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 84276 T87 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 85281 T87 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:52407_sea%2Fwc
   [junit4]   2> 85283 T87 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:52407_sea%2Fwc
   [junit4]   2> 85289 T87 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 85298 T155 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 85299 T155 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 85300 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 85300 T155 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 85305 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:52407/sea/wc";,
   [junit4]   2>          "shard":null,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "node_name":"127.0.0.1:52407_sea%2Fwc",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"down"}
   [junit4]   2> 85305 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=3
   [junit4]   2> 85306 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 85310 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 85310 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 85310 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 85310 T154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 86301 T155 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 86302 T155 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:collection1
   [junit4]   2> 86303 T155 oasc.ZkController.createCollectionZkNode Collection 
zkNode exists
   [junit4]   2> 86303 T155 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/collection1
   [junit4]   2> 86305 T155 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 86305 T155 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/collection1/'
   [junit4]   2> 86308 T155 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 86308 T155 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/collection1/lib/README'
 to classloader
   [junit4]   2> 86309 T155 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/collection1/lib/classes/'
 to classloader
   [junit4]   2> 86382 T155 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 86436 T155 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 86454 T155 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 86473 T155 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 86858 T155 oass.IndexSchema.readSchema default search field in 
schema is text
   [junit4]   2> 86861 T155 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 86863 T155 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 86870 T155 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 86915 T155 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 86915 T155 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 86915 T155 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-004/collection1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty2/
   [junit4]   2> 86916 T155 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@56c244e1
   [junit4]   2> 86917 T155 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty2
   [junit4]   2> 86917 T155 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty2/index/
   [junit4]   2> 86918 T155 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty2/index'
 doesn't exist. Creating new index...
   [junit4]   2> 86920 T155 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-001/jetty2/index
   [junit4]   2> 86921 T155 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=2, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=29.490234375, 
floorSegmentMB=0.4833984375, forceMergeDeletesPctAllowed=4.8675051890866605, 
segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 86926 T155 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/index-SimpleFSDirectory-003
 
lockFactory=org.apache.lucene.store.NativeFSLockFactory@130eff16),segFN=segments_1,generation=1}
   [junit4]   2> 86927 T155 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 86940 T155 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 86941 T155 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 86942 T155 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 86942 T155 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 86942 T155 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 86942 T155 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 86943 T155 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 86944 T155 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 86944 T155 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 86946 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 86947 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 86949 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 86951 T155 oasc.RequestHandlers.initHandlersFromConfig created 
standard: solr.StandardRequestHandler
   [junit4]   2> 86952 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/get: solr.RealTimeGetHandler
   [junit4]   2> 86952 T155 oasc.RequestHandlers.initHandlersFromConfig adding 
lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 86953 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/replication: solr.ReplicationHandler
   [junit4]   2> 86954 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/update: solr.UpdateRequestHandler
   [junit4]   2> 86955 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 86957 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 86958 T155 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 86977 T155 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 86979 T155 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 86981 T155 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 86983 T155 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 86990 T155 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 86991 T155 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 86993 T155 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=27, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=65.0048828125, 
floorSegmentMB=1.6357421875, forceMergeDeletesPctAllowed=22.63027189867615, 
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.6989415891536771
   [junit4]   2> 86997 T155 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/index-SimpleFSDirectory-003
 
lockFactory=org.apache.lucene.store.NativeFSLockFactory@130eff16),segFN=segments_1,generation=1}
   [junit4]   2> 86997 T155 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 86997 T155 oass.SolrIndexSearcher.<init> Opening 
Searcher@1f4ebc6e[collection1] main
   [junit4]   2> 86998 T155 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/collection1
   [junit4]   2> 87000 T155 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 87000 T155 oasr.ManagedResourceStorage.newStorageIO Setting up 
ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 87001 T155 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 87001 T155 oasr.RestManager.init Initializing RestManager with 
initArgs: {}
   [junit4]   2> 87001 T155 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 87003 T155 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 87003 T155 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 87004 T155 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 87004 T155 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 87013 T156 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@1f4ebc6e[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 87024 T155 oasc.CoreContainer.registerCore registering core: 
collection1
   [junit4]   2> 87025 T159 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:52407/sea/wc collection:collection1 
shard:shard1
   [junit4]   2> 87026 T87 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 87027 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 87027 T159 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 87035 T159 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 87038 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 87039 T159 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 87039 T159 oasc.ShardLeaderElectionContext.runLeaderProcess I 
may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C52 name=collection1 
org.apache.solr.core.SolrCore@298d7d87 
url=http://127.0.0.1:52407/sea/wc/collection1 node=127.0.0.1:52407_sea%2Fwc 
C52_STATE=coll:collection1 core:collection1 props:{core=collection1, 
base_url=http://127.0.0.1:52407/sea/wc, node_name=127.0.0.1:52407_sea%2Fwc, 
state=down}
   [junit4]   2> 87040 T159 C52 P52407 oasc.SyncStrategy.sync Sync replicas to 
http://127.0.0.1:52407/sea/wc/collection1/
   [junit4]   2> 87040 T159 C52 P52407 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 87040 T159 C52 P52407 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:52407/sea/wc/collection1/ has no replicas
   [junit4]   2> 87041 T159 oasc.ShardLeaderElectionContext.runLeaderProcess I 
am the new leader: http://127.0.0.1:52407/sea/wc/collection1/ shard1
   [junit4]   2> 87041 T159 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 87049 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87049 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87049 T154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87049 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87063 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 87065 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87065 T154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87065 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87065 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87100 T159 oasc.ZkController.register We are 
http://127.0.0.1:52407/sea/wc/collection1/ and leader is 
http://127.0.0.1:52407/sea/wc/collection1/
   [junit4]   2> 87101 T159 oasc.ZkController.register No LogReplay needed for 
core=collection1 baseURL=http://127.0.0.1:52407/sea/wc
   [junit4]   2> 87101 T159 oasc.ZkController.checkRecovery I am the leader, no 
recovery necessary
   [junit4]   2> 87101 T159 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 87102 T159 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 87104 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 87109 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:52407/sea/wc";,
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "node_name":"127.0.0.1:52407_sea%2Fwc",
   [junit4]   2>          "core_node_name":"core_node2",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "state":"active"}
   [junit4]   2> 87214 T135 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87214 T114 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87214 T121 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 87214 T154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 88237 T87 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 88238 T87 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 88240 T87 oejs.AbstractConnector.doStart Started 
[email protected]:52410
   [junit4]   2> 88241 T87 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 88241 T87 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 88241 T87 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-005
   [junit4]   2> 88242 T87 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-005/'
   [junit4]   2> 88272 T87 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-005/solr.xml
   [junit4]   2> 88330 T87 oasc.CoreContainer.<init> New CoreContainer 238007912
   [junit4]   2> 88331 T87 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest-C412F994C135E7A4-001/tempDir-005/]
   [junit4]   2> 88332 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 88332 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 88332 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 88333 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 88333 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnections to: 10000
   [junit4]   2> 88333 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 88333 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 88334 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 88334 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 88334 T87 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 88335 T87 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 88335 T87 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 88335 T87 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 88336 T87 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 88336 T87 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:52387/solr
   [junit4]   2> 88336 T87 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 88337 T87 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 88337 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 88339 T170 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5e706d1e 
name:ZooKeeperConnection Watcher:127.0.0.1:52387 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 88340 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 88340 T87 oascc.SolrZkClient.createZkACLProvider Using default 
ZkACLProvider
   [junit4]   2> 88343 T87 oascc.ConnectionManager.waitForConnected Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 88345 T172 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7c7ce4a6 
name:ZooKeeperConnection Watcher:127.0.0.1:52387/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 88345 T87 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 88353 T87 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 89359 T87 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:52410_sea%2Fwc
   [junit4]   2> 89361 T87 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:52410_sea%2Fwc
   [junit4]   2> 89366 T87 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 89376 T174 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 89376 T174 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 89378 T114 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 89378 T174 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 89382 T110 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:52410

[...truncated too long message...]

adPoolExecutor.java:615)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>          64) Thread[id=5648, name=zkCallback-227-thread-114, 
state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>                at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]   2>                at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>                at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]   2>                at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>          65) Thread[id=3746, 
name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[C412F994C135E7A4]-SendThread(127.0.0.1:10866),
 state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at sun.nio.ch.IOUtil.drain(Native Method)
   [junit4]   2>                at 
sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
   [junit4]   2>                at 
sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
   [junit4]   2>                at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2>                at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2>          66) Thread[id=3854, name=Thread-2271, state=WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at java.lang.Object.wait(Native Method)
   [junit4]   2>                at java.lang.Object.wait(Object.java:503)
   [junit4]   2>                at 
org.apache.solr.core.CloserThread.run(CoreContainer.java:923)
   [junit4]   2>          67) Thread[id=3661, 
name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[C412F994C135E7A4]-SendThread(127.0.0.1:10866),
 state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at sun.nio.ch.KQueueArrayWrapper.kevent0(Native 
Method)
   [junit4]   2>                at 
sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200)
   [junit4]   2>                at 
sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
   [junit4]   2>                at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2>                at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2>          68) Thread[id=3685, name=Thread-2188, state=WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at java.lang.Object.wait(Native Method)
   [junit4]   2>                at java.lang.Object.wait(Object.java:503)
   [junit4]   2>                at 
org.apache.solr.core.CloserThread.run(CoreContainer.java:923)
   [junit4]   2>          69) Thread[id=3665, 
name=searcherExecutor-1044-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>                at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2>                at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2>                at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>          70) Thread[id=3711, name=qtp1989185045-3711 Acceptor0 
[email protected]:10920, state=RUNNABLE, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at java.net.PlainSocketImpl.socketAccept(Native 
Method)
   [junit4]   2>                at 
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
   [junit4]   2>                at 
java.net.ServerSocket.implAccept(ServerSocket.java:530)
   [junit4]   2>                at 
sun.security.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:317)
   [junit4]   2>                at 
org.eclipse.jetty.server.ssl.SslSocketConnector.accept(SslSocketConnector.java:108)
   [junit4]   2>                at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
   [junit4]   2>                at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2>                at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>          71) Thread[id=3760, name=HashSessionScavenger-45, 
state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at java.lang.Object.wait(Native Method)
   [junit4]   2>                at 
java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2>                at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): 
{id=PostingsFormat(name=LuceneVarGapFixedInterval), 
_version_=PostingsFormat(name=LuceneFixedGap), 
a_t=PostingsFormat(name=LuceneFixedGap), 
rnd_b=PostingsFormat(name=LuceneVarGapFixedInterval), 
a_i=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, 
sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_JO, 
timezone=Pacific/Majuro
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=73,free=275094872,total=457179136
   [junit4]   2> NOTE: All tests run in this JVM: [TestTolerantSearch, 
PrimitiveFieldTypeTest, TestQuerySenderNoQuery, URLClassifyProcessorTest, 
NoCacheHeaderTest, TestStressVersions, FullSolrCloudDistribCmdsTest, 
TestFastOutputStream, TestMaxScoreQueryParser, TestBlendedInfixSuggestions, 
ShowFileRequestHandlerTest, DistributedFacetPivotSmallTest, EnumFieldTest, 
DebugComponentTest, ExternalFileFieldSortTest, BasicZkTest, 
CloudMLTQParserTest, DistribDocExpirationUpdateProcessorTest, 
PreAnalyzedFieldTest, DocumentBuilderTest, SpatialFilterTest, 
TestCollapseQParserPlugin, TestReloadAndDeleteDocs, TestClassNameShortening, 
TestReplicaProperties, TestComponentsName, TestDocumentBuilder, 
TestHighFrequencyDictionaryFactory, SolrCoreCheckLockOnStartupTest, 
TestSystemIdResolver, TestCollationField, SuggesterFSTTest, 
OpenCloseCoreStressTest, HdfsWriteToMultipleCollectionsTest, TestReload, 
TestDocBasedVersionConstraints, TestDefaultSearchFieldResource, TestLFUCache, 
TestOverriddenPrefixQueryForCustomFieldType, RequiredFieldsTest, 
TestConfigSets, VMParamsZkACLAndCredentialsProvidersTest, 
CoreAdminCreateDiscoverTest, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=C412F994C135E7A4 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=ar_JO -Dtests.timezone=Pacific/Majuro -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([C412F994C135E7A4]:0)
   [junit4] Completed on J1 in 7224.56s, 1 test, 2 errors <<< FAILURES!

[...truncated 44 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:532:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:473:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:508:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1359:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:966:
 There were test failures: 444 suites, 1818 tests, 1 suite-level error, 2 
errors, 111 ignored (9 assumptions)

Total time: 296 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #667
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 878440920 bytes
Compression is 0.0%
Took 2 min 36 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to