Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4394/
Java: 32bit/jdk1.7.0_67 -server -XX:+UseSerialGC

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([37808CEB4DB8BA4]:0)


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([37808CEB4DB8BA4]:0)




Build Log:
[...truncated 11007 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\init-core-data-001
   [junit4]   2> 2622065 T6263 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (false)
   [junit4]   2> 2622065 T6263 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /
   [junit4]   2> 2622073 T6263 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 2622073 T6263 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2622076 T6264 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 2622184 T6263 oasc.ZkTestServer.run start zk server on 
port:65090
   [junit4]   2> 2622184 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2622187 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2622193 T6270 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@db8a72 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2622193 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2622193 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2622193 T6263 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2622202 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2622205 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2622211 T6272 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@663558 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2622212 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2622212 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2622212 T6263 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 2622216 T6263 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 2622219 T6263 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 2622221 T6263 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 2622224 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 2622224 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 2622231 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 2622231 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 2622235 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2622235 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2622239 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 2622239 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 2622243 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 2622243 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 2622248 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 2622248 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 2622252 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2622252 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 2622255 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2622255 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 2622259 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2622259 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2622263 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2622263 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 2622268 T6263 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 2622268 T6263 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 2622273 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2622275 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2622299 T6274 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@10277cb name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2622300 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2622300 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2624152 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2624162 T6263 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2624166 T6263 oejs.AbstractConnector.doStart Started 
[email protected]:65100
   [junit4]   2> 2624168 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 2624168 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 2624168 T6263 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002
   [junit4]   2> 2624168 T6263 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\'
   [junit4]   2> 2624204 T6263 oasc.ConfigSolr.fromFile Loading container 
configuration from 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\solr.xml
   [junit4]   2> 2624267 T6263 oasc.CoreContainer.<init> New CoreContainer 
3379680
   [junit4]   2> 2624267 T6263 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\]
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2624271 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 2624271 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 2624271 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 2624274 T6263 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2624277 T6263 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2624277 T6263 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2624277 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2624277 T6263 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:65090/solr
   [junit4]   2> 2624277 T6263 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 2624281 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2624282 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2624284 T6285 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@109ab15 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2624285 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2624285 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2624289 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2624291 T6287 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@727f16 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2624291 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2624293 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 2624298 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 2624306 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 2624312 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 2624318 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 2624328 T6263 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2624331 T6263 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65100_
   [junit4]   2> 2624333 T6263 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:65100_
   [junit4]   2> 2624341 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 2624345 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 2624350 T6263 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2624354 T6263 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:65100_
   [junit4]   2> 2624354 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 2624360 T6263 oasc.Overseer.start Overseer 
(id=92695023255486468-127.0.0.1:65100_-n_0000000000) starting
   [junit4]   2> 2624366 T6263 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 2624388 T6263 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2624389 T6289 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 2624391 T6263 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 2624400 T6263 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 2624404 T6263 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2624412 T6288 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 2624423 T6291 oasc.ZkController.publish publishing 
core=collection1 state=down collection=control_collection
   [junit4]   2> 2624423 T6291 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 2624425 T6291 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 2624425 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2624435 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "node_name":"127.0.0.1:65100_",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "base_url":"https://127.0.0.1:65100";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"collection1"}
   [junit4]   2> 2624435 T6288 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
control_collection with shards [shard1]
   [junit4]   2> 2624436 T6288 
oasc.Overseer$ClusterStateUpdater.createCollection state version 
control_collection 1
   [junit4]   2> 2624436 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 2624442 T6292 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2625503 T6291 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 2625503 T6291 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:control_collection
   [junit4]   2> 2625505 T6291 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 2625505 T6291 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 2625509 T6291 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 2625510 T6291 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\collection1\'
   [junit4]   2> 2625518 T6291 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-002/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 2625522 T6291 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-002/collection1/lib/classes/'
 to classloader
   [junit4]   2> 2625524 T6291 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-002/collection1/lib/README'
 to classloader
   [junit4]   2> 2625603 T3 oasc.CoreContainer.finalize ERROR CoreContainer was 
not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  
instance=30126192
   [junit4]   2> 2625610 T6291 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 2625658 T6291 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 2625660 T6291 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 2625676 T6291 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 2626042 T6291 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 2626057 T6291 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2626058 T6291 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 2626064 T6291 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 2626105 T6291 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection control_collection
   [junit4]   2> 2626105 T6291 oasc.SolrCore.initDirectoryFactory 
solr.StandardDirectoryFactory
   [junit4]   2> 2626106 T6291 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\collection1\,
 
dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/control/data\
   [junit4]   2> 2626106 T6291 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@12c8a22
   [junit4]   2> 2626110 T6291 oasc.CachingDirectoryFactory.get return new 
directory for 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data
   [junit4]   2> 2626111 T6291 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/control/data\index/
   [junit4]   2> 2626112 T6291 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index'
 doesn't exist. Creating new index...
   [junit4]   2> 2626115 T6291 oasc.CachingDirectoryFactory.get return new 
directory for 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index
   [junit4]   2> 2626116 T6291 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2626135 T6291 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2626135 T6291 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 2626140 T6291 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2626141 T6291 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 2626141 T6291 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2626141 T6291 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2626142 T6291 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2626142 T6291 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2626142 T6291 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2626143 T6291 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 2626143 T6291 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2626143 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2626145 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2626145 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 2626147 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 2626147 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2626148 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2626148 T6291 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2626158 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2626159 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2626161 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2626163 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2626168 T6291 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 2626168 T6291 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 2626169 T6291 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7834408184952782]
   [junit4]   2> 2626169 T6291 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2626169 T6291 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 2626171 T6291 oass.SolrIndexSearcher.<init> Opening 
Searcher@556126[collection1] main
   [junit4]   2> 2626171 T6291 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 2626173 T6291 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 2626173 T6291 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2626175 T6291 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2626175 T6291 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 2626175 T6291 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2626176 T6291 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2626176 T6291 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2626177 T6291 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 2626181 T6291 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2626181 T6291 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2626182 T6291 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 2626184 T6293 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@556126[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2626186 T6291 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 2626188 T6296 oasc.ZkController.register Register replica - 
core:collection1 address:https://127.0.0.1:65100 collection:control_collection 
shard:shard1
   [junit4]   2> 2626189 T6263 oass.SolrDispatchFilter.init 
user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2626189 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 2626192 T6296 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2626200 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2626202 T6296 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 2626203 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2626205 T6298 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c065e9 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2626206 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2626206 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2626207 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2626208 T6263 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2626209 T6296 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 2626209 T6296 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C7709 name=collection1 
org.apache.solr.core.SolrCore@164abc5 url=https://127.0.0.1:65100/collection1 
node=127.0.0.1:65100_ C7709_STATE=coll:control_collection core:collection1 
props:{node_name=127.0.0.1:65100_, base_url=https://127.0.0.1:65100, 
state=down, core=collection1}
   [junit4]   2> 2626209 T6296 C7709 P65100 oasc.SyncStrategy.sync Sync 
replicas to https://127.0.0.1:65100/collection1/
   [junit4]   2> 2626209 T6296 C7709 P65100 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 2626210 T6296 C7709 P65100 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:65100/collection1/ has no replicas
   [junit4]   2> 2626210 T6296 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: https://127.0.0.1:65100/collection1/ shard1
   [junit4]   2> 2626210 T6296 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 2626217 T6263 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 2626218 T6263 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 2626218 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2626221 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2626223 T6300 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c07731 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2626223 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2626223 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2626224 T6292 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2626226 T6301 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2626245 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2626246 T6288 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
collection1
   [junit4]   2> 2626246 T6288 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 2626246 T6288 
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 2626250 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 2626252 T6292 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2626252 T6301 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2626282 T6296 oasc.ZkController.register We are 
https://127.0.0.1:65100/collection1/ and leader is 
https://127.0.0.1:65100/collection1/
   [junit4]   2> 2626282 T6296 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=https://127.0.0.1:65100
   [junit4]   2> 2626282 T6296 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 2626282 T6296 oasc.ZkController.publish publishing 
core=collection1 state=active collection=control_collection
   [junit4]   2> 2626282 T6296 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 2626284 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2626292 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "node_name":"127.0.0.1:65100_",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "base_url":"https://127.0.0.1:65100";,
   [junit4]   2>          "state":"active",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"collection1"}
   [junit4]   2> 2626406 T6301 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2626407 T6292 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2627989 T6263 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 2627990 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2627999 T6263 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2628002 T6263 oejs.AbstractConnector.doStart Started 
[email protected]:65115
   [junit4]   2> 2628007 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 2628008 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 2628008 T6263 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003
   [junit4]   2> 2628008 T6263 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\'
   [junit4]   2> 2628043 T6263 oasc.ConfigSolr.fromFile Loading container 
configuration from 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\solr.xml
   [junit4]   2> 2628104 T6263 oasc.CoreContainer.<init> New CoreContainer 
18447405
   [junit4]   2> 2628105 T6263 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\]
   [junit4]   2> 2628106 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 2628106 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 2628107 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 2628107 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2628107 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 2628108 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 2628108 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2628108 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 2628109 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 2628109 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 2628112 T6263 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2628115 T6263 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2628115 T6263 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2628116 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2628116 T6263 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:65090/solr
   [junit4]   2> 2628116 T6263 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 2628117 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2628119 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2628120 T6312 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@a47897 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2628121 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2628121 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2628125 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2628127 T6314 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@b0cdd5 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2628127 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2628141 T6263 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2629152 T6263 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65115_
   [junit4]   2> 2629155 T6263 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:65115_
   [junit4]   2> 2629172 T6263 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2629187 T6316 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 2629187 T6316 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 2629190 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2629191 T6316 oasc.ZkController.preRegister Registering watch 
for external collection collection1
   [junit4]   2> 2629191 T6316 oascc.ZkStateReader.addZkWatch addZkWatch 
collection1
   [junit4]   2> 2629192 T6316 oascc.ZkStateReader.addZkWatch Updating 
collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 2629195 T6316 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 0 
   [junit4]   2> 2629195 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "node_name":"127.0.0.1:65115_",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "base_url":"https://127.0.0.1:65115";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"collection1"}
   [junit4]   2> 2629195 T6316 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 2629202 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=2
   [junit4]   2> 2629204 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard2
   [junit4]   2> 2629214 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2629215 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2629216 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 1 
   [junit4]   2> 2630196 T6316 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 2630196 T6316 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 2630198 T6316 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 2630198 T6316 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 2630203 T6316 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 2630203 T6316 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\collection1\'
   [junit4]   2> 2630209 T6316 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-003/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 2630212 T6316 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-003/collection1/lib/classes/'
 to classloader
   [junit4]   2> 2630214 T6316 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-003/collection1/lib/README'
 to classloader
   [junit4]   2> 2630280 T6316 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 2630359 T6316 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 2630363 T6316 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 2630376 T6316 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 2630719 T6316 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 2630725 T6316 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2630727 T6316 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 2630732 T6316 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 2630760 T6316 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 2630760 T6316 oasc.SolrCore.initDirectoryFactory 
solr.StandardDirectoryFactory
   [junit4]   2> 2630761 T6316 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\collection1\,
 
dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty1\
   [junit4]   2> 2630761 T6316 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@12c8a22
   [junit4]   2> 2630763 T6316 oasc.CachingDirectoryFactory.get return new 
directory for 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1
   [junit4]   2> 2630764 T6316 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty1\index/
   [junit4]   2> 2630765 T6316 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index'
 doesn't exist. Creating new index...
   [junit4]   2> 2630766 T6316 oasc.CachingDirectoryFactory.get return new 
directory for 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index
   [junit4]   2> 2630767 T6316 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2630770 T6316 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2630770 T6316 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 2630775 T6316 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2630777 T6316 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2630777 T6316 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2630777 T6316 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 2630777 T6316 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2630778 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2630778 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2630779 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2630779 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 2630780 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 2630780 T6316 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2630780 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 2630781 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 2630781 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2630781 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2630782 T6316 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2630791 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2630792 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2630794 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2630797 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2630799 T6316 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 2630799 T6316 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 2630801 T6316 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7834408184952782]
   [junit4]   2> 2630802 T6316 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2630802 T6316 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 2630803 T6316 oass.SolrIndexSearcher.<init> Opening 
Searcher@abb9b1[collection1] main
   [junit4]   2> 2630803 T6316 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 2630805 T6316 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 2630805 T6316 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2630806 T6316 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2630806 T6316 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 2630806 T6316 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2630808 T6316 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2630808 T6316 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2630808 T6316 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 2630808 T6316 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 2630814 T6316 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 2630814 T6317 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@abb9b1[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2630817 T6320 oasc.ZkController.register Register replica - 
core:collection1 address:https://127.0.0.1:65115 collection:collection1 
shard:shard2
   [junit4]   2> 2630819 T6263 oass.SolrDispatchFilter.init 
user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2630819 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 2630832 T6320 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 2631031 T6320 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard2
   [junit4]   2> 2631034 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2631035 T6320 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 2631035 T6320 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C7710 name=collection1 
org.apache.solr.core.SolrCore@db84e4 url=https://127.0.0.1:65115/collection1 
node=127.0.0.1:65115_ C7710_STATE=coll:collection1 core:collection1 
props:{node_name=127.0.0.1:65115_, base_url=https://127.0.0.1:65115, 
state=down, core=collection1}
   [junit4]   2> 2631035 T6320 C7710 P65115 oasc.SyncStrategy.sync Sync 
replicas to https://127.0.0.1:65115/collection1/
   [junit4]   2> 2631035 T6320 C7710 P65115 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 2631035 T6320 C7710 P65115 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:65115/collection1/ has no replicas
   [junit4]   2> 2631035 T6320 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: https://127.0.0.1:65115/collection1/ shard2
   [junit4]   2> 2631037 T6320 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard2
   [junit4]   2> 2631053 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2631054 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2631056 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 2 
   [junit4]   2> 2631067 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2631068 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2631069 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2631071 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 3 
   [junit4]   2> 2631103 T6320 oasc.ZkController.register We are 
https://127.0.0.1:65115/collection1/ and leader is 
https://127.0.0.1:65115/collection1/
   [junit4]   2> 2631103 T6320 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=https://127.0.0.1:65115
   [junit4]   2> 2631103 T6320 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 2631103 T6320 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 2631103 T6320 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 2631105 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2631111 T6320 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 3 
   [junit4]   2> 2631112 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "node_name":"127.0.0.1:65115_",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "base_url":"https://127.0.0.1:65115";,
   [junit4]   2>          "state":"active",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"collection1"}
   [junit4]   2> 2631119 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2631121 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2631122 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 4 
   [junit4]   2> 2632426 T6263 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 2632427 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2632435 T6263 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2632438 T6263 oejs.AbstractConnector.doStart Started 
[email protected]:65124
   [junit4]   2> 2632444 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 2632445 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 2632445 T6263 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004
   [junit4]   2> 2632446 T6263 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\'
   [junit4]   2> 2632475 T6263 oasc.ConfigSolr.fromFile Loading container 
configuration from 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\solr.xml
   [junit4]   2> 2632536 T6263 oasc.CoreContainer.<init> New CoreContainer 
6003137
   [junit4]   2> 2632536 T6263 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\]
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2632540 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 2632540 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 2632540 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 2632543 T6263 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2632546 T6263 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2632546 T6263 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2632546 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2632546 T6263 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:65090/solr
   [junit4]   2> 2632546 T6263 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 2632548 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2632550 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2632551 T6331 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4b1fb4 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2632552 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2632552 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2632555 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2632558 T6333 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@c5f5ec name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2632559 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2632569 T6263 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2633581 T6263 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65124_
   [junit4]   2> 2633583 T6263 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:65124_
   [junit4]   2> 2633603 T6263 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2633619 T6335 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 2633619 T6335 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 2633622 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2633624 T6335 oasc.ZkController.preRegister Registering watch 
for external collection collection1
   [junit4]   2> 2633624 T6335 oascc.ZkStateReader.addZkWatch addZkWatch 
collection1
   [junit4]   2> 2633625 T6335 oascc.ZkStateReader.addZkWatch Updating 
collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 2633628 T6335 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 4 
   [junit4]   2> 2633628 T6335 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 2633630 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "node_name":"127.0.0.1:65124_",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "base_url":"https://127.0.0.1:65124";,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"collection1"}
   [junit4]   2> 2633636 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=2
   [junit4]   2> 2633638 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 2633648 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2633650 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2633650 T6334 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2633652 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 5 
   [junit4]   2> 2633652 T6334 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 5 
   [junit4]   2> 2634628 T6335 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 2634628 T6335 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 2634630 T6335 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 2634631 T6335 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 2634633 T6335 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 2634634 T6335 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\collection1\'
   [junit4]   2> 2634641 T6335 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-004/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 2634643 T6335 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-004/collection1/lib/classes/'
 to classloader
   [junit4]   2> 2634644 T6335 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-004/collection1/lib/README'
 to classloader
   [junit4]   2> 2634723 T6335 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 2634767 T6335 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 2634770 T6335 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 2634779 T6335 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 2635112 T6335 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 2635115 T6335 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2635117 T6335 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 2635123 T6335 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 2635151 T6335 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 2635151 T6335 oasc.SolrCore.initDirectoryFactory 
solr.StandardDirectoryFactory
   [junit4]   2> 2635152 T6335 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\collection1\,
 
dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty2\
   [junit4]   2> 2635152 T6335 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@12c8a22
   [junit4]   2> 2635154 T6335 oasc.CachingDirectoryFactory.get return new 
directory for 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2
   [junit4]   2> 2635155 T6335 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty2\index/
   [junit4]   2> 2635155 T6335 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index'
 doesn't exist. Creating new index...
   [junit4]   2> 2635155 T6335 oasc.CachingDirectoryFactory.get return new 
directory for 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index
   [junit4]   2> 2635157 T6335 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2635161 T6335 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2635161 T6335 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 2635165 T6335 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2635165 T6335 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 2635165 T6335 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2635167 T6335 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 2635167 T6335 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2635167 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2635168 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2635168 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 2635170 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 2635171 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2635171 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2635172 T6335 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2635180 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2635181 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2635183 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2635185 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2635188 T6335 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 2635188 T6335 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 2635190 T6335 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7834408184952782]
   [junit4]   2> 2635191 T6335 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2635191 T6335 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 2635192 T6335 oass.SolrIndexSearcher.<init> Opening 
Searcher@78439d[collection1] main
   [junit4]   2> 2635192 T6335 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 2635193 T6335 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 2635193 T6335 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2635194 T6335 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2635194 T6335 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 2635194 T6335 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2635195 T6335 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2635195 T6335 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2635195 T6335 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 2635195 T6335 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 2635201 T6335 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 2635201 T6336 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@78439d[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2635205 T6339 oasc.ZkController.register Register replica - 
core:collection1 address:https://127.0.0.1:65124 collection:collection1 
shard:shard1
   [junit4]   2> 2635206 T6263 oass.SolrDispatchFilter.init 
user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2635206 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 2635218 T6339 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 2635358 T6339 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 2635407 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2635408 T6339 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 2635408 T6339 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C7711 name=collection1 
org.apache.solr.core.SolrCore@16317a8 url=https://127.0.0.1:65124/collection1 
node=127.0.0.1:65124_ C7711_STATE=coll:collection1 core:collection1 
props:{node_name=127.0.0.1:65124_, base_url=https://127.0.0.1:65124, 
state=down, core=collection1}
   [junit4]   2> 2635408 T6339 C7711 P65124 oasc.SyncStrategy.sync Sync 
replicas to https://127.0.0.1:65124/collection1/
   [junit4]   2> 2635408 T6339 C7711 P65124 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 2635408 T6339 C7711 P65124 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:65124/collection1/ has no replicas
   [junit4]   2> 2635408 T6339 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: https://127.0.0.1:65124/collection1/ shard1
   [junit4]   2> 2635409 T6339 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 2635646 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2635647 T6334 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2635648 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2635649 T6334 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 6 
   [junit4]   2> 2635649 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 6 
   [junit4]   2> 2635658 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2635659 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2635660 T6334 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2635661 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2635662 T6334 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 7 
   [junit4]   2> 2635663 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 7 
   [junit4]   2> 2635717 T6339 oasc.ZkController.register We are 
https://127.0.0.1:65124/collection1/ and leader is 
https://127.0.0.1:65124/collection1/
   [junit4]   2> 2635717 T6339 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=https://127.0.0.1:65124
   [junit4]   2> 2635717 T6339 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 2635717 T6339 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 2635717 T6339 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 2635719 T6292 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 2635726 T6288 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "node_name":"127.0.0.1:65124_",
   [junit4]   2>          "core_node_name":"core_node2",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "base_url":"https://127.0.0.1:65124";,
   [junit4]   2>          "state":"active",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "core":"collection1"}
   [junit4]   2> 2635727 T6339 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 7 
   [junit4]   2> 2635733 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/collection1/state.json
   [junit4]   2> 2635734 T6315 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2635735 T6334 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 2635736 T6315 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 8 
   [junit4]   2> 2635737 T6334 oascc.ZkStateReader.updateWatchedCollection 
Updating data for collection1 to ver 8 
   [junit4]   2> 2636742 T6263 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 2636743 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2636751 T6263 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2636754 T6263 oejs.AbstractConnector.doStart Started 
[email protected]:65133
   [junit4]   2> 2636758 T6263 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 2636758 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 2636758 T6263 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005
   [junit4]   2> 2636758 T6263 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005\'
   [junit4]   2> 2636793 T6263 oasc.ConfigSolr.fromFile Loading container 
configuration from 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005\solr.xml
   [junit4]   2> 2636896 T6263 oasc.CoreContainer.<init> New CoreContainer 
7659654
   [junit4]   2> 2636896 T6263 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005\]
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2636900 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 2636900 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 2636900 T6263 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 2636903 T6263 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2636906 T6263 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2636906 T6263 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2636906 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2636906 T6263 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:65090/solr
   [junit4]   2> 2636906 T6263 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 2636909 T6263 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 2636910 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2636912 T6350 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@13382ca name:ZooKeeperConnection 
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2636913 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2636913 T6263 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 2636915 T6265 oazs.NIOServerCnxn.doIO WARN caught end of 
stream exception EndOfStreamException: Unable to read additional data from 
client sessionid 0x14951a1ed97000b, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2636917 T6263 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 2636918 T6352 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@48cac3 name:ZooKeeperConnection 
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2636918 T6263 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2636931 T6263 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2637941 T6263 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65133_
   [junit4]   2> 2637944 T6263 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:65133_
   [junit4]   2> 2637957 T6263 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2637973 T6354 oa

[...truncated too long message...]

tiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2>                at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>          17) Thread[id=6339, 
name=coreZkRegister-2641-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>                at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2>                at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2>                at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>          18) Thread[id=6337, name=Thread-1860, state=WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at java.lang.Object.wait(Native Method)
   [junit4]   2>                at java.lang.Object.wait(Object.java:503)
   [junit4]   2>                at 
org.apache.solr.core.CloserThread.run(CoreContainer.java:923)
   [junit4]   2>          19) Thread[id=6355, 
name=searcherExecutor-2655-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>                at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>                at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2>                at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2>                at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2>                at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: 
codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=387), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=387)), sim=DefaultSimilarity, locale=sr__#Latn, timezone=Asia/Manila
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_67 
(32-bit)/cpus=2,threads=27,free=121800208,total=322891776
   [junit4]   2> NOTE: All tests run in this JVM: 
[SchemaVersionSpecificBehaviorTest, OutputWriterTest, RollingRestartTest, 
TestSortingResponseWriter, TestSerializedLuceneMatchVersion, 
TestCSVResponseWriter, TestFieldTypeResource, CircularListTest, 
TestModifyConfFiles, TestSolrQueryParser, SignatureUpdateProcessorFactoryTest, 
SimpleFacetsTest, AutoCommitTest, TestSuggestSpellingConverter, 
TestReloadAndDeleteDocs, BasicDistributedZkTest, TestInitParams, 
TestStressUserVersions, ParsingFieldUpdateProcessorsTest, TestFunctionQuery, 
TestExtendedDismaxParser, TestImplicitCoreProperties, SliceStateTest, 
TestPivotHelperCode, HardAutoCommitTest, IndexSchemaRuntimeFieldTest, 
TestSolrIndexConfig, CoreContainerCoreInitFailuresTest, 
DistributedFacetPivotLargeTest, SharedFSAutoReplicaFailoverTest, 
TestFileDictionaryLookup, TestRequestStatusCollectionAPI, 
DistributedExpandComponentTest, SolrIndexSplitterTest, FileUtilsTest, 
SimplePostToolTest, TestSystemIdResolver, BadComponentTest, DocValuesTest, 
TestSurroundQueryParser, TestStressReorder, ZkNodePropsTest, TestCSVLoader, 
TestCloudManagedSchemaConcurrent, SolrXmlInZkTest, ResourceLoaderTest, 
ZkControllerTest, ResponseLogComponentTest, IndexSchemaTest, QueryEqualityTest, 
HdfsBasicDistributedZkTest, SuggesterTSTTest, HdfsBasicDistributedZk2Test, 
TestRangeQuery, TestCopyFieldCollectionResource, ClusterStateTest, 
SyncSliceTest, LeaderElectionIntegrationTest, 
TestDynamicFieldCollectionResource, DistributedIntervalFacetingTest, 
TestCollapseQParserPlugin, SuggesterFSTTest, RAMDirectoryFactoryTest, 
AlternateDirectoryTest, TestFaceting, TestLFUCache, TestReload, 
DocumentAnalysisRequestHandlerTest, ExternalCollectionsTest, NoCacheHeaderTest, 
TestShortCircuitedRequests, SpellPossibilityIteratorTest, 
BasicFunctionalityTest, TestHighFrequencyDictionaryFactory, TestSchemaResource, 
XmlUpdateRequestHandlerTest, UUIDFieldTest, URLClassifyProcessorTest, 
TestCollationFieldDocValues, TestPartialUpdateDeduplication, 
DirectUpdateHandlerOptimizeTest, HighlighterTest, SolrPluginUtilsTest, 
TestIndexSearcher, TestLeaderElectionZkExpiry, TestOmitPositions, 
TestRandomMergePolicy, TestSolrXml, PreAnalyzedUpdateProcessorTest, 
ShardSplitTest, SoftAutoCommitTest, TestManagedResourceStorage, 
BinaryUpdateRequestHandlerTest, DistributedQueryComponentCustomSortTest, 
TestConfig, TestIndexingPerformance, BadIndexSchemaTest, 
DistribDocExpirationUpdateProcessorTest, QueryResultKeyTest, 
DistributedTermsComponentTest, ConvertedLegacyTest, 
TestLMJelinekMercerSimilarityFactory, 
TestSolrQueryParserDefaultOperatorResource, MigrateRouteKeyTest, 
StatsComponentTest, TestHighlightDedupGrouping, TestQuerySenderNoQuery, 
TestBinaryResponseWriter, TestCloudManagedSchema, 
TestOverriddenPrefixQueryForCustomFieldType, AnalyticsMergeStrategyTest, 
DateRangeFieldTest, CoreAdminHandlerTest, TestMaxScoreQueryParser, 
DistanceFunctionTest, TestAtomicUpdateErrorCases, TestClassNameShortening, 
TestDefaultSimilarityFactory, TestWriterPerf, OpenCloseCoreStressTest, 
TestSolrJ, TestQueryTypes, TestReplicationHandlerBackup, HdfsLockFactoryTest, 
DistributedFacetPivotSmallTest, BlockCacheTest, 
CloudExitableDirectoryReaderTest, PingRequestHandlerTest, CacheHeaderTest, 
ResponseHeaderTest, DirectUpdateHandlerTest, TestDynamicFieldResource, 
TestZkChroot, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=37808CEB4DB8BA4 
-Dtests.slow=true -Dtests.locale=sr__#Latn -Dtests.timezone=Asia/Manila 
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([37808CEB4DB8BA4]:0)
   [junit4] Completed in 7290.45s, 1 test, 2 errors <<< FAILURES!

[...truncated 909 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:525: The 
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:473: The 
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The 
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: 
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: 
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496:
 The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1358:
 The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:965:
 There were test failures: 438 suites, 1797 tests, 1 suite-level error, 1 
error, 1136 ignored (21 assumptions)

Total time: 209 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_67 -server 
-XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to