Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4394/
Java: 32bit/jdk1.7.0_67 -server -XX:+UseSerialGC
2 tests failed.
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([37808CEB4DB8BA4]:0)
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([37808CEB4DB8BA4]:0)
Build Log:
[...truncated 11007 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\init-core-data-001
[junit4] 2> 2622065 T6263 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl
(true) and clientAuth (false)
[junit4] 2> 2622065 T6263
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system
property: /
[junit4] 2> 2622073 T6263 oas.SolrTestCaseJ4.setUp ###Starting
testDistribSearch
[junit4] 2> 2622073 T6263 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2622076 T6264 oasc.ZkTestServer$ZKServerMain.runFromConfig
Starting server
[junit4] 2> 2622184 T6263 oasc.ZkTestServer.run start zk server on
port:65090
[junit4] 2> 2622184 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2622187 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2622193 T6270 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@db8a72 name:ZooKeeperConnection
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 2622193 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2622193 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2622193 T6263 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2622202 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2622205 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2622211 T6272 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@663558 name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2622212 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2622212 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2622212 T6263 oascc.SolrZkClient.makePath makePath:
/collections/collection1
[junit4] 2> 2622216 T6263 oascc.SolrZkClient.makePath makePath:
/collections/collection1/shards
[junit4] 2> 2622219 T6263 oascc.SolrZkClient.makePath makePath:
/collections/control_collection
[junit4] 2> 2622221 T6263 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/shards
[junit4] 2> 2622224 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 2622224 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.xml
[junit4] 2> 2622231 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 2622231 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/schema.xml
[junit4] 2> 2622235 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2622235 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2622239 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 2622239 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/stopwords.txt
[junit4] 2> 2622243 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 2622243 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/protwords.txt
[junit4] 2> 2622248 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 2622248 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/currency.xml
[junit4] 2> 2622252 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 2622252 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/enumsConfig.xml
[junit4] 2> 2622255 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2622255 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/open-exchange-rates.json
[junit4] 2> 2622259 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2622259 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2622263 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 2622263 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/old_synonyms.txt
[junit4] 2> 2622268 T6263 oasc.AbstractZkTestCase.putConfig put
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 2622268 T6263 oascc.SolrZkClient.makePath makePath:
/configs/conf1/synonyms.txt
[junit4] 2> 2622273 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2622275 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2622299 T6274 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@10277cb name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2622300 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2622300 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2624152 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2624162 T6263 oejus.SslContextFactory.doStart Enabled
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3,
TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2624166 T6263 oejs.AbstractConnector.doStart Started
[email protected]:65100
[junit4] 2> 2624168 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()
[junit4] 2> 2624168 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2624168 T6263 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002
[junit4] 2> 2624168 T6263 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\'
[junit4] 2> 2624204 T6263 oasc.ConfigSolr.fromFile Loading container
configuration from
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\solr.xml
[junit4] 2> 2624267 T6263 oasc.CoreContainer.<init> New CoreContainer
3379680
[junit4] 2> 2624267 T6263 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\]
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2624269 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2624271 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2624271 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2624271 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2624274 T6263 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2624277 T6263 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2624277 T6263 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2624277 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2624277 T6263 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:65090/solr
[junit4] 2> 2624277 T6263 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2624281 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2624282 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2624284 T6285 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@109ab15 name:ZooKeeperConnection
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 2624285 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2624285 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2624289 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2624291 T6287 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@727f16 name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2624291 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2624293 T6263 oascc.SolrZkClient.makePath makePath:
/overseer/queue
[junit4] 2> 2624298 T6263 oascc.SolrZkClient.makePath makePath:
/overseer/collection-queue-work
[junit4] 2> 2624306 T6263 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-running
[junit4] 2> 2624312 T6263 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-completed
[junit4] 2> 2624318 T6263 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-failure
[junit4] 2> 2624328 T6263 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2624331 T6263 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65100_
[junit4] 2> 2624333 T6263 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:65100_
[junit4] 2> 2624341 T6263 oascc.SolrZkClient.makePath makePath:
/overseer_elect
[junit4] 2> 2624345 T6263 oascc.SolrZkClient.makePath makePath:
/overseer_elect/election
[junit4] 2> 2624350 T6263 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2624354 T6263 oasc.OverseerElectionContext.runLeaderProcess I
am going to be the leader 127.0.0.1:65100_
[junit4] 2> 2624354 T6263 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4] 2> 2624360 T6263 oasc.Overseer.start Overseer
(id=92695023255486468-127.0.0.1:65100_-n_0000000000) starting
[junit4] 2> 2624366 T6263 oascc.SolrZkClient.makePath makePath:
/overseer/queue-work
[junit4] 2> 2624388 T6263 oasc.OverseerAutoReplicaFailoverThread.<init>
Starting OverseerAutoReplicaFailoverThread
autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2624389 T6289 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4] 2> 2624391 T6263 oascc.SolrZkClient.makePath makePath:
/clusterstate.json
[junit4] 2> 2624400 T6263 oascc.SolrZkClient.makePath makePath:
/aliases.json
[junit4] 2> 2624404 T6263
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2624412 T6288 oasc.Overseer$ClusterStateUpdater.run Starting
to work on the main queue
[junit4] 2> 2624423 T6291 oasc.ZkController.publish publishing
core=collection1 state=down collection=control_collection
[junit4] 2> 2624423 T6291 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2624425 T6291 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 2624425 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2624435 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:65100_",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"https://127.0.0.1:65100",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2624435 T6288
oasc.Overseer$ClusterStateUpdater.createCollection Create collection
control_collection with shards [shard1]
[junit4] 2> 2624436 T6288
oasc.Overseer$ClusterStateUpdater.createCollection state version
control_collection 1
[junit4] 2> 2624436 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Assigning new node to shard shard=shard1
[junit4] 2> 2624442 T6292 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2625503 T6291 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 2625503 T6291 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:control_collection
[junit4] 2> 2625505 T6291 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 2625505 T6291 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 2625509 T6291 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 2625510 T6291 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\collection1\'
[junit4] 2> 2625518 T6291 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-002/collection1/lib/.svn/'
to classloader
[junit4] 2> 2625522 T6291 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-002/collection1/lib/classes/'
to classloader
[junit4] 2> 2625524 T6291 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-002/collection1/lib/README'
to classloader
[junit4] 2> 2625603 T3 oasc.CoreContainer.finalize ERROR CoreContainer was
not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
instance=30126192
[junit4] 2> 2625610 T6291 oasc.SolrConfig.<init> Using Lucene
MatchVersion: 6.0.0
[junit4] 2> 2625658 T6291 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 2625660 T6291 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 2625676 T6291 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 2626042 T6291 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 2626057 T6291 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2626058 T6291 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2626064 T6291 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2626105 T6291 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection control_collection
[junit4] 2> 2626105 T6291 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 2626106 T6291 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-002\collection1\,
dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/control/data\
[junit4] 2> 2626106 T6291 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@12c8a22
[junit4] 2> 2626110 T6291 oasc.CachingDirectoryFactory.get return new
directory for
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data
[junit4] 2> 2626111 T6291 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/control/data\index/
[junit4] 2> 2626112 T6291 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index'
doesn't exist. Creating new index...
[junit4] 2> 2626115 T6291 oasc.CachingDirectoryFactory.get return new
directory for
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index
[junit4] 2> 2626116 T6291 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy:
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46,
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807,
calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2626135 T6291 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 2626135 T6291 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2626140 T6291 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 2626141 T6291 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 2626141 T6291 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2626141 T6291 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 2626142 T6291 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2626142 T6291 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2626142 T6291 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2626143 T6291 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 2626143 T6291 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2626143 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2626145 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2626145 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /get: solr.RealTimeGetHandler
[junit4] 2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig
adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2626146 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /replication: solr.ReplicationHandler
[junit4] 2> 2626147 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /update: solr.UpdateRequestHandler
[junit4] 2> 2626147 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2626148 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2626148 T6291 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2626158 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2626159 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2626161 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2626163 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2626168 T6291 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 2626168 T6291 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 2626169 T6291 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy:
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44,
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807,
calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7834408184952782]
[junit4] 2> 2626169 T6291 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 2626169 T6291 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2626171 T6291 oass.SolrIndexSearcher.<init> Opening
Searcher@556126[collection1] main
[junit4] 2> 2626171 T6291 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 2626173 T6291 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 2626173 T6291 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2626175 T6291
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2626175 T6291 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 2626175 T6291 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2626176 T6291
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2626176 T6291 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2626177 T6291 oascc.SolrZkClient.makePath makePath:
/configs/conf1/_rest_managed.json
[junit4] 2> 2626181 T6291
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new
znode /configs/conf1/_rest_managed.json
[junit4] 2> 2626181 T6291 oasr.ManagedResourceStorage$JsonStorage.store
Saved JSON object to path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2626182 T6291 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 2626184 T6293 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@556126[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2626186 T6291 oasc.CoreContainer.registerCore registering
core: collection1
[junit4] 2> 2626188 T6296 oasc.ZkController.register Register replica -
core:collection1 address:https://127.0.0.1:65100 collection:control_collection
shard:shard1
[junit4] 2> 2626189 T6263 oass.SolrDispatchFilter.init
user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 2626189 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 2626192 T6296 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2626200 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2626202 T6296 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 2626203 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2626205 T6298 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1c065e9 name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2626206 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2626206 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2626207 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2626208 T6263
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2626209 T6296
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 2626209 T6296 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C7709 name=collection1
org.apache.solr.core.SolrCore@164abc5 url=https://127.0.0.1:65100/collection1
node=127.0.0.1:65100_ C7709_STATE=coll:control_collection core:collection1
props:{node_name=127.0.0.1:65100_, base_url=https://127.0.0.1:65100,
state=down, core=collection1}
[junit4] 2> 2626209 T6296 C7709 P65100 oasc.SyncStrategy.sync Sync
replicas to https://127.0.0.1:65100/collection1/
[junit4] 2> 2626209 T6296 C7709 P65100 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 2626210 T6296 C7709 P65100 oasc.SyncStrategy.syncToMe
https://127.0.0.1:65100/collection1/ has no replicas
[junit4] 2> 2626210 T6296 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: https://127.0.0.1:65100/collection1/ shard1
[junit4] 2> 2626210 T6296 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leaders/shard1
[junit4] 2> 2626217 T6263 oasc.ChaosMonkey.monkeyLog monkey: init - expire
sessions:false cause connection loss:false
[junit4] 2> 2626218 T6263 oasc.AbstractFullDistribZkTestBase.createJettys
Creating collection1 with stateFormat=2
[junit4] 2> 2626218 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2626221 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2626223 T6300 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1c07731 name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2626223 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2626223 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2626224 T6292 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2626226 T6301 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2626245 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2626246 T6288
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection:
collection1
[junit4] 2> 2626246 T6288
oasc.Overseer$ClusterStateUpdater.createCollection Create collection
collection1 with shards [shard1, shard2]
[junit4] 2> 2626246 T6288
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 2626250 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to create_collection /collections/collection1/state.json
[junit4] 2> 2626252 T6292 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2626252 T6301 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2626282 T6296 oasc.ZkController.register We are
https://127.0.0.1:65100/collection1/ and leader is
https://127.0.0.1:65100/collection1/
[junit4] 2> 2626282 T6296 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=https://127.0.0.1:65100
[junit4] 2> 2626282 T6296 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 2626282 T6296 oasc.ZkController.publish publishing
core=collection1 state=active collection=control_collection
[junit4] 2> 2626282 T6296 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2626284 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2626292 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:65100_",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"https://127.0.0.1:65100",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2626406 T6301 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2626407 T6292 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2627989 T6263 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 1
[junit4] 2> 2627990 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2627999 T6263 oejus.SslContextFactory.doStart Enabled
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3,
TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2628002 T6263 oejs.AbstractConnector.doStart Started
[email protected]:65115
[junit4] 2> 2628007 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()
[junit4] 2> 2628008 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2628008 T6263 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003
[junit4] 2> 2628008 T6263 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\'
[junit4] 2> 2628043 T6263 oasc.ConfigSolr.fromFile Loading container
configuration from
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\solr.xml
[junit4] 2> 2628104 T6263 oasc.CoreContainer.<init> New CoreContainer
18447405
[junit4] 2> 2628105 T6263 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\]
[junit4] 2> 2628106 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2628106 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2628107 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2628107 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2628107 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2628108 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2628108 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2628108 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2628109 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2628109 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2628112 T6263 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2628115 T6263 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2628115 T6263 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2628116 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2628116 T6263 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:65090/solr
[junit4] 2> 2628116 T6263 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2628117 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2628119 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2628120 T6312 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@a47897 name:ZooKeeperConnection
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 2628121 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2628121 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2628125 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2628127 T6314 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@b0cdd5 name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2628127 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2628141 T6263
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2629152 T6263 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65115_
[junit4] 2> 2629155 T6263 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:65115_
[junit4] 2> 2629172 T6263 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2629187 T6316 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 2629187 T6316 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2629190 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2629191 T6316 oasc.ZkController.preRegister Registering watch
for external collection collection1
[junit4] 2> 2629191 T6316 oascc.ZkStateReader.addZkWatch addZkWatch
collection1
[junit4] 2> 2629192 T6316 oascc.ZkStateReader.addZkWatch Updating
collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2629195 T6316 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 0
[junit4] 2> 2629195 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:65115_",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"https://127.0.0.1:65115",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2629195 T6316 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 2629202 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Collection already exists with numShards=2
[junit4] 2> 2629204 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Assigning new node to shard shard=shard2
[junit4] 2> 2629214 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2629215 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2629216 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 1
[junit4] 2> 2630196 T6316 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 2630196 T6316 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 2630198 T6316 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 2630198 T6316 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2630203 T6316 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2630203 T6316 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\collection1\'
[junit4] 2> 2630209 T6316 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-003/collection1/lib/.svn/'
to classloader
[junit4] 2> 2630212 T6316 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-003/collection1/lib/classes/'
to classloader
[junit4] 2> 2630214 T6316 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-003/collection1/lib/README'
to classloader
[junit4] 2> 2630280 T6316 oasc.SolrConfig.<init> Using Lucene
MatchVersion: 6.0.0
[junit4] 2> 2630359 T6316 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 2630363 T6316 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 2630376 T6316 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 2630719 T6316 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 2630725 T6316 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2630727 T6316 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2630732 T6316 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2630760 T6316 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 2630760 T6316 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 2630761 T6316 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-003\collection1\,
dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty1\
[junit4] 2> 2630761 T6316 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@12c8a22
[junit4] 2> 2630763 T6316 oasc.CachingDirectoryFactory.get return new
directory for
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1
[junit4] 2> 2630764 T6316 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty1\index/
[junit4] 2> 2630765 T6316 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index'
doesn't exist. Creating new index...
[junit4] 2> 2630766 T6316 oasc.CachingDirectoryFactory.get return new
directory for
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index
[junit4] 2> 2630767 T6316 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy:
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46,
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807,
calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2630770 T6316 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 2630770 T6316 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2630775 T6316 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 2630776 T6316 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2630777 T6316 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2630777 T6316 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2630777 T6316 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 2630777 T6316 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2630778 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2630778 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2630779 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2630779 T6316 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 2630780 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /get: solr.RealTimeGetHandler
[junit4] 2> 2630780 T6316 oasc.RequestHandlers.initHandlersFromConfig
adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2630780 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /replication: solr.ReplicationHandler
[junit4] 2> 2630781 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /update: solr.UpdateRequestHandler
[junit4] 2> 2630781 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2630781 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2630782 T6316 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2630791 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2630792 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2630794 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2630797 T6316 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2630799 T6316 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 2630799 T6316 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 2630801 T6316 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy:
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44,
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807,
calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7834408184952782]
[junit4] 2> 2630802 T6316 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 2630802 T6316 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2630803 T6316 oass.SolrIndexSearcher.<init> Opening
Searcher@abb9b1[collection1] main
[junit4] 2> 2630803 T6316 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2630805 T6316 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2630805 T6316 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2630806 T6316
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2630806 T6316 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 2630806 T6316 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2630808 T6316
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes
from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2630808 T6316 oasr.ManagedResourceStorage.load Loaded
LinkedHashMap at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2630808 T6316 oasr.ManagedResource.reloadFromStorage Loaded
initArgs {} for /rest/managed
[junit4] 2> 2630808 T6316 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 2630814 T6316 oasc.CoreContainer.registerCore registering
core: collection1
[junit4] 2> 2630814 T6317 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@abb9b1[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2630817 T6320 oasc.ZkController.register Register replica -
core:collection1 address:https://127.0.0.1:65115 collection:collection1
shard:shard2
[junit4] 2> 2630819 T6263 oass.SolrDispatchFilter.init
user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 2630819 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 2630832 T6320 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leader_elect/shard2/election
[junit4] 2> 2631031 T6320 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard2
[junit4] 2> 2631034 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2631035 T6320
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 2631035 T6320 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C7710 name=collection1
org.apache.solr.core.SolrCore@db84e4 url=https://127.0.0.1:65115/collection1
node=127.0.0.1:65115_ C7710_STATE=coll:collection1 core:collection1
props:{node_name=127.0.0.1:65115_, base_url=https://127.0.0.1:65115,
state=down, core=collection1}
[junit4] 2> 2631035 T6320 C7710 P65115 oasc.SyncStrategy.sync Sync
replicas to https://127.0.0.1:65115/collection1/
[junit4] 2> 2631035 T6320 C7710 P65115 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 2631035 T6320 C7710 P65115 oasc.SyncStrategy.syncToMe
https://127.0.0.1:65115/collection1/ has no replicas
[junit4] 2> 2631035 T6320 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: https://127.0.0.1:65115/collection1/ shard2
[junit4] 2> 2631037 T6320 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard2
[junit4] 2> 2631053 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2631054 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2631056 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 2
[junit4] 2> 2631067 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2631068 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2631069 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2631071 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 3
[junit4] 2> 2631103 T6320 oasc.ZkController.register We are
https://127.0.0.1:65115/collection1/ and leader is
https://127.0.0.1:65115/collection1/
[junit4] 2> 2631103 T6320 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=https://127.0.0.1:65115
[junit4] 2> 2631103 T6320 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 2631103 T6320 oasc.ZkController.publish publishing
core=collection1 state=active collection=collection1
[junit4] 2> 2631103 T6320 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2631105 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2631111 T6320 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 3
[junit4] 2> 2631112 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:65115_",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"https://127.0.0.1:65115",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2631119 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2631121 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2631122 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 4
[junit4] 2> 2632426 T6263 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 2
[junit4] 2> 2632427 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2632435 T6263 oejus.SslContextFactory.doStart Enabled
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3,
TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2632438 T6263 oejs.AbstractConnector.doStart Started
[email protected]:65124
[junit4] 2> 2632444 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()
[junit4] 2> 2632445 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2632445 T6263 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004
[junit4] 2> 2632446 T6263 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\'
[junit4] 2> 2632475 T6263 oasc.ConfigSolr.fromFile Loading container
configuration from
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\solr.xml
[junit4] 2> 2632536 T6263 oasc.CoreContainer.<init> New CoreContainer
6003137
[junit4] 2> 2632536 T6263 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\]
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2632538 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2632540 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2632540 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2632540 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2632543 T6263 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2632546 T6263 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2632546 T6263 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2632546 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2632546 T6263 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:65090/solr
[junit4] 2> 2632546 T6263 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2632548 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2632550 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2632551 T6331 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@4b1fb4 name:ZooKeeperConnection
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 2632552 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2632552 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2632555 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2632558 T6333 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@c5f5ec name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2632559 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2632569 T6263
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2633581 T6263 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65124_
[junit4] 2> 2633583 T6263 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:65124_
[junit4] 2> 2633603 T6263 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2633619 T6335 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 2633619 T6335 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2633622 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2633624 T6335 oasc.ZkController.preRegister Registering watch
for external collection collection1
[junit4] 2> 2633624 T6335 oascc.ZkStateReader.addZkWatch addZkWatch
collection1
[junit4] 2> 2633625 T6335 oascc.ZkStateReader.addZkWatch Updating
collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2633628 T6335 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 4
[junit4] 2> 2633628 T6335 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 2633630 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:65124_",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"https://127.0.0.1:65124",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2633636 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Collection already exists with numShards=2
[junit4] 2> 2633638 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Assigning new node to shard shard=shard1
[junit4] 2> 2633648 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2633650 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2633650 T6334 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2633652 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 5
[junit4] 2> 2633652 T6334 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 5
[junit4] 2> 2634628 T6335 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 2634628 T6335 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 2634630 T6335 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 2634631 T6335 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2634633 T6335 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2634634 T6335 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\collection1\'
[junit4] 2> 2634641 T6335 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-004/collection1/lib/.svn/'
to classloader
[junit4] 2> 2634643 T6335 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-004/collection1/lib/classes/'
to classloader
[junit4] 2> 2634644 T6335 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001/tempDir-004/collection1/lib/README'
to classloader
[junit4] 2> 2634723 T6335 oasc.SolrConfig.<init> Using Lucene
MatchVersion: 6.0.0
[junit4] 2> 2634767 T6335 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 2634770 T6335 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 2634779 T6335 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 2635112 T6335 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 2635115 T6335 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2635117 T6335 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2635123 T6335 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2635151 T6335 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 2635151 T6335 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 2635152 T6335 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-004\collection1\,
dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty2\
[junit4] 2> 2635152 T6335 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@12c8a22
[junit4] 2> 2635154 T6335 oasc.CachingDirectoryFactory.get return new
directory for
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2
[junit4] 2> 2635155 T6335 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001/jetty2\index/
[junit4] 2> 2635155 T6335 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index'
doesn't exist. Creating new index...
[junit4] 2> 2635155 T6335 oasc.CachingDirectoryFactory.get return new
directory for
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index
[junit4] 2> 2635157 T6335 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy:
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=46,
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807,
calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2635161 T6335 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 2635161 T6335 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2635165 T6335 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 2635165 T6335 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 2635165 T6335 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2635166 T6335 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2635167 T6335 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 2635167 T6335 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2635167 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2635168 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2635168 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /get: solr.RealTimeGetHandler
[junit4] 2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig
adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2635169 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /replication: solr.ReplicationHandler
[junit4] 2> 2635170 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /update: solr.UpdateRequestHandler
[junit4] 2> 2635171 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2635171 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2635172 T6335 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2635180 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2635181 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2635183 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2635185 T6335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2635188 T6335 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 2635188 T6335 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 2635190 T6335 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy:
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44,
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807,
calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7834408184952782]
[junit4] 2> 2635191 T6335 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 2635191 T6335 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2635192 T6335 oass.SolrIndexSearcher.<init> Opening
Searcher@78439d[collection1] main
[junit4] 2> 2635192 T6335 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2635193 T6335 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2635193 T6335 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2635194 T6335
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2635194 T6335 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 2635194 T6335 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2635195 T6335
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes
from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2635195 T6335 oasr.ManagedResourceStorage.load Loaded
LinkedHashMap at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2635195 T6335 oasr.ManagedResource.reloadFromStorage Loaded
initArgs {} for /rest/managed
[junit4] 2> 2635195 T6335 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 2635201 T6335 oasc.CoreContainer.registerCore registering
core: collection1
[junit4] 2> 2635201 T6336 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@78439d[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2635205 T6339 oasc.ZkController.register Register replica -
core:collection1 address:https://127.0.0.1:65124 collection:collection1
shard:shard1
[junit4] 2> 2635206 T6263 oass.SolrDispatchFilter.init
user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 2635206 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 2635218 T6339 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 2635358 T6339 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 2635407 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2635408 T6339
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 2635408 T6339 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C7711 name=collection1
org.apache.solr.core.SolrCore@16317a8 url=https://127.0.0.1:65124/collection1
node=127.0.0.1:65124_ C7711_STATE=coll:collection1 core:collection1
props:{node_name=127.0.0.1:65124_, base_url=https://127.0.0.1:65124,
state=down, core=collection1}
[junit4] 2> 2635408 T6339 C7711 P65124 oasc.SyncStrategy.sync Sync
replicas to https://127.0.0.1:65124/collection1/
[junit4] 2> 2635408 T6339 C7711 P65124 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 2635408 T6339 C7711 P65124 oasc.SyncStrategy.syncToMe
https://127.0.0.1:65124/collection1/ has no replicas
[junit4] 2> 2635408 T6339 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: https://127.0.0.1:65124/collection1/ shard1
[junit4] 2> 2635409 T6339 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard1
[junit4] 2> 2635646 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2635647 T6334 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2635648 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2635649 T6334 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 6
[junit4] 2> 2635649 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 6
[junit4] 2> 2635658 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2635659 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2635660 T6334 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2635661 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2635662 T6334 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 7
[junit4] 2> 2635663 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 7
[junit4] 2> 2635717 T6339 oasc.ZkController.register We are
https://127.0.0.1:65124/collection1/ and leader is
https://127.0.0.1:65124/collection1/
[junit4] 2> 2635717 T6339 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=https://127.0.0.1:65124
[junit4] 2> 2635717 T6339 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 2635717 T6339 oasc.ZkController.publish publishing
core=collection1 state=active collection=collection1
[junit4] 2> 2635717 T6339 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2635719 T6292 oasc.DistributedQueue$LatchChildWatcher.process
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type
NodeChildrenChanged
[junit4] 2> 2635726 T6288 oasc.Overseer$ClusterStateUpdater.updateState
Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:65124_",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"https://127.0.0.1:65124",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2635727 T6339 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 7
[junit4] 2> 2635733 T6288 oasc.Overseer$ClusterStateUpdater.updateZkStates
going to update_collection /collections/collection1/state.json
[junit4] 2> 2635734 T6315 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2635735 T6334 oascc.ZkStateReader$7.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2635736 T6315 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 8
[junit4] 2> 2635737 T6334 oascc.ZkStateReader.updateWatchedCollection
Updating data for collection1 to ver 8
[junit4] 2> 2636742 T6263 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 3
[junit4] 2> 2636743 T6263 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2636751 T6263 oejus.SslContextFactory.doStart Enabled
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3,
TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2636754 T6263 oejs.AbstractConnector.doStart Started
[email protected]:65133
[junit4] 2> 2636758 T6263 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()
[junit4] 2> 2636758 T6263 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2636758 T6263 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005
[junit4] 2> 2636758 T6263 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005\'
[junit4] 2> 2636793 T6263 oasc.ConfigSolr.fromFile Loading container
configuration from
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005\solr.xml
[junit4] 2> 2636896 T6263 oasc.CoreContainer.<init> New CoreContainer
7659654
[junit4] 2> 2636896 T6263 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-37808CEB4DB8BA4-001\tempDir-005\]
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2636899 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2636900 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2636900 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2636900 T6263 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2636903 T6263 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2636906 T6263 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2636906 T6263 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2636906 T6263 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2636906 T6263 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:65090/solr
[junit4] 2> 2636906 T6263 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2636909 T6263
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2636910 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2636912 T6350 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@13382ca name:ZooKeeperConnection
Watcher:127.0.0.1:65090 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 2636913 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2636913 T6263 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2636915 T6265 oazs.NIOServerCnxn.doIO WARN caught end of
stream exception EndOfStreamException: Unable to read additional data from
client sessionid 0x14951a1ed97000b, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2636917 T6263 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2636918 T6352 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@48cac3 name:ZooKeeperConnection
Watcher:127.0.0.1:65090/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 2636918 T6263 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2636931 T6263
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2637941 T6263 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65133_
[junit4] 2> 2637944 T6263 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:65133_
[junit4] 2> 2637957 T6263 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2637973 T6354 oa
[...truncated too long message...]
tiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 17) Thread[id=6339,
name=coreZkRegister-2641-thread-1, state=WAITING,
group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 18) Thread[id=6337, name=Thread-1860, state=WAITING,
group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at
org.apache.solr.core.CloserThread.run(CoreContainer.java:923)
[junit4] 2> 19) Thread[id=6355,
name=searcherExecutor-2655-thread-1, state=WAITING,
group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are:
codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
chunkSize=387),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
chunkSize=387)), sim=DefaultSimilarity, locale=sr__#Latn, timezone=Asia/Manila
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_67
(32-bit)/cpus=2,threads=27,free=121800208,total=322891776
[junit4] 2> NOTE: All tests run in this JVM:
[SchemaVersionSpecificBehaviorTest, OutputWriterTest, RollingRestartTest,
TestSortingResponseWriter, TestSerializedLuceneMatchVersion,
TestCSVResponseWriter, TestFieldTypeResource, CircularListTest,
TestModifyConfFiles, TestSolrQueryParser, SignatureUpdateProcessorFactoryTest,
SimpleFacetsTest, AutoCommitTest, TestSuggestSpellingConverter,
TestReloadAndDeleteDocs, BasicDistributedZkTest, TestInitParams,
TestStressUserVersions, ParsingFieldUpdateProcessorsTest, TestFunctionQuery,
TestExtendedDismaxParser, TestImplicitCoreProperties, SliceStateTest,
TestPivotHelperCode, HardAutoCommitTest, IndexSchemaRuntimeFieldTest,
TestSolrIndexConfig, CoreContainerCoreInitFailuresTest,
DistributedFacetPivotLargeTest, SharedFSAutoReplicaFailoverTest,
TestFileDictionaryLookup, TestRequestStatusCollectionAPI,
DistributedExpandComponentTest, SolrIndexSplitterTest, FileUtilsTest,
SimplePostToolTest, TestSystemIdResolver, BadComponentTest, DocValuesTest,
TestSurroundQueryParser, TestStressReorder, ZkNodePropsTest, TestCSVLoader,
TestCloudManagedSchemaConcurrent, SolrXmlInZkTest, ResourceLoaderTest,
ZkControllerTest, ResponseLogComponentTest, IndexSchemaTest, QueryEqualityTest,
HdfsBasicDistributedZkTest, SuggesterTSTTest, HdfsBasicDistributedZk2Test,
TestRangeQuery, TestCopyFieldCollectionResource, ClusterStateTest,
SyncSliceTest, LeaderElectionIntegrationTest,
TestDynamicFieldCollectionResource, DistributedIntervalFacetingTest,
TestCollapseQParserPlugin, SuggesterFSTTest, RAMDirectoryFactoryTest,
AlternateDirectoryTest, TestFaceting, TestLFUCache, TestReload,
DocumentAnalysisRequestHandlerTest, ExternalCollectionsTest, NoCacheHeaderTest,
TestShortCircuitedRequests, SpellPossibilityIteratorTest,
BasicFunctionalityTest, TestHighFrequencyDictionaryFactory, TestSchemaResource,
XmlUpdateRequestHandlerTest, UUIDFieldTest, URLClassifyProcessorTest,
TestCollationFieldDocValues, TestPartialUpdateDeduplication,
DirectUpdateHandlerOptimizeTest, HighlighterTest, SolrPluginUtilsTest,
TestIndexSearcher, TestLeaderElectionZkExpiry, TestOmitPositions,
TestRandomMergePolicy, TestSolrXml, PreAnalyzedUpdateProcessorTest,
ShardSplitTest, SoftAutoCommitTest, TestManagedResourceStorage,
BinaryUpdateRequestHandlerTest, DistributedQueryComponentCustomSortTest,
TestConfig, TestIndexingPerformance, BadIndexSchemaTest,
DistribDocExpirationUpdateProcessorTest, QueryResultKeyTest,
DistributedTermsComponentTest, ConvertedLegacyTest,
TestLMJelinekMercerSimilarityFactory,
TestSolrQueryParserDefaultOperatorResource, MigrateRouteKeyTest,
StatsComponentTest, TestHighlightDedupGrouping, TestQuerySenderNoQuery,
TestBinaryResponseWriter, TestCloudManagedSchema,
TestOverriddenPrefixQueryForCustomFieldType, AnalyticsMergeStrategyTest,
DateRangeFieldTest, CoreAdminHandlerTest, TestMaxScoreQueryParser,
DistanceFunctionTest, TestAtomicUpdateErrorCases, TestClassNameShortening,
TestDefaultSimilarityFactory, TestWriterPerf, OpenCloseCoreStressTest,
TestSolrJ, TestQueryTypes, TestReplicationHandlerBackup, HdfsLockFactoryTest,
DistributedFacetPivotSmallTest, BlockCacheTest,
CloudExitableDirectoryReaderTest, PingRequestHandlerTest, CacheHeaderTest,
ResponseHeaderTest, DirectUpdateHandlerTest, TestDynamicFieldResource,
TestZkChroot, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=37808CEB4DB8BA4
-Dtests.slow=true -Dtests.locale=sr__#Latn -Dtests.timezone=Asia/Manila
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>=
7200000 msec).
[junit4] > at
__randomizedtesting.SeedInfo.seed([37808CEB4DB8BA4]:0)
[junit4] Completed in 7290.45s, 1 test, 2 errors <<< FAILURES!
[...truncated 909 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:525: The
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:473: The
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39:
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189:
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496:
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1358:
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:965:
There were test failures: 438 suites, 1797 tests, 1 suite-level error, 1
error, 1136 ignored (21 assumptions)
Total time: 209 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_67 -server
-XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]