Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-MacOSX/1979/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC (asserts: false)
2 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([3301BB78F341D7A1]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([3301BB78F341D7A1]:0)
Build Log:
[...truncated 9894 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/init-core-data-001
[junit4] 2> 2560591 T9499 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl
(false) and clientAuth (false)
[junit4] 2> 2560591 T9499
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system
property: /
[junit4] 2> 2560602 T9499 oas.SolrTestCaseJ4.setUp ###Starting
testDistribSearch
[junit4] 2> 2560602 T9499 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2560604 T9500 oasc.ZkTestServer$ZKServerMain.runFromConfig
Starting server
[junit4] 2> 2560705 T9499 oasc.ZkTestServer.run start zk server on
port:58235
[junit4] 2> 2560706 T9499
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2560709 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2560723 T9507 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@62901579
name:ZooKeeperConnection Watcher:127.0.0.1:58235 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2560724 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2560725 T9499 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2560725 T9499 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2560736 T9499
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2560739 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2560744 T9510 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@206b2a69
name:ZooKeeperConnection Watcher:127.0.0.1:58235/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2560744 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2560745 T9499 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2560745 T9499 oascc.SolrZkClient.makePath makePath:
/collections/collection1
[junit4] 2> 2560753 T9499 oascc.SolrZkClient.makePath makePath:
/collections/collection1/shards
[junit4] 2> 2560762 T9499 oascc.SolrZkClient.makePath makePath:
/collections/control_collection
[junit4] 2> 2560769 T9499 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/shards
[junit4] 2> 2560776 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 2560777 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.xml
[junit4] 2> 2560788 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 2560789 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/schema.xml
[junit4] 2> 2560796 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2560797 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2560803 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 2560806 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/stopwords.txt
[junit4] 2> 2560812 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 2560813 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/protwords.txt
[junit4] 2> 2560820 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 2560820 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/currency.xml
[junit4] 2> 2560828 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 2560828 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/enumsConfig.xml
[junit4] 2> 2560837 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2560838 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/open-exchange-rates.json
[junit4] 2> 2560845 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2560846 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2560854 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 2560855 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/old_synonyms.txt
[junit4] 2> 2560862 T9499 oasc.AbstractZkTestCase.putConfig put
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 2560863 T9499 oascc.SolrZkClient.makePath makePath:
/configs/conf1/synonyms.txt
[junit4] 2> 2562742 T9499 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2562766 T9499 oejs.AbstractConnector.doStart Started
[email protected]:58238
[junit4] 2> 2562767 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@5ac524dd
[junit4] 2> 2562767 T9499 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2562768 T9499 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002
[junit4] 2> 2562769 T9499 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/'
[junit4] 2> 2562834 T9499 oasc.ConfigSolr.fromFile Loading container
configuration from
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/solr.xml
[junit4] 2> 2563006 T9499 oasc.CoreContainer.<init> New CoreContainer
193758717
[junit4] 2> 2563007 T9499 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/]
[junit4] 2> 2563010 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2563011 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2563012 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2563012 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2563013 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2563013 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2563013 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2563014 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2563014 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2563015 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2563015 T9499 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2563016 T9499 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2563017 T9499 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2563018 T9499 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2563019 T9499 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:58235/solr
[junit4] 2> 2563019 T9499 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2563020 T9499
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2563024 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2563026 T9522 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@40299b6e
name:ZooKeeperConnection Watcher:127.0.0.1:58235 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2563028 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2563028 T9499 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2563035 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2563036 T9525 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@54da1e37
name:ZooKeeperConnection Watcher:127.0.0.1:58235/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2563037 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2563040 T9499 oascc.SolrZkClient.makePath makePath:
/overseer/queue
[junit4] 2> 2563049 T9499 oascc.SolrZkClient.makePath makePath:
/overseer/collection-queue-work
[junit4] 2> 2563057 T9499 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-running
[junit4] 2> 2563067 T9499 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-completed
[junit4] 2> 2563078 T9499 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-failure
[junit4] 2> 2563090 T9499 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2563095 T9499 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58238_
[junit4] 2> 2563097 T9499 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:58238_
[junit4] 2> 2563107 T9499 oascc.SolrZkClient.makePath makePath:
/overseer_elect
[junit4] 2> 2563114 T9499 oascc.SolrZkClient.makePath makePath:
/overseer_elect/election
[junit4] 2> 2563121 T9499 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2563128 T9499 oasc.OverseerElectionContext.runLeaderProcess I
am going to be the leader 127.0.0.1:58238_
[junit4] 2> 2563129 T9499 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4] 2> 2563141 T9499 oasc.Overseer.start Overseer
(id=93055832271224835-127.0.0.1:58238_-n_0000000000) starting
[junit4] 2> 2563152 T9499 oascc.SolrZkClient.makePath makePath:
/overseer/queue-work
[junit4] 2> 2563187 T9499 oasc.OverseerAutoReplicaFailoverThread.<init>
Starting OverseerAutoReplicaFailoverThread
autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2563190 T9527 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4] 2> 2563192 T9499 oascc.SolrZkClient.makePath makePath:
/clusterstate.json
[junit4] 2> 2563200 T9499 oascc.SolrZkClient.makePath makePath:
/aliases.json
[junit4] 2> 2563205 T9499
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2563219 T9526 oasc.Overseer$ClusterStateUpdater.run Starting
to work on the main queue
[junit4] 2> 2563234 T9529 oasc.ZkController.publish publishing
core=collection1 state=down collection=control_collection
[junit4] 2> 2563235 T9529 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2563237 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2563237 T9529 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 2563251 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 0, message = {
[junit4] 2> "roles":null,
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58238";,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:58238_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down"} current state version: 0
[junit4] 2> 2563253 T9526 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58238";,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:58238_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down"}
[junit4] 2> 2563254 T9526 oasco.ClusterStateMutator.createCollection
building a new cName: control_collection
[junit4] 2> 2563254 T9526 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 2563258 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2564239 T9529 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 2564239 T9529 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:control_collection
[junit4] 2> 2564241 T9529 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 2564242 T9529 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 2564245 T9529 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 2564245 T9529 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/collection1/'
[junit4] 2> 2564247 T9529 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/collection1/lib/.svn/'
to classloader
[junit4] 2> 2564247 T9529 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/collection1/lib/classes/'
to classloader
[junit4] 2> 2564248 T9529 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/collection1/lib/README'
to classloader
[junit4] 2> 2564289 T9529 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 2564295 T9529 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 2564337 T9529 oasc.SolrConfig.<init> Using Lucene
MatchVersion: 5.0.0
[junit4] 2> 2564395 T9529 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 2564398 T9529 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 2564407 T9529 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 2564829 T9529 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 2564832 T9529 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2564834 T9529 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2564840 T9529 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2564915 T9529 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection control_collection
[junit4] 2> 2564915 T9529 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 2564916 T9529 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-002/collection1/,
dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data/
[junit4] 2> 2564917 T9529 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@18dee2d0
[junit4] 2> 2564919 T9529 oasc.CachingDirectoryFactory.get return new
directory for
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data
[junit4] 2> 2564920 T9529 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data/index/
[junit4] 2> 2564920 T9529 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data/index'
doesn't exist. Creating new index...
[junit4] 2> 2564921 T9529 oasc.CachingDirectoryFactory.get return new
directory for
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data/index
[junit4] 2> 2564922 T9529 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=43, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=69.8681640625,
floorSegmentMB=1.12109375, forceMergeDeletesPctAllowed=19.680193740013998,
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2564926 T9529 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2564927 T9529 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2564933 T9529 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 2564934 T9529 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 2564934 T9529 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2564935 T9529 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 2564935 T9529 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2564936 T9529 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2564936 T9529 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2564937 T9529 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 2564937 T9529 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2564939 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2564940 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2564940 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2564941 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2564941 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2564942 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 2564943 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 2564944 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 2564944 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 2564946 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 2564948 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 2564948 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 2564949 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 2564949 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 2564950 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 2564951 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 2564952 T9529 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 2564952 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2564953 T9529 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2564969 T9529 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2564970 T9529 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2564972 T9529 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2564975 T9529 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2564979 T9529 oasc.SolrCore.initStatsCache Using default
statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2564981 T9529 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 2564981 T9529 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 2564982 T9529 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=28, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=86.4443359375,
floorSegmentMB=0.6728515625, forceMergeDeletesPctAllowed=1.1209794571015208,
segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.5648746974196173
[junit4] 2> 2564983 T9529 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2564984 T9529 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2564984 T9529 oass.SolrIndexSearcher.<init> Opening
Searcher@761d1ef6[collection1] main
[junit4] 2> 2564984 T9529 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 2564988 T9529 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 2564989 T9529 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2564992 T9529
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2564992 T9529 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 2564993 T9529 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2564995 T9529
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2564995 T9529 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2564996 T9529 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 2564997 T9529 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 2564998 T9530 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@761d1ef6[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2565000 T9529 oasc.CoreContainer.registerCore registering
core: collection1
[junit4] 2> 2565003 T9533 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:58238 collection:control_collection
shard:shard1
[junit4] 2> 2565004 T9499 oass.SolrDispatchFilter.init
user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2565004 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 2565005 T9533 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2565005 T9499
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2565007 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2565014 T9536 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@23f58a7c
name:ZooKeeperConnection Watcher:127.0.0.1:58235/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2565015 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2565015 T9499 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2565019 T9499
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2565023 T9533 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 2565027 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2565030 T9533
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 2565030 T9533 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2683 name=collection1
org.apache.solr.core.SolrCore@36960e58 url=http://127.0.0.1:58238/collection1
node=127.0.0.1:58238_ C2683_STATE=coll:control_collection core:collection1
props:{core=collection1, base_url=http://127.0.0.1:58238,
node_name=127.0.0.1:58238_, state=down}
[junit4] 2> 2565030 T9533 C2683 P58238 oasc.SyncStrategy.sync Sync
replicas to http://127.0.0.1:58238/collection1/
[junit4] 2> 2565030 T9499 oasc.ChaosMonkey.monkeyLog monkey: init - expire
sessions:false cause connection loss:false
[junit4] 2> 2565030 T9533 C2683 P58238 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 2565031 T9533 C2683 P58238 oasc.SyncStrategy.syncToMe
http://127.0.0.1:58238/collection1/ has no replicas
[junit4] 2> 2565032 T9533 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:58238/collection1/ shard1
[junit4] 2> 2565032 T9533 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leaders/shard1
[junit4] 2> 2565034 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state
version: 1
[junit4] 2> 2565037 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2565041 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2565061 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:58238";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 2565068 T9537 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2565072 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2565112 T9533 oasc.ZkController.register We are
http://127.0.0.1:58238/collection1/ and leader is
http://127.0.0.1:58238/collection1/
[junit4] 2> 2565113 T9533 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:58238
[junit4] 2> 2565113 T9533 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 2565113 T9533 oasc.ZkController.publish publishing
core=collection1 state=active collection=control_collection
[junit4] 2> 2565114 T9533 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2565122 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2565135 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:58238";,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:58238_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active"} current state version: 3
[junit4] 2> 2565136 T9526 oasco.ReplicaMutator.updateState Update state
numShards=3 message={
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:58238";,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:58238_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active"}
[junit4] 2> 2565245 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2565245 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2566841 T9499 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 1
[junit4] 2> 2566842 T9499 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2566845 T9499 oejs.AbstractConnector.doStart Started
[email protected]:58242
[junit4] 2> 2566846 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@5ac524dd
[junit4] 2> 2566847 T9499 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2566847 T9499 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003
[junit4] 2> 2566847 T9499 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/'
[junit4] 2> 2566913 T9499 oasc.ConfigSolr.fromFile Loading container
configuration from
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/solr.xml
[junit4] 2> 2567007 T9499 oasc.CoreContainer.<init> New CoreContainer
693057563
[junit4] 2> 2567009 T9499 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/]
[junit4] 2> 2567012 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2567012 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2567012 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2567013 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2567013 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2567013 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2567014 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2567014 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2567014 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2567014 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2567015 T9499 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2567015 T9499 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2567016 T9499 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2567016 T9499 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2567017 T9499 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:58235/solr
[junit4] 2> 2567017 T9499 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2567018 T9499
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2567020 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2567024 T9549 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1d82f65f
name:ZooKeeperConnection Watcher:127.0.0.1:58235 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2567026 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2567027 T9499 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2567033 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2567039 T9552 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@61923d5b
name:ZooKeeperConnection Watcher:127.0.0.1:58235/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2567039 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2567064 T9499
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2568081 T9499 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58242_
[junit4] 2> 2568085 T9499 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:58242_
[junit4] 2> 2568104 T9499 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2568117 T9553 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 2568117 T9553 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2568120 T9553 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 2568120 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2568124 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58242";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58242_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down"} current state version: 4
[junit4] 2> 2568126 T9526 oasco.ReplicaMutator.updateState Update state
numShards=3 message={
[junit4] 2> "roles":null,
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58242";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58242_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down"}
[junit4] 2> 2568126 T9526 oasco.ClusterStateMutator.createCollection
building a new cName: collection1
[junit4] 2> 2568126 T9526 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard2
[junit4] 2> 2568130 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2568130 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2568130 T9552 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2569121 T9553 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 2569122 T9553 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 2569124 T9553 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 2569124 T9553 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2569126 T9553 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2569127 T9553 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/collection1/'
[junit4] 2> 2569128 T9553 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/collection1/lib/.svn/'
to classloader
[junit4] 2> 2569129 T9553 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/collection1/lib/classes/'
to classloader
[junit4] 2> 2569129 T9553 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/collection1/lib/README'
to classloader
[junit4] 2> 2569219 T9553 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 2569228 T9553 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 2569282 T9553 oasc.SolrConfig.<init> Using Lucene
MatchVersion: 5.0.0
[junit4] 2> 2569329 T9553 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 2569333 T9553 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 2569343 T9553 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 2569780 T9553 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 2569783 T9553 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2569785 T9553 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2569791 T9553 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2569870 T9553 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 2569870 T9553 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 2569870 T9553 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-003/collection1/,
dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1/
[junit4] 2> 2569870 T9553 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@18dee2d0
[junit4] 2> 2569873 T9553 oasc.CachingDirectoryFactory.get return new
directory for
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1
[junit4] 2> 2569874 T9553 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1/index/
[junit4] 2> 2569875 T9553 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1/index'
doesn't exist. Creating new index...
[junit4] 2> 2569877 T9553 oasc.CachingDirectoryFactory.get return new
directory for
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1/index
[junit4] 2> 2569877 T9553 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=43, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=69.8681640625,
floorSegmentMB=1.12109375, forceMergeDeletesPctAllowed=19.680193740013998,
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2569882 T9553 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2569882 T9553 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2569891 T9553 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 2569892 T9553 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 2569893 T9553 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2569893 T9553 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 2569893 T9553 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2569894 T9553 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2569894 T9553 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2569895 T9553 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 2569895 T9553 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2569897 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2569897 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2569898 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2569899 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2569900 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2569901 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 2569904 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 2569905 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 2569906 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 2569911 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 2569912 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 2569912 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 2569913 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 2569914 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 2569915 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 2569917 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 2569918 T9553 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 2569920 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2569921 T9553 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2569937 T9553 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2569938 T9553 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2569941 T9553 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2569943 T9553 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2569945 T9553 oasc.SolrCore.initStatsCache Using default
statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2569947 T9553 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 2569948 T9553 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 2569949 T9553 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=28, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=86.4443359375,
floorSegmentMB=0.6728515625, forceMergeDeletesPctAllowed=1.1209794571015208,
segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.5648746974196173
[junit4] 2> 2569950 T9553 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2569951 T9553 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2569951 T9553 oass.SolrIndexSearcher.<init> Opening
Searcher@19c6f1dd[collection1] main
[junit4] 2> 2569951 T9553 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2569954 T9553 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2569955 T9553 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2569956 T9553
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2569956 T9553 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 2569956 T9553 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2569958 T9553
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2569958 T9553 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2569959 T9553 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 2569959 T9553 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 2569961 T9554 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@19c6f1dd[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2569962 T9553 oasc.CoreContainer.registerCore registering
core: collection1
[junit4] 2> 2569963 T9557 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:58242 collection:collection1
shard:shard2
[junit4] 2> 2569965 T9499 oass.SolrDispatchFilter.init
user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2569965 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 2569966 T9557 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leader_elect/shard2/election
[junit4] 2> 2569982 T9557 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard2
[junit4] 2> 2569989 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2569990 T9557
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 2569991 T9557 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2684 name=collection1
org.apache.solr.core.SolrCore@5c9d45b1 url=http://127.0.0.1:58242/collection1
node=127.0.0.1:58242_ C2684_STATE=coll:collection1 core:collection1
props:{core=collection1, base_url=http://127.0.0.1:58242,
node_name=127.0.0.1:58242_, state=down}
[junit4] 2> 2569991 T9557 C2684 P58242 oasc.SyncStrategy.sync Sync
replicas to http://127.0.0.1:58242/collection1/
[junit4] 2> 2569991 T9557 C2684 P58242 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 2569992 T9557 C2684 P58242 oasc.SyncStrategy.syncToMe
http://127.0.0.1:58242/collection1/ has no replicas
[junit4] 2> 2569992 T9557 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:58242/collection1/ shard2
[junit4] 2> 2569992 T9557 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard2
[junit4] 2> 2570005 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 2570011 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570011 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570021 T9552 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570022 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58242";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 2570030 T9537 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2570033 T9558 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570045 T9559 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570107 T9557 oasc.ZkController.register We are
http://127.0.0.1:58242/collection1/ and leader is
http://127.0.0.1:58242/collection1/
[junit4] 2> 2570107 T9557 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:58242
[junit4] 2> 2570107 T9557 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 2570108 T9557 oasc.ZkController.publish publishing
core=collection1 state=active collection=collection1
[junit4] 2> 2570108 T9557 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2570112 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2570115 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard2",
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:58242";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58242_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active"} current state version: 7
[junit4] 2> 2570117 T9526 oasco.ReplicaMutator.updateState Update state
numShards=3 message={
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard2",
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:58242";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58242_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active"}
[junit4] 2> 2570229 T9559 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570229 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2570230 T9558 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2571845 T9499 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 2
[junit4] 2> 2571845 T9499 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2571851 T9499 oejs.AbstractConnector.doStart Started
[email protected]:58245
[junit4] 2> 2571852 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@5ac524dd
[junit4] 2> 2571852 T9499 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2571853 T9499 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004
[junit4] 2> 2571853 T9499 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/'
[junit4] 2> 2571898 T9499 oasc.ConfigSolr.fromFile Loading container
configuration from
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/solr.xml
[junit4] 2> 2571992 T9499 oasc.CoreContainer.<init> New CoreContainer
1510458769
[junit4] 2> 2571993 T9499 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/]
[junit4] 2> 2571994 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 2571995 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 2571996 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 2571997 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 2571997 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 2571998 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 2571998 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 2571999 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 2571999 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 2571999 T9499 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 2572000 T9499 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2572000 T9499 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2572001 T9499 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2572001 T9499 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2572001 T9499 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:58235/solr
[junit4] 2> 2572002 T9499 oasc.ZkController.checkChrootPath zkHost
includes chroot
[junit4] 2> 2572002 T9499
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 2572003 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2572009 T9571 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@6fe84463
name:ZooKeeperConnection Watcher:127.0.0.1:58235 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2572011 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2572012 T9499 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 2572019 T9499 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 2572023 T9574 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@783a49e3
name:ZooKeeperConnection Watcher:127.0.0.1:58235/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2572024 T9499 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 2572043 T9499
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 2573058 T9499 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58245_
[junit4] 2> 2573062 T9499 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:58245_
[junit4] 2> 2573078 T9499 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2573094 T9575 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 2573094 T9575 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2573097 T9575 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 2573097 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2573103 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58245";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58245_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down"} current state version: 8
[junit4] 2> 2573105 T9526 oasco.ReplicaMutator.updateState Update state
numShards=3 message={
[junit4] 2> "roles":null,
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58245";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58245_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down"}
[junit4] 2> 2573106 T9526 oasco.ReplicaMutator.updateState Collection
already exists with numShards=3
[junit4] 2> 2573106 T9526 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard3
[junit4] 2> 2573111 T9574 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2573111 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2573111 T9558 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2573112 T9559 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2574098 T9575 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 2574098 T9575 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 2574101 T9575 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 2574102 T9575 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2574109 T9575 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2574109 T9575 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/collection1/'
[junit4] 2> 2574112 T9575 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/collection1/lib/.svn/'
to classloader
[junit4] 2> 2574113 T9575 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/collection1/lib/classes/'
to classloader
[junit4] 2> 2574115 T9575 oasc.SolrResourceLoader.replaceClassLoader
Adding
'file:/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/collection1/lib/README'
to classloader
[junit4] 2> 2574162 T9575 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 2574173 T9575 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 2574228 T9575 oasc.SolrConfig.<init> Using Lucene
MatchVersion: 5.0.0
[junit4] 2> 2574293 T9575 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 2574298 T9575 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 2574310 T9575 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 2574754 T9575 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 2574757 T9575 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2574758 T9575 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2574767 T9575 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 2574850 T9575 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 2574851 T9575 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 2574851 T9575 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-004/collection1/,
dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2/
[junit4] 2> 2574852 T9575 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@18dee2d0
[junit4] 2> 2574854 T9575 oasc.CachingDirectoryFactory.get return new
directory for
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2
[junit4] 2> 2574854 T9575 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2/index/
[junit4] 2> 2574855 T9575 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2/index'
doesn't exist. Creating new index...
[junit4] 2> 2574857 T9575 oasc.CachingDirectoryFactory.get return new
directory for
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2/index
[junit4] 2> 2574857 T9575 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=43, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=69.8681640625,
floorSegmentMB=1.12109375, forceMergeDeletesPctAllowed=19.680193740013998,
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2574862 T9575 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2574863 T9575 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2574870 T9575 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 2574871 T9575 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 2574871 T9575 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2574872 T9575 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 2574872 T9575 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2574872 T9575 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2574873 T9575 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2574874 T9575 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 2574874 T9575 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2574875 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2574876 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2574876 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2574877 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2574877 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2574879 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 2574884 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 2574885 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 2574885 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 2574886 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 2574887 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 2574888 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 2574888 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 2574889 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 2574889 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 2574890 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 2574891 T9575 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 2574891 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2574892 T9575 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2574907 T9575 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2574909 T9575 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2574911 T9575 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2574913 T9575 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2574917 T9575 oasc.SolrCore.initStatsCache Using default
statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2574919 T9575 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 2574919 T9575 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 2574921 T9575 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=28, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=86.4443359375,
floorSegmentMB=0.6728515625, forceMergeDeletesPctAllowed=1.1209794571015208,
segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.5648746974196173
[junit4] 2> 2574923 T9575 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2574923 T9575 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 2574924 T9575 oass.SolrIndexSearcher.<init> Opening
Searcher@26b1241f[collection1] main
[junit4] 2> 2574924 T9575 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 2574928 T9575 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 2574929 T9575 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2574930 T9575
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2574930 T9575 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 2574930 T9575 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2574931 T9575
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2574932 T9575 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2574932 T9575 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 2574932 T9575 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 2574934 T9576 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@26b1241f[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2574935 T9575 oasc.CoreContainer.registerCore registering
core: collection1
[junit4] 2> 2574937 T9579 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:58245 collection:collection1
shard:shard3
[junit4] 2> 2574939 T9499 oass.SolrDispatchFilter.init
user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2574940 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 2574941 T9579 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leader_elect/shard3/election
[junit4] 2> 2574952 T9579 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard3
[junit4] 2> 2574957 T9579
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 2574958 T9579 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2685 name=collection1
org.apache.solr.core.SolrCore@4bb4078e url=http://127.0.0.1:58245/collection1
node=127.0.0.1:58245_ C2685_STATE=coll:collection1 core:collection1
props:{core=collection1, base_url=http://127.0.0.1:58245,
node_name=127.0.0.1:58245_, state=down}
[junit4] 2> 2574958 T9579 C2685 P58245 oasc.SyncStrategy.sync Sync
replicas to http://127.0.0.1:58245/collection1/
[junit4] 2> 2574958 T9579 C2685 P58245 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 2574959 T9579 C2685 P58245 oasc.SyncStrategy.syncToMe
http://127.0.0.1:58245/collection1/ has no replicas
[junit4] 2> 2574959 T9579 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:58245/collection1/ shard3
[junit4] 2> 2574959 T9579 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard3
[junit4] 2> 2574970 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2574972 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1"} current state version: 9
[junit4] 2> 2574977 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2574981 T9559 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2574981 T9558 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2574990 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:58245";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 10
[junit4] 2> 2574992 T9574 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575004 T9537 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2575004 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575004 T9552 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575020 T9580 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575072 T9579 oasc.ZkController.register We are
http://127.0.0.1:58245/collection1/ and leader is
http://127.0.0.1:58245/collection1/
[junit4] 2> 2575073 T9579 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:58245
[junit4] 2> 2575074 T9579 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 2575074 T9579 oasc.ZkController.publish publishing
core=collection1 state=active collection=collection1
[junit4] 2> 2575075 T9579 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 2575079 T9525 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2575082 T9526 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard3",
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "base_url":"http://127.0.0.1:58245";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58245_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active"} current state version: 11
[junit4] 2> 2575084 T9526 oasco.ReplicaMutator.updateState Update state
numShards=3 message={
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard3",
[junit4] 2> "numShards":"3",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "base_url":"http://127.0.0.1:58245";,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:58245_",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active"}
[junit4] 2> 2575195 T9525 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575195 T9580 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575196 T9536 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2575195 T9552 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2576774 T9499 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 3
[junit4] 2> 2576775 T9499 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2576779 T9499 oejs.AbstractConnector.doStart Started
[email protected]:58248
[junit4] 2> 2576779 T9499 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@5ac524dd
[junit4] 2> 2576781 T9499 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 2576781 T9499 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-005
[junit4] 2> 2576781 T9499 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-005/'
[junit4] 2> 2576830 T9499 oasc.ConfigSolr.fromFile Loading container
configuration from
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tempDir-005/solr.xml
[junit4] 2> 2576914 T9499 oasc.CoreContainer.<init> New CoreContainer
1864187122
[junit4] 2> 2576915 T9499 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3301BB78F341D7A1-001/tem
[...truncated too long message...]
der.java:101)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2> 23) Thread[id=9617,
name=searcherExecutor-5305-thread-1, state=WAITING,
group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 24) Thread[id=9598, name=Thread-4004, state=WAITING,
group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at
org.apache.solr.core.CloserThread.run(CoreContainer.java:929)
[junit4] 2> 25) Thread[id=10464, name=zkCallback-1218-thread-115,
state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4] 2> at
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4] 2> at
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50),
sim=DefaultSimilarity, locale=ga, timezone=Europe/Vatican
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_67
(64-bit)/cpus=2,threads=30,free=265155720,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestShardHandlerFactory,
TestFieldTypeCollectionResource, TestSystemIdResolver, PingRequestHandlerTest,
HighlighterTest, TestConfigOverlay, TestPostingsSolrHighlighter,
SoftAutoCommitTest, JSONWriterTest, DocValuesMissingTest, PrimUtilsTest,
UnloadDistributedZkTest, TestReplicationHandler,
FieldAnalysisRequestHandlerTest, TestReplicaProperties,
TestSolrDeletionPolicy2, TestStandardQParsers, TestFieldCollectionResource,
SimplePostToolTest, TestDistribDocBasedVersion, TestInfoStreamLogging,
AssignTest, TestCollapseQParserPlugin, TestPerFieldSimilarity, SampleTest,
TestCoreContainer, CollectionsAPIDistributedZkTest,
TestManagedSchemaFieldTypeResource, TestDistributedGrouping, TestCSVLoader,
RankQueryTest, PluginInfoTest, SpatialFilterTest, TestSort, TestDynamicLoading,
CacheHeaderTest, HdfsChaosMonkeySafeLeaderTest, TestBinaryResponseWriter,
QueryElevationComponentTest, DirectSolrSpellCheckerTest, ScriptEngineTest,
PrimitiveFieldTypeTest, TestManagedSchemaFieldResource, TestDocSet,
TestFieldSortValues, MultiThreadedOCPTest, TestSearcherReuse,
MergeStrategyTest, TestTolerantSearch, SpellCheckComponentTest,
TestFoldingMultitermQuery, TestQueryUtils, TestSearchPerf, TestMissingGroups,
LoggingHandlerTest, TestSolrDynamicMBean, TestJoin, NotRequiredUniqueKeyTest,
FastVectorHighlighterTest, DefaultValueUpdateProcessorTest,
TestDefaultSimilarityFactory, TestOmitPositions, SOLR749Test,
CSVRequestHandlerTest, TestCollationFieldDocValues, SliceStateTest,
TestDistributedMissingSort, ShardSplitTest, TestConfig, TestSchemaNameResource,
TestDocumentBuilder, TestRealTimeGet, BinaryUpdateRequestHandlerTest,
TestCollectionAPI, AlternateDirectoryTest, SuggesterTSTTest,
TestSolrXmlPersistence, TestQuerySenderNoQuery, SortByFunctionTest,
IndexSchemaTest, TestRangeQuery, TestDistributedSearch, TestStressLucene,
TestNonDefinedSimilarityFactory, QueryParsingTest, HdfsBasicDistributedZk2Test,
TestIBSimilarityFactory, DocExpirationUpdateProcessorFactoryTest,
NumericFieldsTest, TestAddFieldRealTimeGet, TestSchemaVersionResource,
ExitableDirectoryReaderTest, ConnectionManagerTest,
OutOfBoxZkACLAndCredentialsProvidersTest, SolrIndexConfigTest,
SSLMigrationTest, TimeZoneUtilsTest, TestCopyFieldCollectionResource,
OutputWriterTest, DistributedDebugComponentTest, WordBreakSolrSpellCheckerTest,
SystemInfoHandlerTest, SolrCoreTest, TestQuerySenderListener,
TestSolrConfigHandler, RegexBoostProcessorTest, HighlighterMaxOffsetTest,
TestJmxIntegration, TestExpandComponent, TestChildDocTransformer,
ResponseLogComponentTest, ChaosMonkeyNothingIsSafeTest, ChangedSchemaMergeTest,
PreAnalyzedUpdateProcessorTest, ConvertedLegacyTest,
DistributedQueryComponentCustomSortTest, LegacyHTMLStripCharFilterTest,
TestMergePolicyConfig, TestCoreDiscovery, TestStressUserVersions,
DeleteReplicaTest, TestHashPartitioner, DocValuesTest, UpdateParamsTest,
TestLRUStatsCache, TestUniqueKeyFieldResource, DistributedSuggestComponentTest,
QueryResultKeyTest, TestCodecSupport, TestIndexingPerformance, EchoParamsTest,
ShardRoutingCustomTest, ExternalCollectionsTest, TestIndexSearcher,
TestRemoteStreaming, TestSolr4Spatial2, ResourceLoaderTest, TestSchemaManager,
EnumFieldTest, TestSolrQueryParserResource, TestNoOpRegenerator,
ZkNodePropsTest, PathHierarchyTokenizerFactoryTest,
TestReversedWildcardFilterFactory, TermsComponentTest, RollingRestartTest,
TestFileDictionaryLookup, SpellCheckCollatorTest, SolrRequestParserTest,
AnalyticsQueryTest, DistributedQueryComponentOptimizationTest,
TestFastLRUCache, TestRequestStatusCollectionAPI, TestGroupingSearch,
RequestHandlersTest, TestStressReorder, TestManagedStopFilterFactory,
TestDocBasedVersionConstraints, DistributedFacetPivotWhiteBoxTest,
PeerSyncTest, SimpleFacetsTest, OverseerTest, TestFieldTypeResource,
CopyFieldTest, URLClassifyProcessorTest, TestFunctionQuery,
TestCloudSchemaless, ZkCLITest, SpellingQueryConverterTest, TestNonNRTOpen,
CoreAdminRequestStatusTest, SearchHandlerTest,
DistributedSpellCheckComponentTest, TestFaceting, ResponseHeaderTest,
HdfsBasicDistributedZkTest, TestStressVersions, MinimalSchemaTest,
TestSchemaSimilarityResource, CurrencyFieldOpenExchangeTest,
TestSolrQueryParserDefaultOperatorResource, TestComponentsName,
AliasIntegrationTest, IndexSchemaRuntimeFieldTest, TestDFRSimilarityFactory,
ZkSolrClientTest, HdfsWriteToMultipleCollectionsTest,
TestShortCircuitedRequests, TestSolrConfigHandlerCloud,
UUIDUpdateProcessorFallbackTest, HttpPartitionTest,
SpellPossibilityIteratorTest, TestMaxScoreQueryParser,
TestAtomicUpdateErrorCases, TestUtils, TestBM25SimilarityFactory,
DateFieldTest, TestSolr4Spatial, DistributedQueueTest, TestSolrQueryParser,
AddBlockUpdateTest, ZkStateWriterTest, TestCSVResponseWriter, UUIDFieldTest,
CoreMergeIndexesAdminHandlerTest, AnalysisErrorHandlingTest,
TestClassNameShortening, OpenExchangeRatesOrgProviderTest, TestBulkSchemaAPI,
TestExactSharedStatsCache, SharedFSAutoReplicaFailoverTest, InfoHandlerTest,
TestAnalyzedSuggestions, BasicFunctionalityTest, TestImplicitCoreProperties,
ShardRoutingTest, TestPseudoReturnFields, SimpleMLTQParserTest,
SharedFSAutoReplicaFailoverUtilsTest, TestHighlightDedupGrouping,
TestBadConfig, HdfsLockFactoryTest, BasicDistributedZkTest,
ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=3301BB78F341D7A1
-Dtests.slow=true -Dtests.locale=ga -Dtests.timezone=Europe/Vatican
-Dtests.asserts=false -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>=
7200000 msec).
[junit4] > at
__randomizedtesting.SeedInfo.seed([3301BB78F341D7A1]:0)
[junit4] Completed in 7224.63s, 1 test, 2 errors <<< FAILURES!
[...truncated 694 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:529: The following
error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:477: The following
error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:61: The following
error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/extra-targets.xml:39: The
following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build.xml:190: The
following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/common-build.xml:508: The
following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:1363:
The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:970:
There were test failures: 458 suites, 1859 tests, 1 suite-level error, 1 error,
879 ignored (15 assumptions)
Total time: 207 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0
-XX:-UseCompressedOops -XX:+UseG1GC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
