Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11928/
Java: 32bit/jdk1.8.0_40-ea-b22 -client -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test
Error Message:
There were too many update fails - we expect it can happen, but shouldn't easily
Stack Trace:
java.lang.AssertionError: There were too many update fails - we expect it can
happen, but shouldn't easily
at
__randomizedtesting.SeedInfo.seed([64ADBFEEB3B8D0AE:ECF980341D44BD56]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:222)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:958)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:933)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9198 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/init-core-data-001
[junit4] 2> 203010 T1104 oas.BaseDistributedSearchTestCase.initHostContext
Setting hostContext system property: /zm_kby/
[junit4] 2> 203014 T1104 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 203015 T1105 oasc.ZkTestServer$ZKServerMain.runFromConfig
Starting server
[junit4] 2> 203114 T1104 oasc.ZkTestServer.run start zk server on
port:53570
[junit4] 2> 203115 T1104
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 203116 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 203119 T1112 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@8b7484 name:ZooKeeperConnection
Watcher:127.0.0.1:53570 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 203120 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 203121 T1104 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 203121 T1104 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 203126 T1104
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 203127 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 203129 T1115 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@277c85 name:ZooKeeperConnection
Watcher:127.0.0.1:53570/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 203130 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 203131 T1104 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 203131 T1104 oascc.SolrZkClient.makePath makePath:
/collections/collection1
[junit4] 2> 203134 T1104 oascc.SolrZkClient.makePath makePath:
/collections/collection1/shards
[junit4] 2> 203136 T1104 oascc.SolrZkClient.makePath makePath:
/collections/control_collection
[junit4] 2> 203138 T1104 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/shards
[junit4] 2> 203141 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 203141 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.xml
[junit4] 2> 203144 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 203145 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/schema.xml
[junit4] 2> 203148 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 203148 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 203150 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 203151 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/stopwords.txt
[junit4] 2> 203153 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 203154 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/protwords.txt
[junit4] 2> 203156 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 203156 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/currency.xml
[junit4] 2> 203158 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 203159 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/enumsConfig.xml
[junit4] 2> 203161 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 203161 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/open-exchange-rates.json
[junit4] 2> 203163 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 203164 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 203166 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 203166 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/old_synonyms.txt
[junit4] 2> 203168 T1104 oasc.AbstractZkTestCase.putConfig put
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 203168 T1104 oascc.SolrZkClient.makePath makePath:
/configs/conf1/synonyms.txt
[junit4] 2> 203516 T1104 oas.SolrTestCaseJ4.writeCoreProperties Writing
core.properties file to
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1
[junit4] 2> 203518 T1104 oejs.Server.doStart jetty-9.2.9.v20150224
[junit4] 2> 203520 T1104 oejsh.ContextHandler.doStart Started
o.e.j.s.ServletContextHandler@7911bd{/zm_kby,null,AVAILABLE}
[junit4] 2> 203536 T1104 oejs.AbstractConnector.doStart Started
ServerConnector@6be5a4{HTTP/1.1}{127.0.0.1:49969}
[junit4] 2> 203537 T1104 oejs.Server.doStart Started @204634ms
[junit4] 2> 203537 T1104 oascse.JettySolrRunner$1.lifeCycleStarted Jetty
properties:
{solr.data.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/tempDir-001/control/data, hostContext=/zm_kby,
hostPort=49969,
coreRootDirectory=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores}
[junit4] 2> 203538 T1104 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@e2f2a
[junit4] 2> 203539 T1104 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/'
[junit4] 2> 203567 T1104 oasc.SolrXmlConfig.fromFile Loading container
configuration from
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/solr.xml
[junit4] 2> 203578 T1104 oasc.CorePropertiesLocator.<init> Config-defined
core root directory:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores
[junit4] 2> 203579 T1104 oasc.CoreContainer.<init> New CoreContainer
24603738
[junit4] 2> 203579 T1104 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/]
[junit4] 2> 203580 T1104 oasc.CoreContainer.load loading shared library:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/lib
[junit4] 2> 203580 T1104 oasc.SolrResourceLoader.addToClassLoader WARN
Can't find (or read) directory to add to classloader: lib (resolved as:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/lib).
[junit4] 2> 203594 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 203595 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 203595 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 203596 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 203596 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 203597 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 203597 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 203598 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 203598 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 203598 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 203599 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting useRetries to: false
[junit4] 2> 203600 T1104 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 203600 T1104 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 203600 T1104 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 203601 T1104 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 203601 T1104 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:53570/solr
[junit4] 2> 203602 T1104 oasc.ZkController.checkChrootPath zkHost includes
chroot
[junit4] 2> 203602 T1104
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 203603 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 203604 T1129 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1a8a1bf name:ZooKeeperConnection
Watcher:127.0.0.1:53570 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 203605 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 203606 T1104 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 203607 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 203609 T1132 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@818bd name:ZooKeeperConnection
Watcher:127.0.0.1:53570/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 203609 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 203611 T1104 oascc.SolrZkClient.makePath makePath:
/overseer/queue
[junit4] 2> 203614 T1104 oascc.SolrZkClient.makePath makePath:
/overseer/collection-queue-work
[junit4] 2> 203616 T1104 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-running
[junit4] 2> 203619 T1104 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-completed
[junit4] 2> 203622 T1104 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-failure
[junit4] 2> 203625 T1104 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 203626 T1104 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49969_zm_kby
[junit4] 2> 203627 T1104 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:49969_zm_kby
[junit4] 2> 203630 T1104 oascc.SolrZkClient.makePath makePath:
/overseer_elect
[junit4] 2> 203632 T1104 oascc.SolrZkClient.makePath makePath:
/overseer_elect/election
[junit4] 2> 203633 T1104 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 203635 T1104 oasc.OverseerElectionContext.runLeaderProcess I
am going to be the leader 127.0.0.1:49969_zm_kby
[junit4] 2> 203636 T1104 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4] 2> 203637 T1104 oasc.Overseer.start Overseer
(id=93432470364422147-127.0.0.1:49969_zm_kby-n_0000000000) starting
[junit4] 2> 203639 T1104 oascc.SolrZkClient.makePath makePath:
/overseer/queue-work
[junit4] 2> 203644 T1104 oasc.OverseerAutoReplicaFailoverThread.<init>
Starting OverseerAutoReplicaFailoverThread
autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 203644 T1134 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4] 2> 203645 T1104 oascc.SolrZkClient.makePath makePath:
/clusterstate.json
[junit4] 2> 203645 T1133 oasc.Overseer$ClusterStateUpdater.run Starting to
work on the main queue
[junit4] 2> 203647 T1104 oascc.SolrZkClient.makePath makePath:
/aliases.json
[junit4] 2> 203648 T1104
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 203650 T1104 oasc.CorePropertiesLocator.discover Looking for
core definitions underneath
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores
[junit4] 1> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml,
transient=false, schema=schema.xml, loadOnStartup=true,
instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1,
collection=control_collection,
absoluteInstDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/, coreNodeName=,
dataDir=data/, shard=}
[junit4] 2> 203653 T1104 oasc.CorePropertiesLocator.discoverUnder Found
core collection1 in
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/
[junit4] 2> 203653 T1104 oasc.CorePropertiesLocator.discover Found 1 core
definitions
[junit4] 2> 203655 T1136 oasc.ZkController.publish publishing
core=collection1 state=down collection=control_collection
[junit4] 2> 203655 T1136 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 203656 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 203656 T1136 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 203657 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49969/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:49969_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 203658 T1133 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49969/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:49969_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 203658 T1133 oasco.ClusterStateMutator.createCollection
building a new cName: control_collection
[junit4] 2> 203658 T1133 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 203660 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 204657 T1136 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 204657 T1136 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:control_collection
[junit4] 2> 204658 T1136 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 204658 T1136 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 204659 T1136 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 204659 T1136 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/'
[junit4] 2> 204678 T1136 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 204680 T1136 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 204687 T1136 oasc.SolrConfig.refreshRequestParams current
version of requestparams : -1
[junit4] 2> 204694 T1136 oasc.SolrConfig.<init> Using Lucene MatchVersion:
6.0.0
[junit4] 2> 204707 T1136 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 204708 T1136 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 204730 T1136 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 204884 T1136 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 204886 T1136 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 204888 T1136 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 204891 T1136 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 204921 T1136 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection control_collection
[junit4] 2> 204921 T1136 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 204929 T1136 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/,
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data/
[junit4] 2> 204930 T1136 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@176ebbe
[junit4] 2> 204930 T1136 oasc.CachingDirectoryFactory.get return new
directory for
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data
[junit4] 2> 204931 T1136 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data/index/
[junit4] 2> 204931 T1136 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data/index' doesn't exist.
Creating new index...
[junit4] 2> 204931 T1136 oasc.CachingDirectoryFactory.get return new
directory for
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data/index
[junit4] 2> 204932 T1136 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=40, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=26.7861328125,
floorSegmentMB=0.896484375, forceMergeDeletesPctAllowed=6.056589345764992,
segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 204988 T1136 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 204988 T1136 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 204992 T1136 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 204992 T1136 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 204993 T1136 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 204993 T1136 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 204993 T1136 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 204993 T1136 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 204994 T1136 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 204994 T1136 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 204994 T1136 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 204995 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 204995 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 204996 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 204996 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 204997 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 204997 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 204998 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 204998 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 204999 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 205000 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 205001 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 205002 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 205002 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 205003 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 205003 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 205004 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 205004 T1136 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 205005 T1136 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 205007 T1136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 205008 T1136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 205009 T1136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 205010 T1136 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 205011 T1136 oasc.SolrCore.initStatsCache Using default
statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 205011 T1136 oasu.UpdateHandler.<init> Using UpdateLog
implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 205012 T1136 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 205012 T1136 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 205013 T1136 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=32, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=12.5263671875,
floorSegmentMB=1.5859375, forceMergeDeletesPctAllowed=29.255536249920798,
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 205013 T1136 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 205014 T1136 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 205014 T1136 oass.SolrIndexSearcher.<init> Opening
Searcher@1491e04[collection1] main
[junit4] 2> 205014 T1136 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 205015 T1136 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 205016 T1136 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 205016 T1136
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 205016 T1136 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 205017 T1136 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 205017 T1136
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 205018 T1136 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 205018 T1136 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 205018 T1136 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 205019 T1137 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@1491e04[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 205020 T1136 oasc.CoreContainer.registerCore registering core:
collection1
[junit4] 2> 205020 T1140 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:49969/zm_kby
collection:control_collection shard:shard1
[junit4] 2> 205021 T1104 oass.SolrDispatchFilter.init
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 205021 T1104 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 205022 T1104
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 205022 T1140 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leader_elect/shard1/election
[junit4] 2> 205022 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 205024 T1143 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@52cff8 name:ZooKeeperConnection
Watcher:127.0.0.1:53570/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 205024 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 205025 T1104 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 205025 T1104
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 205028 T1104 oasc.ChaosMonkey.monkeyLog monkey: init - expire
sessions:false cause connection loss:false
[junit4] 2> 205028 T1140 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 205033 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 205034 T1140
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 205034 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state
version: 1
[junit4] 2> 205035 T1140 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C139 name=collection1
org.apache.solr.core.SolrCore@169cc44
url=http://127.0.0.1:49969/zm_kby/collection1 node=127.0.0.1:49969_zm_kby
C139_STATE=coll:control_collection core:collection1 props:{core=collection1,
base_url=http://127.0.0.1:49969/zm_kby, node_name=127.0.0.1:49969_zm_kby,
state=down}
[junit4] 2> 205036 T1140 C139 P49969 oasc.SyncStrategy.sync Sync replicas
to http://127.0.0.1:49969/zm_kby/collection1/
[junit4] 2> 205036 T1140 C139 P49969 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 205040 T1140 C139 P49969 oasc.SyncStrategy.syncToMe
http://127.0.0.1:49969/zm_kby/collection1/ has no replicas
[junit4] 2> 205040 T1140 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:49969/zm_kby/collection1/ shard1
[junit4] 2> 205041 T1140 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leaders/shard1
[junit4] 2> 205046 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 205048 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:49969/zm_kby";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 205151 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 205151 T1143 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 205199 T1140 oasc.ZkController.register We are
http://127.0.0.1:49969/zm_kby/collection1/ and leader is
http://127.0.0.1:49969/zm_kby/collection1/
[junit4] 2> 205199 T1140 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:49969/zm_kby
[junit4] 2> 205199 T1140 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 205200 T1140 oasc.ZkController.publish publishing
core=collection1 state=active collection=control_collection
[junit4] 2> 205200 T1140 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 205202 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 205203 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49969/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:49969_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 205204 T1133 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49969/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:49969_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 205307 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 205307 T1143 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 205353 T1104 oas.SolrTestCaseJ4.writeCoreProperties Writing
core.properties file to
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1
[junit4] 2> 205355 T1104 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 1 in directory
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001
[junit4] 2> 205355 T1104 oejs.Server.doStart jetty-9.2.9.v20150224
[junit4] 2> 205357 T1104 oejsh.ContextHandler.doStart Started
o.e.j.s.ServletContextHandler@3f2b8d{/zm_kby,null,AVAILABLE}
[junit4] 2> 205358 T1104 oejs.AbstractConnector.doStart Started
ServerConnector@949837{HTTP/1.1}{127.0.0.1:43993}
[junit4] 2> 205358 T1104 oejs.Server.doStart Started @206455ms
[junit4] 2> 205359 T1104 oascse.JettySolrRunner$1.lifeCycleStarted Jetty
properties:
{solr.data.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/tempDir-001/jetty1, solrconfig=solrconfig.xml,
hostContext=/zm_kby, hostPort=43993,
coreRootDirectory=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores}
[junit4] 2> 205359 T1104 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@e2f2a
[junit4] 2> 205360 T1104 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/'
[junit4] 2> 205377 T1104 oasc.SolrXmlConfig.fromFile Loading container
configuration from
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/solr.xml
[junit4] 2> 205384 T1104 oasc.CorePropertiesLocator.<init> Config-defined
core root directory:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores
[junit4] 2> 205385 T1104 oasc.CoreContainer.<init> New CoreContainer
11204838
[junit4] 2> 205385 T1104 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/]
[junit4] 2> 205385 T1104 oasc.CoreContainer.load loading shared library:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/lib
[junit4] 2> 205386 T1104 oasc.SolrResourceLoader.addToClassLoader WARN
Can't find (or read) directory to add to classloader: lib (resolved as:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/lib).
[junit4] 2> 205399 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 205399 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 205399 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 205400 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 205400 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 205400 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 205401 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 205401 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 205401 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 205401 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 205402 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting useRetries to: false
[junit4] 2> 205402 T1104 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 205403 T1104 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 205403 T1104 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 205403 T1104 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 205404 T1104 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:53570/solr
[junit4] 2> 205404 T1104 oasc.ZkController.checkChrootPath zkHost includes
chroot
[junit4] 2> 205404 T1104
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 205405 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 205407 T1157 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@17bbcc4 name:ZooKeeperConnection
Watcher:127.0.0.1:53570 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 205407 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 205408 T1104 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 205411 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 205413 T1160 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@3df831 name:ZooKeeperConnection
Watcher:127.0.0.1:53570/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 205413 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 205420 T1104
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 206424 T1104 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43993_zm_kby
[junit4] 2> 206426 T1104 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:43993_zm_kby
[junit4] 2> 206429 T1104 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 206432 T1104 oasc.CorePropertiesLocator.discover Looking for
core definitions underneath
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores
[junit4] 1> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml,
transient=false, schema=schema.xml, loadOnStartup=true,
instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1, collection=collection1,
absoluteInstDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/, coreNodeName=,
dataDir=data/, shard=}
[junit4] 2> 206433 T1104 oasc.CorePropertiesLocator.discoverUnder Found
core collection1 in
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/
[junit4] 2> 206434 T1104 oasc.CorePropertiesLocator.discover Found 1 core
definitions
[junit4] 2> 206435 T1161 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 206436 T1161 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 206437 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 206437 T1161 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 206438 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:43993/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:43993_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 206439 T1133 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:43993/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:43993_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 206439 T1133 oasco.ClusterStateMutator.createCollection
building a new cName: collection1
[junit4] 2> 206439 T1133 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 206542 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 206543 T1160 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 206542 T1143 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 207437 T1161 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 207438 T1161 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 207438 T1161 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 207439 T1161 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 207439 T1161 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 207440 T1161 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/'
[junit4] 2> 207465 T1161 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 207468 T1161 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 207479 T1161 oasc.SolrConfig.refreshRequestParams current
version of requestparams : -1
[junit4] 2> 207487 T1161 oasc.SolrConfig.<init> Using Lucene MatchVersion:
6.0.0
[junit4] 2> 207505 T1161 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 207506 T1161 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 207530 T1161 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 207691 T1161 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 207694 T1161 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 207696 T1161 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 207700 T1161 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 207726 T1161 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 207727 T1161 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 207727 T1161 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/,
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data/
[junit4] 2> 207728 T1161 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@176ebbe
[junit4] 2> 207729 T1161 oasc.CachingDirectoryFactory.get return new
directory for
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data
[junit4] 2> 207729 T1161 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 207729 T1161 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data/index' doesn't exist.
Creating new index...
[junit4] 2> 207730 T1161 oasc.CachingDirectoryFactory.get return new
directory for
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 207730 T1161 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=40, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=26.7861328125,
floorSegmentMB=0.896484375, forceMergeDeletesPctAllowed=6.056589345764992,
segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 207741 T1161 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 207742 T1161 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 207748 T1161 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 207749 T1161 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 207749 T1161 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 207749 T1161 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 207749 T1161 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 207749 T1161 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 207750 T1161 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 207750 T1161 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 207750 T1161 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 207751 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 207752 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 207753 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 207753 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 207754 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 207755 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 207757 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 207758 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 207759 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 207760 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 207761 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 207762 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 207763 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 207764 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 207765 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 207767 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 207767 T1161 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 207768 T1161 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 207770 T1161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 207771 T1161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 207773 T1161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 207774 T1161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 207774 T1161 oasc.SolrCore.initStatsCache Using default
statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 207775 T1161 oasu.UpdateHandler.<init> Using UpdateLog
implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 207775 T1161 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 207776 T1161 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 207777 T1161 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=32, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=12.5263671875,
floorSegmentMB=1.5859375, forceMergeDeletesPctAllowed=29.255536249920798,
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 207778 T1161 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 207778 T1161 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 207778 T1161 oass.SolrIndexSearcher.<init> Opening
Searcher@cbb37e[collection1] main
[junit4] 2> 207779 T1161 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 207780 T1161 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 207780 T1161 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 207781 T1161
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 207781 T1161 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 207781 T1161 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 207782 T1161
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 207782 T1161 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 207783 T1161 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 207783 T1161 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 207785 T1162 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@cbb37e[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 207786 T1161 oasc.CoreContainer.registerCore registering core:
collection1
[junit4] 2> 207787 T1165 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:43993/zm_kby collection:collection1
shard:shard1
[junit4] 2> 207788 T1104 oass.SolrDispatchFilter.init
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 207788 T1104 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 207788 T1165 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 207795 T1165 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 207796 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 207797 T1165
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 207797 T1165 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C140 name=collection1
org.apache.solr.core.SolrCore@f4258d
url=http://127.0.0.1:43993/zm_kby/collection1 node=127.0.0.1:43993_zm_kby
C140_STATE=coll:collection1 core:collection1 props:{core=collection1,
base_url=http://127.0.0.1:43993/zm_kby, node_name=127.0.0.1:43993_zm_kby,
state=down}
[junit4] 2> 207797 T1165 C140 P43993 oasc.SyncStrategy.sync Sync replicas
to http://127.0.0.1:43993/zm_kby/collection1/
[junit4] 2> 207798 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 207798 T1165 C140 P43993 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 207798 T1165 C140 P43993 oasc.SyncStrategy.syncToMe
http://127.0.0.1:43993/zm_kby/collection1/ has no replicas
[junit4] 2> 207798 T1165 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:43993/zm_kby/collection1/ shard1
[junit4] 2> 207799 T1165 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard1
[junit4] 2> 207804 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 207805 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:43993/zm_kby";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 207908 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 207908 T1160 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 207909 T1143 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 207956 T1165 oasc.ZkController.register We are
http://127.0.0.1:43993/zm_kby/collection1/ and leader is
http://127.0.0.1:43993/zm_kby/collection1/
[junit4] 2> 207957 T1165 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:43993/zm_kby
[junit4] 2> 207957 T1165 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 207957 T1165 oasc.ZkController.publish publishing
core=collection1 state=active collection=collection1
[junit4] 2> 207957 T1165 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 207959 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 207960 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:43993/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:43993_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 5
[junit4] 2> 207961 T1133 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:43993/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:43993_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 208064 T1143 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 208064 T1160 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 208065 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 208091 T1104 oas.SolrTestCaseJ4.writeCoreProperties Writing
core.properties file to
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1
[junit4] 2> 208092 T1104 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 2 in directory
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001
[junit4] 2> 208092 T1104 oejs.Server.doStart jetty-9.2.9.v20150224
[junit4] 2> 208095 T1104 oejsh.ContextHandler.doStart Started
o.e.j.s.ServletContextHandler@b78637{/zm_kby,null,AVAILABLE}
[junit4] 2> 208095 T1104 oejs.AbstractConnector.doStart Started
ServerConnector@13825eb{HTTP/1.1}{127.0.0.1:52768}
[junit4] 2> 208096 T1104 oejs.Server.doStart Started @209193ms
[junit4] 2> 208096 T1104 oascse.JettySolrRunner$1.lifeCycleStarted Jetty
properties:
{solr.data.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/tempDir-001/jetty2, solrconfig=solrconfig.xml,
hostContext=/zm_kby, hostPort=52768,
coreRootDirectory=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores}
[junit4] 2> 208097 T1104 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@e2f2a
[junit4] 2> 208097 T1104 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/'
[junit4] 2> 208116 T1104 oasc.SolrXmlConfig.fromFile Loading container
configuration from
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/solr.xml
[junit4] 2> 208122 T1104 oasc.CorePropertiesLocator.<init> Config-defined
core root directory:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores
[junit4] 2> 208123 T1104 oasc.CoreContainer.<init> New CoreContainer 677480
[junit4] 2> 208123 T1104 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/]
[junit4] 2> 208124 T1104 oasc.CoreContainer.load loading shared library:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/lib
[junit4] 2> 208124 T1104 oasc.SolrResourceLoader.addToClassLoader WARN
Can't find (or read) directory to add to classloader: lib (resolved as:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/lib).
[junit4] 2> 208142 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 208142 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 208142 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 208143 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 208143 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 208143 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 208143 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 208144 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 208144 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 208144 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 208145 T1104 oashc.HttpShardHandlerFactory.getParameter
Setting useRetries to: false
[junit4] 2> 208145 T1104 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 208145 T1104 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 208146 T1104 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 208146 T1104 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 208146 T1104 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:53570/solr
[junit4] 2> 208147 T1104 oasc.ZkController.checkChrootPath zkHost includes
chroot
[junit4] 2> 208147 T1104
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 208148 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 208149 T1179 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@dbf7c0 name:ZooKeeperConnection
Watcher:127.0.0.1:53570 got event WatchedEvent state:SyncConnected type:None
path:null path:null type:None
[junit4] 2> 208150 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 208150 T1104 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 208152 T1104 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 208153 T1182 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@117d85b name:ZooKeeperConnection
Watcher:127.0.0.1:53570/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 208154 T1104 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 208159 T1104
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 209162 T1104 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52768_zm_kby
[junit4] 2> 209163 T1104 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:52768_zm_kby
[junit4] 2> 209167 T1104 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 209171 T1104 oasc.CorePropertiesLocator.discover Looking for
core definitions underneath
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores
[junit4] 1> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml,
transient=false, schema=schema.xml, loadOnStartup=true,
instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1, collection=collection1,
absoluteInstDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/, coreNodeName=,
dataDir=data/, shard=}
[junit4] 2> 209173 T1104 oasc.CorePropertiesLocator.discoverUnder Found
core collection1 in
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/
[junit4] 2> 209173 T1104 oasc.CorePropertiesLocator.discover Found 1 core
definitions
[junit4] 2> 209175 T1183 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 209175 T1183 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 209176 T1183 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 209176 T1132 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 209177 T1133 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52768/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:52768_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 6
[junit4] 2> 209178 T1133 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52768/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:52768_zm_kby",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 209178 T1133 oasco.ReplicaMutator.updateState Collection
already exists with numShards=1
[junit4] 2> 209178 T1133 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 209282 T1143 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 209282 T1160 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 209282 T1132 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 209282 T1182 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 210176 T1183 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 210178 T1183 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 210179 T1183 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 210180 T1183 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 210181 T1183 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 210182 T1183 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/'
[junit4] 2> 210211 T1183 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 210213 T1183 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 210223 T1183 oasc.SolrConfig.refreshRequestParams current
version of requestparams : -1
[junit4] 2> 210232 T1183 oasc.SolrConfig.<init> Using Lucene MatchVersion:
6.0.0
[junit4] 2> 210248 T1183 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 210250 T1183 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 210262 T1183 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 210377 T1183 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 210379 T1183 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 210380 T1183 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 210383 T1183 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 210403 T1183 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 210403 T1183 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 210404 T1183 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/,
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/
[junit4] 2> 210404 T1183 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@176ebbe
[junit4] 2> 210405 T1183 oasc.CachingDirectoryFactory.get return new
directory for
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data
[junit4] 2> 210405 T1183 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index/
[junit4] 2> 210405 T1183 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index' doesn't exist.
Creating new index...
[junit4] 2> 210406 T1183 oasc.CachingDirectoryFactory.get return new
directory for
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 210407 T1183 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=40, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=26.7861328125,
floorSegmentMB=0.896484375, forceMergeDeletesPctAllowed=6.056589345764992,
segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 210419 T1183 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 210419 T1183 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 210423 T1183 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 210424 T1183 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 210424 T1183 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 210424 T1183 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 210424 T1183 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 210425 T1183 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 210425 T1183 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 210425 T1183 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 210426 T1183 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 210427 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 210431 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 210432 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 210432 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 210433 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 210434 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 210435 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 210436 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 210437 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 210438 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 210439 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 210440 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 210441 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 210441 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 210442 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 210443 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 210444 T1183 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 210444 T1183 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 210446 T1183 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 210447 T1183 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 210448 T1183 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 210449 T1183 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 210450 T1183 oasc.SolrCore.initStatsCache Using default
statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 210450 T1183 oasu.UpdateHandler.<init> Using UpdateLog
implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 210451 T1183 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 210451 T1183 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 210452 T1183 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
[...truncated too long message...]
index.20150306132624177
[junit4] 2> 242218 T1218 oascc.ZkStateReader$3.process WARN ZooKeeper
watch triggered, but Solr cannot talk to ZK
[junit4] 2> 242220 T1104 oejs.AbstractConnector.doStop Stopped
ServerConnector@a62af4{HTTP/1.1}{127.0.0.1:43993}
[junit4] 2> 242221 T1104 oejsh.ContextHandler.doStop Stopped
o.e.j.s.ServletContextHandler@10de1ae{/zm_kby,null,UNAVAILABLE}
[junit4] 2> 242221 T1104 oasc.ChaosMonkey.monkeyLog monkey: stop shard!
52768
[junit4] 2> 242222 T1104 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=677480
[junit4] 2> 242222 T1104 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 242222 T1104 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 242223 T1199 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 242223 T1104 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@1ee3ded
[junit4] 2> 242224 T1104 oasc.ZkController.unRegisterConfListener a
listener was removed because of core close
[junit4] 2> 242224 T1235 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52768/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:52768_zm_kby",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 17
[junit4] 2> 242224 T1104 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=3,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=165,cumulative_deletesById=71,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=18821,transaction_logs_total_number=1}
[junit4] 2> 242225 T1235 oasco.ReplicaMutator.updateState Update state
numShards=null message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52768/zm_kby";,
[junit4] 2> "node_name":"127.0.0.1:52768_zm_kby",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 242225 T1104 oasu.SolrCoreState.decrefSolrCoreState Closing
SolrCoreState
[junit4] 2> 242225 T1104 oasu.DefaultSolrCoreState.closeIndexWriter
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 242226 T1104 oasu.DefaultSolrCoreState.closeIndexWriter
closing IndexWriter with IndexWriterCloser
[junit4] 2> 242226 T1199 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 242228 T1104 oasc.SolrCore.closeSearcher [collection1] Closing
main searcher on request.
[junit4] 2> 242237 T1104 oasc.CachingDirectoryFactory.close Closing
StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 242238 T1104 oasc.CachingDirectoryFactory.closeCacheValue
looking to close
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data
[CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data;done=false>>]
[junit4] 2> 242238 T1104 oasc.CachingDirectoryFactory.close Closing
directory:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data
[junit4] 2> 242239 T1104 oasc.CachingDirectoryFactory.closeCacheValue
looking to close
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index
[CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index;done=false>>]
[junit4] 2> 242239 T1104 oasc.CachingDirectoryFactory.close Closing
directory:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 242240 T1104 oasc.Overseer.close Overseer
(id=93432470364422152-127.0.0.1:52768_zm_kby-n_0000000002) closing
[junit4] 2> 242241 T1235 oasc.Overseer$ClusterStateUpdater.run Overseer
Loop exiting : 127.0.0.1:52768_zm_kby
[junit4] 2> 243742 T1199 oascc.ZkStateReader$3.process WARN ZooKeeper
watch triggered, but Solr cannot talk to ZK
[junit4] 2> 243745 T1104 oejs.AbstractConnector.doStop Stopped
ServerConnector@13825eb{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 243746 T1104 oejsh.ContextHandler.doStop Stopped
o.e.j.s.ServletContextHandler@b78637{/zm_kby,null,UNAVAILABLE}
[junit4] 2> 243747 T1104 oasc.ZkTestServer.send4LetterWord connecting to
127.0.0.1:53570 53570
[junit4] 2> 244315 T1105 oasc.ZkTestServer.send4LetterWord connecting to
127.0.0.1:53570 53570
[junit4] 2> 244317 T1105 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN
Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2
/solr/overseer_elect/election/93432470364422147-127.0.0.1:49969_zm_kby-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.method=test
-Dtests.seed=64ADBFEEB3B8D0AE -Dtests.multiplier=3 -Dtests.slow=true
-Dtests.locale=sr_RS_#Latn -Dtests.timezone=SystemV/EST5 -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[junit4] FAILURE 41.3s J0 | ChaosMonkeyNothingIsSafeTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: There were too many
update fails - we expect it can happen, but shouldn't easily
[junit4] > at
__randomizedtesting.SeedInfo.seed([64ADBFEEB3B8D0AE:ECF980341D44BD56]:0)
[junit4] > at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:222)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:958)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:933)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 244344 T1104 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest
64ADBFEEB3B8D0AE-001
[junit4] 2> NOTE: test params are: codec=Lucene50,
sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sr_RS_#Latn,
timezone=SystemV/EST5
[junit4] 2> NOTE: Linux 3.13.0-46-generic i386/Oracle Corporation
1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=138733656,total=227016704
[junit4] 2> NOTE: All tests run in this JVM: [UnloadDistributedZkTest,
PreAnalyzedUpdateProcessorTest, SuggestComponentTest, SyncSliceTest,
TestDistributedSearch, TestCollectionAPI, ZkCLITest, TestPhraseSuggestions,
TestIndexingPerformance, TestCustomSort, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed on J0 in 41.37s, 1 test, 1 failure <<< FAILURES!
[...truncated 1354 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:191: The
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:510:
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1351:
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:958:
There were test failures: 471 suites, 1872 tests, 1 failure, 48 ignored (21
assumptions)
Total time: 76 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b22 -client
-XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
