Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2388/
1 tests failed.
REGRESSION:
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
There were too many update fails - we expect it can happen, but shouldn't easily
Stack Trace:
java.lang.AssertionError: There were too many update fails - we expect it can
happen, but shouldn't easily
at
__randomizedtesting.SeedInfo.seed([22D23199875D3546:A334BF81F002557A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:223)
at
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9360 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/init-core-data-001
[junit4] 2> 846461 T1992 oas.BaseDistributedSearchTestCase.initHostContext
Setting hostContext system property: /
[junit4] 2> 846469 T1992 oas.SolrTestCaseJ4.setUp ###Starting
testDistribSearch
[junit4] 2> 846470 T1992 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 846471 T1993 oasc.ZkTestServer$ZKServerMain.runFromConfig
Starting server
[junit4] 2> 846571 T1992 oasc.ZkTestServer.run start zk server on
port:35206
[junit4] 2> 846572 T1992
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 846573 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 846577 T2000 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@10813dd6
name:ZooKeeperConnection Watcher:127.0.0.1:35206 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 846577 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 846577 T1992 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 846578 T1992 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 846581 T1992
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 846581 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 846583 T2003 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@235ac8ef
name:ZooKeeperConnection Watcher:127.0.0.1:35206/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 846583 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 846583 T1992 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 846583 T1992 oascc.SolrZkClient.makePath makePath:
/collections/collection1
[junit4] 2> 846585 T1992 oascc.SolrZkClient.makePath makePath:
/collections/collection1/shards
[junit4] 2> 846587 T1992 oascc.SolrZkClient.makePath makePath:
/collections/control_collection
[junit4] 2> 846588 T1992 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/shards
[junit4] 2> 846589 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 846590 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.xml
[junit4] 2> 846592 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 846593 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/schema.xml
[junit4] 2> 846695 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 846696 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 846698 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 846698 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/stopwords.txt
[junit4] 2> 846700 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 846701 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/protwords.txt
[junit4] 2> 846703 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 846703 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/currency.xml
[junit4] 2> 846705 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 846705 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/enumsConfig.xml
[junit4] 2> 846707 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 846708 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/open-exchange-rates.json
[junit4] 2> 846709 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 846710 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 846712 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 846713 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/old_synonyms.txt
[junit4] 2> 846714 T1992 oasc.AbstractZkTestCase.putConfig put
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 846715 T1992 oascc.SolrZkClient.makePath makePath:
/configs/conf1/synonyms.txt
[junit4] 2> 847921 T1992 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 847925 T1992 oejs.AbstractConnector.doStart Started
[email protected]:51423
[junit4] 2> 847925 T1992 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 847926 T1992 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 847926 T1992 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002
[junit4] 2> 847926 T1992 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/'
[junit4] 2> 847955 T1992 oasc.ConfigSolr.fromFile Loading container
configuration from
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/solr.xml
[junit4] 2> 848007 T1992 oasc.CoreContainer.<init> New CoreContainer
1852657920
[junit4] 2> 848008 T1992 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/]
[junit4] 2> 848009 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 848009 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 848009 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 848009 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 848009 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 848010 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 848010 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 848010 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 848010 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 848010 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 848011 T1992 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 848011 T1992 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 848011 T1992 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 848012 T1992 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 848012 T1992 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:35206/solr
[junit4] 2> 848012 T1992 oasc.ZkController.checkChrootPath zkHost includes
chroot
[junit4] 2> 848012 T1992
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 848013 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 848015 T2015 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@19596f71
name:ZooKeeperConnection Watcher:127.0.0.1:35206 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 848016 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 848016 T1992 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 848018 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 848019 T2018 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1ca9a3db
name:ZooKeeperConnection Watcher:127.0.0.1:35206/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 848020 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 848021 T1992 oascc.SolrZkClient.makePath makePath:
/overseer/queue
[junit4] 2> 848023 T1992 oascc.SolrZkClient.makePath makePath:
/overseer/collection-queue-work
[junit4] 2> 848025 T1992 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-running
[junit4] 2> 848027 T1992 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-completed
[junit4] 2> 848029 T1992 oascc.SolrZkClient.makePath makePath:
/overseer/collection-map-failure
[junit4] 2> 848031 T1992 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 848032 T1992 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51423_
[junit4] 2> 848032 T1992 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:51423_
[junit4] 2> 848034 T1992 oascc.SolrZkClient.makePath makePath:
/overseer_elect
[junit4] 2> 848035 T1992 oascc.SolrZkClient.makePath makePath:
/overseer_elect/election
[junit4] 2> 848037 T1992 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 848038 T1992 oasc.OverseerElectionContext.runLeaderProcess I
am going to be the leader 127.0.0.1:51423_
[junit4] 2> 848038 T1992 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4] 2> 848040 T1992 oasc.Overseer.start Overseer
(id=93039455383060483-127.0.0.1:51423_-n_0000000000) starting
[junit4] 2> 848042 T1992 oascc.SolrZkClient.makePath makePath:
/overseer/queue-work
[junit4] 2> 848047 T1992 oasc.OverseerAutoReplicaFailoverThread.<init>
Starting OverseerAutoReplicaFailoverThread
autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 848048 T2020 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4] 2> 848049 T1992 oascc.SolrZkClient.makePath makePath:
/clusterstate.json
[junit4] 2> 848050 T1992 oascc.SolrZkClient.makePath makePath:
/aliases.json
[junit4] 2> 848051 T1992
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 848053 T2019 oasc.Overseer$ClusterStateUpdater.run Starting to
work on the main queue
[junit4] 2> 848059 T2022 oasc.ZkController.publish publishing
core=collection1 state=down collection=control_collection
[junit4] 2> 848059 T2022 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 848060 T2022 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 848060 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 848062 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 0, message = {
[junit4] 2> "base_url":"http://127.0.0.1:51423";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:51423_"} current state
version: 0
[junit4] 2> 848062 T2019 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "base_url":"http://127.0.0.1:51423";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:51423_"}
[junit4] 2> 848063 T2019 oasco.ClusterStateMutator.createCollection
building a new cName: control_collection
[junit4] 2> 848063 T2019 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 848064 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 849060 T2022 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 849061 T2022 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:control_collection
[junit4] 2> 849061 T2022 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 849062 T2022 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 849062 T2022 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 849062 T2022 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/collection1/'
[junit4] 2> 849065 T2022 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/collection1/lib/.svn/'
to classloader
[junit4] 2> 849065 T2022 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/collection1/lib/README'
to classloader
[junit4] 2> 849066 T2022 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/collection1/lib/classes/'
to classloader
[junit4] 2> 849099 T2022 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 849101 T2022 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 849134 T2022 oasc.SolrConfig.<init> Using Lucene MatchVersion:
5.0.0
[junit4] 2> 849179 T2022 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 849280 T2022 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 849289 T2022 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 849657 T2022 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 849660 T2022 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 849662 T2022 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 849666 T2022 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 849683 T2022 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection control_collection
[junit4] 2> 849684 T2022 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 849750 T2022 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-002/collection1/,
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data/
[junit4] 2> 849751 T2022 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@13c9b9e4
[junit4] 2> 849753 T2022 oasc.CachingDirectoryFactory.get return new
directory for
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data
[junit4] 2> 849754 T2022 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data/index/
[junit4] 2> 849755 T2022 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data/index'
doesn't exist. Creating new index...
[junit4] 2> 849756 T2022 oasc.CachingDirectoryFactory.get return new
directory for
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data/index
[junit4] 2> 849757 T2022 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 849824 T2022 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 849824 T2022 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 849829 T2022 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 849829 T2022 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 849829 T2022 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 849830 T2022 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 849830 T2022 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 849830 T2022 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 849830 T2022 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 849831 T2022 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 849831 T2022 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 849832 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 849832 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 849833 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 849833 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 849833 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 849834 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 849834 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 849835 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 849835 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 849836 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 849837 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 849837 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 849838 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 849838 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 849839 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 849839 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 849839 T2022 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 849840 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 849840 T2022 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 849859 T2022 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 849862 T2022 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 849863 T2022 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 849865 T2022 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 849870 T2022 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 849870 T2022 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 849871 T2022 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8781427771283324]
[junit4] 2> 849872 T2022 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 849873 T2022 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 849873 T2022 oass.SolrIndexSearcher.<init> Opening
Searcher@644513ae[collection1] main
[junit4] 2> 849873 T2022 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/control_collection
[junit4] 2> 849874 T2022 oascc.ZkStateReader.readConfigName
path=/collections/control_collection configName=conf1 specified config exists
in ZooKeeper
[junit4] 2> 849874 T2022 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 849875 T2022
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 849875 T2022 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 849875 T2022 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 849876 T2022
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 849876 T2022 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 849876 T2022 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 849877 T2022 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 849878 T2022 oasc.CoreContainer.registerCore registering core:
collection1
[junit4] 2> 849878 T2023 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@644513ae[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 849878 T2026 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:51423 collection:control_collection
shard:shard1
[junit4] 2> 849879 T1992 oass.SolrDispatchFilter.init
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 849879 T1992 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 849879 T2026 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leader_elect/shard1/election
[junit4] 2> 849880 T1992
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 849881 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 849882 T2029 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@6b04e62f
name:ZooKeeperConnection Watcher:127.0.0.1:35206/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 849883 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 849883 T1992 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 849885 T1992
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 849885 T2026 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 849886 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 849886 T2026
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 849887 T2026 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1841 name=collection1
org.apache.solr.core.SolrCore@66abc86c url=http://127.0.0.1:51423/collection1
node=127.0.0.1:51423_ C1841_STATE=coll:control_collection core:collection1
props:{base_url=http://127.0.0.1:51423, core=collection1, state=down,
node_name=127.0.0.1:51423_}
[junit4] 2> 849887 T2026 C1841 P51423 oasc.SyncStrategy.sync Sync replicas
to http://127.0.0.1:51423/collection1/
[junit4] 2> 849887 T1992 oasc.ChaosMonkey.monkeyLog monkey: init - expire
sessions:false cause connection loss:false
[junit4] 2> 849887 T2026 C1841 P51423 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 849887 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state
version: 1
[junit4] 2> 849888 T2026 C1841 P51423 oasc.SyncStrategy.syncToMe
http://127.0.0.1:51423/collection1/ has no replicas
[junit4] 2> 849888 T2026 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:51423/collection1/ shard1
[junit4] 2> 849888 T2026 oascc.SolrZkClient.makePath makePath:
/collections/control_collection/leaders/shard1
[junit4] 2> 849889 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 849889 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 849893 T2030 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 849893 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:51423";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 849996 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 850045 T2026 oasc.ZkController.register We are
http://127.0.0.1:51423/collection1/ and leader is
http://127.0.0.1:51423/collection1/
[junit4] 2> 850046 T2026 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:51423
[junit4] 2> 850046 T2026 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 850046 T2026 oasc.ZkController.publish publishing
core=collection1 state=active collection=control_collection
[junit4] 2> 850046 T2026 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 850048 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 850049 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "base_url":"http://127.0.0.1:51423";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:51423_"} current state
version: 3
[junit4] 2> 850050 T2019 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "base_url":"http://127.0.0.1:51423";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:51423_"}
[junit4] 2> 850152 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 850152 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 851059 T1992 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 1
[junit4] 2> 851060 T1992 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 851063 T1992 oejs.AbstractConnector.doStart Started
[email protected]:28263
[junit4] 2> 851063 T1992 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 851063 T1992 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 851064 T1992 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003
[junit4] 2> 851064 T1992 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/'
[junit4] 2> 851092 T1992 oasc.ConfigSolr.fromFile Loading container
configuration from
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/solr.xml
[junit4] 2> 851144 T1992 oasc.CoreContainer.<init> New CoreContainer
656409811
[junit4] 2> 851144 T1992 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/]
[junit4] 2> 851145 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 851146 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 851146 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 851146 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 851146 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 851146 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 851147 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 851147 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 851147 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 851147 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 851148 T1992 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 851148 T1992 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 851148 T1992 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 851148 T1992 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 851149 T1992 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:35206/solr
[junit4] 2> 851149 T1992 oasc.ZkController.checkChrootPath zkHost includes
chroot
[junit4] 2> 851149 T1992
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 851150 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 851152 T2042 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1a034f46
name:ZooKeeperConnection Watcher:127.0.0.1:35206 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 851153 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 851153 T1992 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 851155 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 851156 T2045 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@1a744d63
name:ZooKeeperConnection Watcher:127.0.0.1:35206/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 851157 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 851161 T1992
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 852165 T1992 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28263_
[junit4] 2> 852166 T1992 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:28263_
[junit4] 2> 852169 T1992 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 852175 T2046 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 852176 T2046 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 852176 T2046 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 852176 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 852177 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "base_url":"http://127.0.0.1:28263";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:28263_"} current state
version: 4
[junit4] 2> 852178 T2019 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "base_url":"http://127.0.0.1:28263";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:28263_"}
[junit4] 2> 852178 T2019 oasco.ClusterStateMutator.createCollection
building a new cName: collection1
[junit4] 2> 852179 T2019 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 852180 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 852180 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 852180 T2045 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 853177 T2046 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 853178 T2046 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 853178 T2046 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 853179 T2046 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 853179 T2046 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 853179 T2046 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/collection1/'
[junit4] 2> 853181 T2046 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/collection1/lib/README'
to classloader
[junit4] 2> 853182 T2046 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/collection1/lib/.svn/'
to classloader
[junit4] 2> 853182 T2046 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/collection1/lib/classes/'
to classloader
[junit4] 2> 853215 T2046 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 853217 T2046 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 853249 T2046 oasc.SolrConfig.<init> Using Lucene MatchVersion:
5.0.0
[junit4] 2> 853309 T2046 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 853410 T2046 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 853419 T2046 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 853747 T2046 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 853750 T2046 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 853752 T2046 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 853756 T2046 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 853773 T2046 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 853773 T2046 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 853774 T2046 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-003/collection1/,
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1/
[junit4] 2> 853774 T2046 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@13c9b9e4
[junit4] 2> 853775 T2046 oasc.CachingDirectoryFactory.get return new
directory for
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1
[junit4] 2> 853776 T2046 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1/index/
[junit4] 2> 853777 T2046 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1/index'
doesn't exist. Creating new index...
[junit4] 2> 853778 T2046 oasc.CachingDirectoryFactory.get return new
directory for
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1/index
[junit4] 2> 853779 T2046 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 853784 T2046 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 853785 T2046 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 853790 T2046 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 853791 T2046 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 853791 T2046 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 853791 T2046 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 853791 T2046 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 853792 T2046 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 853792 T2046 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 853792 T2046 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 853793 T2046 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 853793 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 853794 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 853794 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 853795 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 853796 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 853796 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 853798 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 853799 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 853799 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 853801 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 853801 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 853802 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 853802 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 853803 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 853803 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 853804 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 853804 T2046 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 853805 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 853806 T2046 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 853824 T2046 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 853826 T2046 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 853828 T2046 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 853830 T2046 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 853833 T2046 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 853833 T2046 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 853834 T2046 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8781427771283324]
[junit4] 2> 853836 T2046 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 853836 T2046 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 853837 T2046 oass.SolrIndexSearcher.<init> Opening
Searcher@74320c5d[collection1] main
[junit4] 2> 853837 T2046 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 853838 T2046 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 853838 T2046 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 853838 T2046
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 853838 T2046 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 853839 T2046 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 853839 T2046
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 853839 T2046 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 853840 T2046 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 853840 T2046 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 853841 T2047 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@74320c5d[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 853842 T2046 oasc.CoreContainer.registerCore registering core:
collection1
[junit4] 2> 853842 T2050 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:28263 collection:collection1
shard:shard1
[junit4] 2> 853843 T1992 oass.SolrDispatchFilter.init
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 853843 T2050 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 853843 T1992 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 853847 T2050 oasc.ShardLeaderElectionContext.runLeaderProcess
Running the leader process for shard shard1
[junit4] 2> 853848 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 853848 T2050
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found
to continue.
[junit4] 2> 853849 T2050 oasc.ShardLeaderElectionContext.runLeaderProcess
I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1842 name=collection1
org.apache.solr.core.SolrCore@3a014e8 url=http://127.0.0.1:28263/collection1
node=127.0.0.1:28263_ C1842_STATE=coll:collection1 core:collection1
props:{base_url=http://127.0.0.1:28263, core=collection1, state=down,
node_name=127.0.0.1:28263_}
[junit4] 2> 853849 T2050 C1842 P28263 oasc.SyncStrategy.sync Sync replicas
to http://127.0.0.1:28263/collection1/
[junit4] 2> 853849 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 853849 T2050 C1842 P28263 oasc.SyncStrategy.syncReplicas Sync
Success - now sync replicas to me
[junit4] 2> 853850 T2050 C1842 P28263 oasc.SyncStrategy.syncToMe
http://127.0.0.1:28263/collection1/ has no replicas
[junit4] 2> 853850 T2050 oasc.ShardLeaderElectionContext.runLeaderProcess
I am the new leader: http://127.0.0.1:28263/collection1/ shard1
[junit4] 2> 853850 T2050 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard1
[junit4] 2> 853850 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 853850 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 853850 T2045 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 853853 T2030 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 853854 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:28263";,
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 853957 T2045 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 853957 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 854006 T2050 oasc.ZkController.register We are
http://127.0.0.1:28263/collection1/ and leader is
http://127.0.0.1:28263/collection1/
[junit4] 2> 854007 T2050 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:28263
[junit4] 2> 854007 T2050 oasc.ZkController.checkRecovery I am the leader,
no recovery necessary
[junit4] 2> 854007 T2050 oasc.ZkController.publish publishing
core=collection1 state=active collection=collection1
[junit4] 2> 854007 T2050 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 854008 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 854009 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "base_url":"http://127.0.0.1:28263";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:28263_"} current state
version: 7
[junit4] 2> 854009 T2019 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "base_url":"http://127.0.0.1:28263";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:28263_"}
[junit4] 2> 854112 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 854112 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 854112 T2045 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 855224 T1992 oasc.AbstractFullDistribZkTestBase.createJettys
create jetty 2
[junit4] 2> 855225 T1992 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 855228 T1992 oejs.AbstractConnector.doStart Started
[email protected]:30209
[junit4] 2> 855228 T1992 oass.SolrDispatchFilter.init
SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 855229 T1992 oasc.SolrResourceLoader.locateSolrHome JNDI not
configured for solr (NoInitialContextEx)
[junit4] 2> 855229 T1992 oasc.SolrResourceLoader.locateSolrHome using
system property solr.solr.home:
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004
[junit4] 2> 855229 T1992 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/'
[junit4] 2> 855258 T1992 oasc.ConfigSolr.fromFile Loading container
configuration from
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/solr.xml
[junit4] 2> 855310 T1992 oasc.CoreContainer.<init> New CoreContainer
99843058
[junit4] 2> 855310 T1992 oasc.CoreContainer.load Loading cores into
CoreContainer
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/]
[junit4] 2> 855311 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting socketTimeout to: 90000
[junit4] 2> 855311 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting urlScheme to:
[junit4] 2> 855312 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting connTimeout to: 15000
[junit4] 2> 855312 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnectionsPerHost to: 20
[junit4] 2> 855312 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxConnections to: 10000
[junit4] 2> 855312 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting corePoolSize to: 0
[junit4] 2> 855312 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maximumPoolSize to: 2147483647
[junit4] 2> 855313 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting maxThreadIdleTime to: 5
[junit4] 2> 855313 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting sizeOfQueue to: -1
[junit4] 2> 855313 T1992 oashc.HttpShardHandlerFactory.getParameter
Setting fairnessPolicy to: false
[junit4] 2> 855313 T1992 oasu.UpdateShardHandler.<init> Creating
UpdateShardHandler HTTP client with params:
socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 855314 T1992 oasl.LogWatcher.createWatcher SLF4J impl is
org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 855314 T1992 oasl.LogWatcher.newRegisteredLogWatcher
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 855314 T1992 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 855314 T1992 oasc.ZkContainer.initZooKeeper Zookeeper
client=127.0.0.1:35206/solr
[junit4] 2> 855315 T1992 oasc.ZkController.checkChrootPath zkHost includes
chroot
[junit4] 2> 855315 T1992
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
ZkCredentialsProvider
[junit4] 2> 855316 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 855317 T2062 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@153d8a14
name:ZooKeeperConnection Watcher:127.0.0.1:35206 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 855318 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 855319 T1992 oascc.SolrZkClient.createZkACLProvider Using
default ZkACLProvider
[junit4] 2> 855321 T1992 oascc.ConnectionManager.waitForConnected Waiting
for client to connect to ZooKeeper
[junit4] 2> 855322 T2065 oascc.ConnectionManager.process Watcher
org.apache.solr.common.cloud.ConnectionManager@75ffdb8d
name:ZooKeeperConnection Watcher:127.0.0.1:35206/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 855323 T1992 oascc.ConnectionManager.waitForConnected Client
is connected to ZooKeeper
[junit4] 2> 855327 T1992
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state
from ZooKeeper...
[junit4] 2> 856330 T1992 oasc.ZkController.createEphemeralLiveNode
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30209_
[junit4] 2> 856331 T1992 oascc.SolrZkClient.makePath makePath:
/live_nodes/127.0.0.1:30209_
[junit4] 2> 856334 T1992 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 856341 T2066 oasc.ZkController.publish publishing
core=collection1 state=down collection=collection1
[junit4] 2> 856341 T2066 oasc.ZkController.publish numShards not found on
descriptor - reading it from system property
[junit4] 2> 856342 T2066 oasc.ZkController.waitForCoreNodeName look for
our core node name
[junit4] 2> 856342 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 856343 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "base_url":"http://127.0.0.1:30209";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:30209_"} current state
version: 8
[junit4] 2> 856343 T2019 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "base_url":"http://127.0.0.1:30209";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:30209_"}
[junit4] 2> 856344 T2019 oasco.ReplicaMutator.updateState Collection
already exists with numShards=1
[junit4] 2> 856344 T2019 oasco.ReplicaMutator.updateState Assigning new
node to shard shard=shard1
[junit4] 2> 856345 T2065 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 856345 T2029 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 856345 T2018 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 856345 T2045 oascc.ZkStateReader$2.process A cluster state
change: WatchedEvent state:SyncConnected type:NodeDataChanged
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 857342 T2066 oasc.ZkController.waitForShardId waiting to find
shard id in clusterstate for collection1
[junit4] 2> 857343 T2066 oasc.ZkController.createCollectionZkNode Check
for collection zkNode:collection1
[junit4] 2> 857344 T2066 oasc.ZkController.createCollectionZkNode
Collection zkNode exists
[junit4] 2> 857344 T2066 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 857345 T2066 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 857345 T2066 oasc.SolrResourceLoader.<init> new
SolrResourceLoader for directory:
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/collection1/'
[junit4] 2> 857355 T2066 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/collection1/lib/classes/'
to classloader
[junit4] 2> 857359 T2066 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/collection1/lib/.svn/'
to classloader
[junit4] 2> 857363 T2066 oasc.SolrResourceLoader.replaceClassLoader Adding
'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/collection1/lib/README'
to classloader
[junit4] 2> 857436 T2066 oasc.ZkController.watchZKConfDir watch zkdir
/configs/conf1
[junit4] 2> 857439 T2066 oasc.Config.<init> loaded config solrconfig.xml
with version 0
[junit4] 2> 857493 T2066 oasc.SolrConfig.<init> Using Lucene MatchVersion:
5.0.0
[junit4] 2> 857536 T2066 oasc.SolrConfig.<init> Loaded SolrConfig:
solrconfig.xml
[junit4] 2> 857638 T2066 oass.IndexSchema.readSchema Reading Solr Schema
from /configs/conf1/schema.xml
[junit4] 2> 857646 T2066 oass.IndexSchema.readSchema [collection1] Schema
name=test
[junit4] 2> 858112 T2066 oass.IndexSchema.readSchema default search field
in schema is text
[junit4] 2> 858115 T2066 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 858117 T2066 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 858123 T2066 oass.FileExchangeRateProvider.reload Reloading
exchange rates from file currency.xml
[junit4] 2> 858146 T2066 oasc.CoreContainer.create Creating SolrCore
'collection1' using configuration from collection collection1
[junit4] 2> 858147 T2066 oasc.SolrCore.initDirectoryFactory
solr.StandardDirectoryFactory
[junit4] 2> 858147 T2066 oasc.SolrCore.<init> [collection1] Opening new
SolrCore at
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-004/collection1/,
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/
[junit4] 2> 858147 T2066 oasc.JmxMonitoredMap.<init> JMX monitoring is
enabled. Adding Solr mbeans to JMX Server:
com.sun.jmx.mbeanserver.JmxMBeanServer@13c9b9e4
[junit4] 2> 858150 T2066 oasc.CachingDirectoryFactory.get return new
directory for
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2
[junit4] 2> 858151 T2066 oasc.SolrCore.getNewIndexDir New index directory
detected: old=null
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index/
[junit4] 2> 858152 T2066 oasc.SolrCore.initIndex WARN [collection1] Solr
index directory
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index'
doesn't exist. Creating new index...
[junit4] 2> 858154 T2066 oasc.CachingDirectoryFactory.get return new
directory for
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index
[junit4] 2> 858155 T2066 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 858163 T2066 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2>
commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 858163 T2066 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 858171 T2066 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "nodistrib"
[junit4] 2> 858171 T2066 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "dedupe"
[junit4] 2> 858171 T2066 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 858172 T2066 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "stored_sig"
[junit4] 2> 858172 T2066 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 858172 T2066 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 858172 T2066 oasup.UpdateRequestProcessorChain.init creating
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 858173 T2066 oasup.UpdateRequestProcessorChain.init inserting
DistributedUpdateProcessorFactory into updateRequestProcessorChain
"distrib-dup-test-chain-implicit"
[junit4] 2> 858173 T2066 oasc.SolrCore.loadUpdateProcessorChains no
updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 858174 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 858174 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 858175 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 858176 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 858176 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 858177 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 858179 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 858180 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 858181 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 858182 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 858182 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 858183 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 858183 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 858184 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/properties:
org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 858185 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 858185 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 858186 T2066 oasc.RequestHandlers.initHandlersFromConfig
created standard: solr.StandardRequestHandler
[junit4] 2> 858186 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 858187 T2066 oasc.RequestHandlers.initHandlersFromConfig
created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 858207 T2066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 858210 T2066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 858212 T2066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 858214 T2066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 858219 T2066 oasu.CommitTracker.<init> Hard AutoCommit:
disabled
[junit4] 2> 858219 T2066 oasu.CommitTracker.<init> Soft AutoCommit:
disabled
[junit4] 2> 858221 T2066 oasu.RandomMergePolicy.<init> RandomMergePolicy
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8781427771283324]
[junit4] 2> 858222 T2066 oasc.SolrDeletionPolicy.onInit
SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2>
commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 858223 T2066 oasc.SolrDeletionPolicy.updateCommits newest
commit generation = 1
[junit4] 2> 858223 T2066 oass.SolrIndexSearcher.<init> Opening
Searcher@cea0e74[collection1] main
[junit4] 2> 858223 T2066 oascc.ZkStateReader.readConfigName Load
collection config from:/collections/collection1
[junit4] 2> 858224 T2066 oascc.ZkStateReader.readConfigName
path=/collections/collection1 configName=conf1 specified config exists in
ZooKeeper
[junit4] 2> 858224 T2066 oasr.ManagedResourceStorage.newStorageIO Setting
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 858225 T2066
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 858225 T2066 oasr.RestManager.init Initializing RestManager
with initArgs: {}
[junit4] 2> 858225 T2066 oasr.ManagedResourceStorage.load Reading
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 858226 T2066
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found
for znode /configs/conf1/_rest_managed.json
[junit4] 2> 858226 T2066 oasr.ManagedResourceStorage.load Loaded null at
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 858226 T2066 oasr.RestManager.init Initializing 0 registered
ManagedResources
[junit4] 2> 858227 T2066 oash.ReplicationHandler.inform Commits will be
reserved for 10000
[junit4] 2> 858228 T2067 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@cea0e74[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 858228 T2066 oasc.CoreContainer.registerCore registering core:
collection1
[junit4] 2> 858229 T2070 oasc.ZkController.register Register replica -
core:collection1 address:http://127.0.0.1:30209 collection:collection1
shard:shard1
[junit4] 2> 858229 T1992 oass.SolrDispatchFilter.init
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 858230 T1992 oass.SolrDispatchFilter.init
SolrDispatchFilter.init() done
[junit4] 2> 858231 T2070 oasc.ZkController.register We are
http://127.0.0.1:30209/collection1/ and leader is
http://127.0.0.1:28263/collection1/
[junit4] 2> 858232 T2070 oasc.ZkController.register No LogReplay needed
for core=collection1 baseURL=http://127.0.0.1:30209
[junit4] 2> 858232 T2070 oasc.ZkController.checkRecovery Core needs to
recover:collection1
[junit4] 2> 858232 T2070 oasu.DefaultSolrCoreState.doRecovery Running
recovery - first canceling any ongoing recovery
[junit4] 2> 858232 T1992
oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to
finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4] 2> ASYNC NEW_CORE C1843 name=collection1
org.apache.solr.core.SolrCore@1dfb070 url=http://127.0.0.1:30209/collection1
node=127.0.0.1:30209_ C1843_STATE=coll:collection1 core:collection1
props:{base_url=http://127.0.0.1:30209, core=collection1, state=down,
node_name=127.0.0.1:30209_}
[junit4] 2> 858232 T2071 C1843 P30209 oasc.RecoveryStrategy.run Starting
recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 858234 T2071 C1843 P30209 oasc.RecoveryStrategy.doRecovery
###### startupVersions=[]
[junit4] 2> 858234 T2071 C1843 P30209 oasc.RecoveryStrategy.doRecovery
Publishing state of core collection1 as recovering, leader is
http://127.0.0.1:28263/collection1/ and I am http://127.0.0.1:30209/collection1/
[junit4] 2> 858234 T2071 C1843 P30209 oasc.ZkController.publish publishing
core=collection1 state=recovering collection=collection1
[junit4] 2> 858234 T2071 C1843 P30209 oasc.ZkController.publish numShards
not found on descriptor - reading it from system property
[junit4] 2> 858235 T2018 oasc.DistributedQueue$LatchWatcher.process
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 858236 T2071 C1843 P30209
oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to
http://127.0.0.1:28263; WaitForState:
action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A30209_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 858237 T2019 oasc.Overseer$ClusterStateUpdater.run
processMessage: queueSize: 1, message = {
[junit4] 2> "base_url":"http://127.0.0.1:30209";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"recovering",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:30209_"} current state
version: 9
[junit4] 2> 858238 T2019 oasco.ReplicaMutator.updateState Update state
numShards=1 message={
[junit4] 2> "base_url":"http://127.0.0.1:30209";,
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"recovering",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:30209_"}
[junit4] 2> 858239 T2035 oasha.CoreAdminHandler.handleWaitForStateAction
Going to wait for coreNodeName
[...truncated too long message...]
h.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 2> at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 966144 T1992 oasc.CachingDirectoryFactory.close Closing
StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 966144 T1992 oasc.CachingDirectoryFactory.closeCacheValue
looking to close
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index;done=false>>]
[junit4] 2> 966144 T1992 oasc.CachingDirectoryFactory.close Closing
directory:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2/index
[junit4] 2> 966145 T1992 oasc.CachingDirectoryFactory.closeCacheValue
looking to close
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2;done=false>>]
[junit4] 2> 966145 T1992 oasc.CachingDirectoryFactory.close Closing
directory:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001/tempDir-001/jetty2
[junit4] 2> 966146 T1992 oasc.Overseer.close Overseer
(id=93039455383060488-127.0.0.1:30209_-n_0000000002) closing
[junit4] 2> 966146 T2094 oasc.Overseer$ClusterStateUpdater.run Overseer
Loop exiting : 127.0.0.1:30209_
[junit4] 2> 967647 T2093 oascc.ZkStateReader$2.process WARN ZooKeeper
watch triggered, but Solr cannot talk to ZK
[junit4] 2> 967648 T2090 oascc.ZkStateReader$3.process WARN ZooKeeper
watch triggered, but Solr cannot talk to ZK
[junit4] 2> 967650 T1992 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 972652 T1992 oas.SolrTestCaseJ4.tearDown ###Ending
testDistribSearch
[junit4] 2> 972654 T1992 oasc.ZkTestServer.send4LetterWord connecting to
127.0.0.1:35206 35206
[junit4] 2> 972869 T1993 oasc.ZkTestServer.send4LetterWord connecting to
127.0.0.1:35206 35206
[junit4] 2> 972870 T1993 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN
Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 3 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2
/solr/overseer_elect/election/93039455383060483-127.0.0.1:51423_-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.method=testDistribSearch
-Dtests.seed=22D23199875D3546 -Dtests.multiplier=2 -Dtests.slow=true
-Dtests.locale=ja -Dtests.timezone=CST -Dtests.asserts=true
-Dtests.file.encoding=US-ASCII
[junit4] FAILURE 126s J1 | ChaosMonkeyNothingIsSafeTest.testDistribSearch
<<<
[junit4] > Throwable #1: java.lang.AssertionError: There were too many
update fails - we expect it can happen, but shouldn't easily
[junit4] > at
__randomizedtesting.SeedInfo.seed([22D23199875D3546:A334BF81F002557A]:0)
[junit4] > at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:223)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 972960 T1992 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest-22D23199875D3546-001
[junit4] 2> 126504 T1991 ccr.ThreadLeakControl.checkThreadLeaks WARNING
Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are:
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
chunkSize=2, maxDocsPerChunk=600),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY,
chunkSize=2)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {},
locale=ja, timezone=CST
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65
(64-bit)/cpus=16,threads=1,free=109582368,total=305135616
[junit4] 2> NOTE: All tests run in this JVM: [DeleteInactiveReplicaTest,
TestQueryTypes, AnalyticsMergeStrategyTest, CopyFieldTest,
TestFieldTypeCollectionResource, PingRequestHandlerTest,
AnalysisAfterCoreReloadTest, SolrRequestParserTest,
AddSchemaFieldsUpdateProcessorFactoryTest, TestIBSimilarityFactory,
TestSolrDynamicMBean, BasicDistributedZkTest, TestDistribDocBasedVersion,
UnloadDistributedZkTest, TestManagedSchemaDynamicFieldResource,
ConnectionManagerTest, FieldMutatingUpdateProcessorTest, AtomicUpdatesTest,
TestInfoStreamLogging, CollectionsAPIAsyncDistributedZkTest,
TestBinaryResponseWriter, DistributedFacetPivotSmallTest,
TestNonDefinedSimilarityFactory, ResponseHeaderTest, SuggesterTest,
TestCustomSort, FastVectorHighlighterTest, TestManagedSynonymFilterFactory,
TestDistributedMissingSort, TestSolrXmlPersistor, TestCloudSchemaless,
UUIDFieldTest, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed on J1 in 127.06s, 1 test, 1 failure <<< FAILURES!
[...truncated 997 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:529:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:477:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:190:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:508:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1363:
The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:970:
There were test failures: 453 suites, 1855 tests, 1 failure, 61 ignored (23
assumptions)
Total time: 64 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #2386
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 204951164 bytes
Compression is 0.0%
Took 42 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
