Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18114/
Java: 32bit/jdk1.8.0_102 -server -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test
Error Message:
document count mismatch. control=1586 sum(shards)=1587 cloudClient=1587
Stack Trace:
java.lang.AssertionError: document count mismatch. control=1586
sum(shards)=1587 cloudClient=1587
at
__randomizedtesting.SeedInfo.seed([7C9F1D628159DC07:F4CB22B82FA5B1FF]:0)
at org.junit.Assert.fail(Assert.java:93)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1323)
at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:231)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10913 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> Creating dataDir:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/init-core-data-001
[junit4] 2> 173723 INFO
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[7C9F1D628159DC07]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 173723 INFO
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[7C9F1D628159DC07]-worker) [ ]
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /bkb/ja
[junit4] 2> 173726 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 173726 INFO (Thread-393) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 173726 INFO (Thread-393) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 173826 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkTestServer start zk server on port:34157
[junit4] 2> 173836 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 173837 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 173838 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 173839 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 173840 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 173841 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 173842 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 173844 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 173845 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 173848 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 173849 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractZkTestCase put
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 174002 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/control-001/cores/collection1
[junit4] 2> 174003 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 174004 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@f8c358{/bkb/ja,null,AVAILABLE}
[junit4] 2> 174006 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Started
ServerConnector@10600c2{HTTP/1.1,[http/1.1]}{127.0.0.1:34588}
[junit4] 2> 174006 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server Started @175969ms
[junit4] 2> 174006 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/tempDir-001/control/data,
hostContext=/bkb/ja, hostPort=34588,
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/control-001/cores}
[junit4] 2> 174006 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 174006 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 174006 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 174007 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 174007 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-10-22T15:01:49.335Z
[junit4] 2> 174009 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 174009 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/control-001/solr.xml
[junit4] 2> 174016 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34157/solr
[junit4] 2> 174043 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.OverseerElectionContext I am going to
be the leader 127.0.0.1:34588_bkb%2Fja
[junit4] 2> 174044 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.Overseer Overseer
(id=96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000) starting
[junit4] 2> 174046 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:34588_bkb%2Fja
[junit4] 2> 174047 INFO
(zkCallback-348-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (1)
[junit4] 2> 174070 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/control-001/cores
[junit4] 2> 174070 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 174072 INFO
(OverseerStateUpdate-96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 175082 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection x:collection1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 175091 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection x:collection1]
o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 175151 WARN
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection x:collection1]
o.a.s.s.IndexSchema [collection1] default search field in schema is text.
WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 175152 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection x:collection1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 175162 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection control_collection
[junit4] 2> 175162 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/control-001/cores/collection1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/control-001/cores/collection1/data/]
[junit4] 2> 175162 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bbb62e
[junit4] 2> 175164 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8047977423533451]
[junit4] 2> 175202 WARN
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler
{type = requestHandler,name = /dump,class = DumpRequestHandler,args =
{defaults={a=A,b=B}}}
[junit4] 2> 175207 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 175207 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
numVersionBuckets=65536
[junit4] 2> 175216 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for
15000ms;
[junit4] 2> 175216 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 175216 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8157983375621845]
[junit4] 2> 175217 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1df3edc[collection1]
main]
[junit4] 2> 175218 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO
with znodeBase: /configs/conf1
[junit4] 2> 175218 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 175218 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 175219 INFO
(searcherExecutor-734-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher
Searcher@1df3edc[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 175219 INFO
(coreLoadExecutor-733-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent
updates, using new clock 1548902476595331072
[junit4] 2> 175223 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to
continue.
[junit4] 2> 175223 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try
and sync
[junit4] 2> 175223 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.SyncStrategy Sync replicas to
http://127.0.0.1:34588/bkb/ja/collection1/
[junit4] 2> 175223 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 175223 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:34588/bkb/ja/collection1/
has no replicas
[junit4] 2> 175225 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:34588/bkb/ja/collection1/ shard1
[junit4] 2> 175376 INFO
(coreZkRegister-726-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja
x:collection1 s:shard1 c:control_collection r:core_node1)
[n:127.0.0.1:34588_bkb%2Fja c:control_collection s:shard1 r:core_node1
x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 175575 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 175575 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection
loss:false
[junit4] 2> 175768 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001/cores/collection1
[junit4] 2> 175768 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001
[junit4] 2> 175769 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 175770 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@e74c29{/bkb/ja,null,AVAILABLE}
[junit4] 2> 175770 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Started
ServerConnector@ded007{HTTP/1.1,[http/1.1]}{127.0.0.1:44755}
[junit4] 2> 175770 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server Started @177733ms
[junit4] 2> 175771 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/tempDir-001/jetty1,
solrconfig=solrconfig.xml, hostContext=/bkb/ja, hostPort=44755,
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001/cores}
[junit4] 2> 175771 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 175771 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 175771 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 175771 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 175771 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-10-22T15:01:51.099Z
[junit4] 2> 175773 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 175773 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001/solr.xml
[junit4] 2> 175778 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34157/solr
[junit4] 2> 175783 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (1)
[junit4] 2> 175784 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:44755_bkb%2Fja
[junit4] 2> 175785 INFO
(zkCallback-348-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (1) -> (2)
[junit4] 2> 175785 INFO
(zkCallback-357-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (1) -> (2)
[junit4] 2> 175785 INFO (zkCallback-352-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 175797 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001/cores
[junit4] 2> 175797 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 175798 INFO
(OverseerStateUpdate-96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard2
[junit4] 2> 176810 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 176834 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 176897 WARN
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] default search field in schema is text. WARNING: Deprecated,
please use 'df' on request instead.
[junit4] 2> 176899 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 176906 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection collection1
[junit4] 2> 176907 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001/cores/collection1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 176907 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bbb62e
[junit4] 2> 176908 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8047977423533451]
[junit4] 2> 176976 WARN
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,args =
{defaults={a=A,b=B}}}
[junit4] 2> 176983 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 176983 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 176986 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 176986 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 176987 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8157983375621845]
[junit4] 2> 176987 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@1751299[collection1] main]
[junit4] 2> 176987 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 176988 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 176988 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 176988 INFO
(searcherExecutor-745-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore
[collection1] Registered new searcher Searcher@1751299[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 176989 INFO
(coreLoadExecutor-744-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1548902478451310592
[junit4] 2> 176993 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 176993 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 176993 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync
replicas to http://127.0.0.1:44755/bkb/ja/collection1/
[junit4] 2> 176993 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync
Success - now sync replicas to me
[junit4] 2> 176993 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy
http://127.0.0.1:44755/bkb/ja/collection1/ has no replicas
[junit4] 2> 176995 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:44755/bkb/ja/collection1/ shard2
[junit4] 2> 177146 INFO
(coreZkRegister-739-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:44755_bkb%2Fja
c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am
the leader, no recovery necessary
[junit4] 2> 177464 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001/cores/collection1
[junit4] 2> 177465 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001
[junit4] 2> 177465 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 177466 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@129c8e0{/bkb/ja,null,AVAILABLE}
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Started
ServerConnector@10a7787{HTTP/1.1,[http/1.1]}{127.0.0.1:45025}
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server Started @179429ms
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/tempDir-001/jetty2,
solrconfig=solrconfig.xml, hostContext=/bkb/ja, hostPort=45025,
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001/cores}
[junit4] 2> 177467 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 177467 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-10-22T15:01:52.795Z
[junit4] 2> 177470 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 177470 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001/solr.xml
[junit4] 2> 177475 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34157/solr
[junit4] 2> 177489 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (2)
[junit4] 2> 177491 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:45025_bkb%2Fja
[junit4] 2> 177491 INFO
(zkCallback-357-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (3)
[junit4] 2> 177491 INFO
(zkCallback-348-thread-3-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (3)
[junit4] 2> 177491 INFO (zkCallback-352-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 177492 INFO
(zkCallback-363-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (3)
[junit4] 2> 177507 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001/cores
[junit4] 2> 177507 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 177518 INFO
(OverseerStateUpdate-96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard3
[junit4] 2> 178525 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 178535 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 178594 WARN
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] default search field in schema is text. WARNING: Deprecated,
please use 'df' on request instead.
[junit4] 2> 178595 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 178604 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection collection1
[junit4] 2> 178604 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001/cores/collection1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-2-001/cores/collection1/data/]
[junit4] 2> 178604 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bbb62e
[junit4] 2> 178614 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8047977423533451]
[junit4] 2> 178656 WARN
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,args =
{defaults={a=A,b=B}}}
[junit4] 2> 178663 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 178663 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 178664 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 178664 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 178672 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8157983375621845]
[junit4] 2> 178672 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@153d78[collection1] main]
[junit4] 2> 178673 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 178673 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 178673 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 178674 INFO
(searcherExecutor-756-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SolrCore
[collection1] Registered new searcher Searcher@153d78[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 178674 INFO
(coreLoadExecutor-755-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1548902480218161152
[junit4] 2> 178680 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 178680 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 178680 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync
replicas to http://127.0.0.1:45025/bkb/ja/collection1/
[junit4] 2> 178680 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync
Success - now sync replicas to me
[junit4] 2> 178680 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.SyncStrategy
http://127.0.0.1:45025/bkb/ja/collection1/ has no replicas
[junit4] 2> 178694 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:45025/bkb/ja/collection1/ shard3
[junit4] 2> 178845 INFO
(coreZkRegister-750-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja
x:collection1 s:shard3 c:collection1 r:core_node2) [n:127.0.0.1:45025_bkb%2Fja
c:collection1 s:shard3 r:core_node2 x:collection1] o.a.s.c.ZkController I am
the leader, no recovery necessary
[junit4] 2> 179238 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001/cores/collection1
[junit4] 2> 179238 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001
[junit4] 2> 179239 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 179240 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1eab3d3{/bkb/ja,null,AVAILABLE}
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Started
ServerConnector@1dd8d45{HTTP/1.1,[http/1.1]}{127.0.0.1:40702}
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server Started @181204ms
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/tempDir-001/jetty3,
solrconfig=solrconfig.xml, hostContext=/bkb/ja, hostPort=40702,
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001/cores}
[junit4] 2> 179241 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 179241 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-10-22T15:01:54.569Z
[junit4] 2> 179243 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 179243 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001/solr.xml
[junit4] 2> 179249 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34157/solr
[junit4] 2> 179254 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (3)
[junit4] 2> 179260 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:40702_bkb%2Fja
[junit4] 2> 179261 INFO
(zkCallback-357-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 179261 INFO
(zkCallback-363-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 179262 INFO
(zkCallback-348-thread-2-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 179262 INFO (zkCallback-352-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 179262 INFO
(zkCallback-369-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (4)
[junit4] 2> 179274 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001/cores
[junit4] 2> 179274 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 179275 INFO
(OverseerStateUpdate-96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard1
[junit4] 2> 180284 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 180301 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 180360 WARN
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] default search field in schema is text. WARNING: Deprecated,
please use 'df' on request instead.
[junit4] 2> 180361 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 180373 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection collection1
[junit4] 2> 180373 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001/cores/collection1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-3-001/cores/collection1/data/]
[junit4] 2> 180373 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bbb62e
[junit4] 2> 180380 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8047977423533451]
[junit4] 2> 180407 WARN
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,args =
{defaults={a=A,b=B}}}
[junit4] 2> 180415 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 180415 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 180416 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 180416 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 180417 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8157983375621845]
[junit4] 2> 180417 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@5fbc0f[collection1] main]
[junit4] 2> 180418 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 180418 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 180418 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 180419 INFO
(searcherExecutor-767-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.c.SolrCore
[collection1] Registered new searcher Searcher@5fbc0f[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 180419 INFO
(coreLoadExecutor-766-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1548902482047926272
[junit4] 2> 180424 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 180424 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 180424 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.c.SyncStrategy Sync
replicas to http://127.0.0.1:40702/bkb/ja/collection1/
[junit4] 2> 180424 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.c.SyncStrategy Sync
Success - now sync replicas to me
[junit4] 2> 180424 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.c.SyncStrategy
http://127.0.0.1:40702/bkb/ja/collection1/ has no replicas
[junit4] 2> 180426 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:40702/bkb/ja/collection1/ shard1
[junit4] 2> 180576 INFO
(coreZkRegister-761-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja
x:collection1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:40702_bkb%2Fja
c:collection1 s:shard1 r:core_node3 x:collection1] o.a.s.c.ZkController I am
the leader, no recovery necessary
[junit4] 2> 180912 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001/cores/collection1
[junit4] 2> 180912 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001
[junit4] 2> 180913 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 180914 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@6eb706{/bkb/ja,null,AVAILABLE}
[junit4] 2> 180914 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Started
ServerConnector@1496d06{HTTP/1.1,[http/1.1]}{127.0.0.1:39009}
[junit4] 2> 180914 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server Started @182877ms
[junit4] 2> 180914 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/tempDir-001/jetty4,
solrconfig=solrconfig.xml, hostContext=/bkb/ja, hostPort=39009,
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001/cores}
[junit4] 2> 180915 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 180915 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 180915 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 180915 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 180915 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-10-22T15:01:56.243Z
[junit4] 2> 180917 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 180917 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001/solr.xml
[junit4] 2> 180923 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34157/solr
[junit4] 2> 180940 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (4)
[junit4] 2> 180942 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:39009_bkb%2Fja
[junit4] 2> 180942 INFO
(zkCallback-357-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (4) -> (5)
[junit4] 2> 180943 INFO
(zkCallback-375-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (4) -> (5)
[junit4] 2> 180943 INFO
(zkCallback-363-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (4) -> (5)
[junit4] 2> 180943 INFO
(zkCallback-369-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (4) -> (5)
[junit4] 2> 180943 INFO (zkCallback-352-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 180943 INFO
(zkCallback-348-thread-1-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (4) -> (5)
[junit4] 2> 180955 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001/cores
[junit4] 2> 180955 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 180958 INFO
(OverseerStateUpdate-96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard2
[junit4] 2> 181968 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 181978 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 182036 WARN
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] default search field in schema is text. WARNING: Deprecated,
please use 'df' on request instead.
[junit4] 2> 182037 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 182046 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection collection1
[junit4] 2> 182046 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001/cores/collection1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-4-001/cores/collection1/data/]
[junit4] 2> 182046 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bbb62e
[junit4] 2> 182049 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8047977423533451]
[junit4] 2> 182091 WARN
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,args =
{defaults={a=A,b=B}}}
[junit4] 2> 182098 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 182098 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 182099 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 182099 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 182100 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.8157983375621845]
[junit4] 2> 182108 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.s.SolrIndexSearcher Opening [Searcher@ed6b87[collection1] main]
[junit4] 2> 182115 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 182116 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 182116 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 182116 INFO
(searcherExecutor-778-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.SolrCore
[collection1] Registered new searcher Searcher@ed6b87[collection1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 182117 INFO
(coreLoadExecutor-777-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1548902483828408320
[junit4] 2> 182120 INFO
(coreZkRegister-772-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.ZkController Core
needs to recover:collection1
[junit4] 2> 182120 INFO
(updateExecutor-372-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.u.DefaultSolrCoreState
Running recovery
[junit4] 2> 182120 INFO
(recoveryExecutor-373-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 182120 INFO
(recoveryExecutor-373-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
###### startupVersions=[[]]
[junit4] 2> 182121 INFO
(recoveryExecutor-373-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
Begin buffering updates. core=[collection1]
[junit4] 2> 182121 INFO
(recoveryExecutor-373-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.u.UpdateLog Starting
to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 182121 INFO
(recoveryExecutor-373-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
Publishing state of core [collection1] as recovering, leader is
[http://127.0.0.1:44755/bkb/ja/collection1/] and I am
[http://127.0.0.1:39009/bkb/ja/collection1/]
[junit4] 2> 182122 INFO
(recoveryExecutor-373-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja
x:collection1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39009_bkb%2Fja
c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy
Sending prep recovery command to [http://127.0.0.1:44755/bkb/ja];
[WaitForState:
action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:39009_bkb%252Fja&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 182123 INFO (qtp9428584-1743) [n:127.0.0.1:44755_bkb%2Fja
] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4, state:
recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 182124 INFO (qtp9428584-1743) [n:127.0.0.1:44755_bkb%2Fja
] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1
(shard2 of collection1) have state: recovering
[junit4] 2> 182124 INFO (qtp9428584-1743) [n:127.0.0.1:44755_bkb%2Fja
] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1,
shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader?
true, live=true, checkLive=true, currentState=down, localState=active,
nodeName=127.0.0.1:39009_bkb%2Fja, coreNodeName=core_node4,
onlyIfActiveCheckResult=false, nodeProps:
core_node4:{"core":"collection1","base_url":"http://127.0.0.1:39009/bkb/ja","node_name":"127.0.0.1:39009_bkb%2Fja","state":"down"}
[junit4] 2> 182610 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.SolrTestCaseJ4 Writing core.properties file to
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001/cores/collection1
[junit4] 2> 182611 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.AbstractFullDistribZkTestBase create jetty 5 in directory
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001
[junit4] 2> 182611 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 182612 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1a70782{/bkb/ja,null,AVAILABLE}
[junit4] 2> 182613 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Started
ServerConnector@1ffbe0c{HTTP/1.1,[http/1.1]}{127.0.0.1:36102}
[junit4] 2> 182613 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.Server Started @184576ms
[junit4] 2> 182613 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/tempDir-001/jetty5,
solrconfig=solrconfig.xml, hostContext=/bkb/ja, hostPort=36102,
coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001/cores}
[junit4] 2> 182613 ERROR
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 182614 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version
7.0.0
[junit4] 2> 182614 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 182614 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 182614 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2016-10-22T15:01:57.942Z
[junit4] 2> 182616 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 182616 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.SolrXmlConfig Loading container configuration from
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001/solr.xml
[junit4] 2> 182622 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34157/solr
[junit4] 2> 182626 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (5)
[junit4] 2> 182628 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:36102_bkb%2Fja
[junit4] 2> 182628 INFO
(zkCallback-357-thread-1-processing-n:127.0.0.1:44755_bkb%2Fja)
[n:127.0.0.1:44755_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (5) -> (6)
[junit4] 2> 182628 INFO
(zkCallback-375-thread-1-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (5) -> (6)
[junit4] 2> 182629 INFO (zkCallback-352-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 182629 INFO
(zkCallback-369-thread-1-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (5) -> (6)
[junit4] 2> 182629 INFO
(zkCallback-348-thread-2-processing-n:127.0.0.1:34588_bkb%2Fja)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (5) -> (6)
[junit4] 2> 182630 INFO
(zkCallback-382-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (5) -> (6)
[junit4] 2> 182629 INFO
(zkCallback-363-thread-1-processing-n:127.0.0.1:45025_bkb%2Fja)
[n:127.0.0.1:45025_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (5) -> (6)
[junit4] 2> 182643 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001/cores
[junit4] 2> 182643 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.CorePropertiesLocator Cores are:
[collection1]
[junit4] 2> 182644 INFO
(OverseerStateUpdate-96806404689428484-127.0.0.1:34588_bkb%2Fja-n_0000000000)
[n:127.0.0.1:34588_bkb%2Fja ] o.a.s.c.o.ReplicaMutator Assigning new node to
shard shard=shard3
[junit4] 2> 183124 INFO (qtp9428584-1743) [n:127.0.0.1:44755_bkb%2Fja
] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1,
shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader?
true, live=true, checkLive=true, currentState=recovering, localState=active,
nodeName=127.0.0.1:39009_bkb%2Fja, coreNodeName=core_node4,
onlyIfActiveCheckResult=false, nodeProps:
core_node4:{"core":"collection1","base_url":"http://127.0.0.1:39009/bkb/ja","node_name":"127.0.0.1:39009_bkb%2Fja","state":"recovering"}
[junit4] 2> 183124 INFO (qtp9428584-1743) [n:127.0.0.1:44755_bkb%2Fja
] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node4, state: recovering,
checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 183124 INFO (qtp9428584-1743) [n:127.0.0.1:44755_bkb%2Fja
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
params={nodeName=127.0.0.1:39009_bkb%252Fja&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node4&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2}
status=0 QTime=1000
[junit4] 2> 183653 INFO
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 x:collection1] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.0.0
[junit4] 2> 183671 INFO
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] Schema name=test
[junit4] 2> 183736 WARN
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
[collection1] default search field in schema is text. WARNING: Deprecated,
please use 'df' on request instead.
[junit4] 2> 183737 INFO
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 x:collection1] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 183747 INFO
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 x:collection1]
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from
collection collection1
[junit4] 2> 183747 INFO
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 s:shard3 r:core_node5 x:collection1]
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001/cores/collection1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001/shard-5-001/cores/collection1/data/]
[junit4] 2> 183747 INFO
(coreLoadExecutor-788-thread-1-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 s:shard3 r:core_node5 x:collection1]
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX
Server: com.sun.jmx.mbeanserve
[...truncated too long message...]
223763 INFO (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07])
[ ] o.a.s.c.ChaosMonkey monkey: stop shard! 40702
[junit4] 2> 223763 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.CoreContainer Shutting down CoreContainer instance=10622039
[junit4] 2> 223770 INFO (coreCloseExecutor-816-thread-1)
[n:127.0.0.1:40702_bkb%2Fja c:collection1 s:shard1 r:core_node3 x:collection1]
o.a.s.c.SolrCore [collection1] CLOSING SolrCore
org.apache.solr.core.SolrCore@1497c90
[junit4] 2> 223774 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.Overseer Overseer
(id=96806404689428494-127.0.0.1:40702_bkb%2Fja-n_0000000003) closing
[junit4] 2> 223775 INFO
(OverseerStateUpdate-96806404689428494-127.0.0.1:40702_bkb%2Fja-n_0000000003)
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:40702_bkb%2Fja
[junit4] 2> 223777 INFO
(zkCallback-382-thread-4-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (2)
[junit4] 2> 223777 INFO
(zkCallback-375-thread-6-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (3) -> (2)
[junit4] 2> 223777 INFO
(zkCallback-375-thread-2-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.OverseerElectionContext I am going to
be the leader 127.0.0.1:39009_bkb%2Fja
[junit4] 2> 223780 INFO
(zkCallback-375-thread-2-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.Overseer Overseer
(id=96806404689428497-127.0.0.1:39009_bkb%2Fja-n_0000000004) starting
[junit4] 2> 225276 WARN
(zkCallback-369-thread-2-processing-n:127.0.0.1:40702_bkb%2Fja)
[n:127.0.0.1:40702_bkb%2Fja ] o.a.s.c.c.ZkStateReader ZooKeeper watch
triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for
/live_nodes]
[junit4] 2> 225278 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Stopped
ServerConnector@1dd8d45{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 225278 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@1eab3d3{/bkb/ja,null,UNAVAILABLE}
[junit4] 2> 225278 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ChaosMonkey monkey: stop shard! 39009
[junit4] 2> 225278 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.CoreContainer Shutting down CoreContainer instance=10163774
[junit4] 2> 225312 INFO (coreCloseExecutor-820-thread-1)
[n:127.0.0.1:39009_bkb%2Fja c:collection1 s:shard2 r:core_node4 x:collection1]
o.a.s.c.SolrCore [collection1] CLOSING SolrCore
org.apache.solr.core.SolrCore@1f17264
[junit4] 2> 225315 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.Overseer Overseer
(id=96806404689428497-127.0.0.1:39009_bkb%2Fja-n_0000000004) closing
[junit4] 2> 225315 INFO
(OverseerStateUpdate-96806404689428497-127.0.0.1:39009_bkb%2Fja-n_0000000004)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:39009_bkb%2Fja
[junit4] 2> 225318 WARN
(zkCallback-375-thread-5-processing-n:127.0.0.1:39009_bkb%2Fja)
[n:127.0.0.1:39009_bkb%2Fja ] o.a.s.c.c.ZkStateReader ZooKeeper watch
triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for
/live_nodes]
[junit4] 2> 225318 INFO
(zkCallback-382-thread-6-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (2) -> (1)
[junit4] 2> 225318 INFO
(zkCallback-382-thread-4-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.OverseerElectionContext I am going to
be the leader 127.0.0.1:36102_bkb%2Fja
[junit4] 2> 225319 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Stopped
ServerConnector@1496d06{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 225319 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@6eb706{/bkb/ja,null,UNAVAILABLE}
[junit4] 2> 225319 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ChaosMonkey monkey: stop shard! 36102
[junit4] 2> 225319 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.CoreContainer Shutting down CoreContainer instance=2744447
[junit4] 2> 225341 INFO
(zkCallback-382-thread-4-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.Overseer Overseer
(id=96806404689428500-127.0.0.1:36102_bkb%2Fja-n_0000000005) starting
[junit4] 2> 225344 INFO (coreCloseExecutor-822-thread-1)
[n:127.0.0.1:36102_bkb%2Fja c:collection1 s:shard3 r:core_node5 x:collection1]
o.a.s.c.SolrCore [collection1] CLOSING SolrCore
org.apache.solr.core.SolrCore@1a4f8a4
[junit4] 2> 225372 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.Overseer Overseer
(id=96806404689428500-127.0.0.1:36102_bkb%2Fja-n_0000000005) closing
[junit4] 2> 225372 INFO
(OverseerStateUpdate-96806404689428500-127.0.0.1:36102_bkb%2Fja-n_0000000005)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:36102_bkb%2Fja
[junit4] 2> 225373 INFO
(OverseerCollectionConfigSetProcessor-96806404689428500-127.0.0.1:36102_bkb%2Fja-n_0000000005)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.OverseerTaskProcessor According to ZK
I (id=96806404689428500-127.0.0.1:36102_bkb%2Fja-n_0000000005) am no longer a
leader.
[junit4] 2> 225376 WARN
(zkCallback-382-thread-4-processing-n:127.0.0.1:36102_bkb%2Fja)
[n:127.0.0.1:36102_bkb%2Fja ] o.a.s.c.c.ZkStateReader ZooKeeper watch
triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for
/live_nodes]
[junit4] 2> 225377 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.ServerConnector Stopped
ServerConnector@1ffbe0c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 225377 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@1a70782{/bkb/ja,null,UNAVAILABLE}
[junit4] 2> 225378 INFO
(TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[7C9F1D628159DC07]) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:34157 34157
[junit4] 2> 225424 INFO (Thread-469) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:34157 34157
[junit4] 2> 225425 WARN (Thread-469) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/overseer/collection-queue-work
[junit4] 2> 7 /solr/overseer/queue
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.method=test
-Dtests.seed=7C9F1D628159DC07 -Dtests.multiplier=3 -Dtests.slow=true
-Dtests.locale=fr-BE -Dtests.timezone=Africa/Tunis -Dtests.asserts=true
-Dtests.file.encoding=US-ASCII
[junit4] FAILURE 51.7s J1 | ChaosMonkeyNothingIsSafeTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: document count
mismatch. control=1586 sum(shards)=1587 cloudClient=1587
[junit4] > at
__randomizedtesting.SeedInfo.seed([7C9F1D628159DC07:F4CB22B82FA5B1FF]:0)
[junit4] > at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1323)
[junit4] > at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:231)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
[junit4] > at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 225427 INFO
(SUITE-ChaosMonkeyNothingIsSafeTest-seed#[7C9F1D628159DC07]-worker) [ ]
o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeyNothingIsSafeTest_7C9F1D628159DC07-001
[junit4] 2> Oct 22, 2016 3:02:40 PM
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked
thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70):
{rnd_b=FSTOrd50, _version_=BlockTreeOrds(blocksize=128),
a_t=PostingsFormat(name=LuceneFixedGap), a_i=FSTOrd50, id=FSTOrd50},
docValues:{}, maxPointsInLeafNode=234, maxMBSortInHeap=5.4109826970394765,
sim=ClassicSimilarity, locale=fr-BE, timezone=Africa/Tunis
[junit4] 2> NOTE: Linux 4.4.0-42-generic i386/Oracle Corporation 1.8.0_102
(32-bit)/cpus=12,threads=1,free=25116064,total=140541952
[junit4] 2> NOTE: All tests run in this JVM: [SparseHLLTest,
TestOnReconnectListenerSupport, TestPartialUpdateDeduplication,
TestSolrCoreSnapshots, HdfsCollectionsAPIDistributedZkTest,
TestOverriddenPrefixQueryForCustomFieldType, ShardRoutingCustomTest,
AtomicUpdatesTest, QueryParsingTest, IndexBasedSpellCheckerTest,
TestMiniSolrCloudCluster, HighlighterTest, TestPivotHelperCode,
TimeZoneUtilsTest, TestFastLRUCache, ClusterStateUpdateTest,
BasicFunctionalityTest, TestNumericTerms32, SchemaVersionSpecificBehaviorTest,
DistribJoinFromCollectionTest, ChaosMonkeyNothingIsSafeTest]
[junit4] Completed [103/641 (1!)] on J1 in 51.98s, 1 test, 1 failure <<<
FAILURES!
[...truncated 54422 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
