Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/187/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseG1GC
3 tests failed.
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
Error Message:
3 threads leaked from SUITE scope at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest: 1)
Thread[id=19285,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-EventThread,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at sun.misc.Unsafe.park(Native Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
2) Thread[id=19284,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-SendThread(127.0.0.1:54640),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.lang.Thread.sleep(Native Method) at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 3)
Thread[id=19283, name=Connection evictor, state=TIMED_WAITING,
group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at
java.lang.Thread.sleep(Native Method) at
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE
scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest:
1) Thread[id=19285,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-EventThread,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
2) Thread[id=19284,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-SendThread(127.0.0.1:54640),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
3) Thread[id=19283, name=Connection evictor, state=TIMED_WAITING,
group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.lang.Thread.sleep(Native Method)
at
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([4DD0B3A5072A9817]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
Error Message:
There are still zombie threads that couldn't be terminated: 1)
Thread[id=19284,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-SendThread(127.0.0.1:54640),
state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.lang.Thread.isInterrupted(Native Method) at
java.lang.Thread.isInterrupted(Thread.java:964) at
java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
threads that couldn't be terminated:
1) Thread[id=19284,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-SendThread(127.0.0.1:54640),
state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.lang.Thread.isInterrupted(Native Method)
at java.lang.Thread.isInterrupted(Thread.java:964)
at
java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
at __randomizedtesting.SeedInfo.seed([4DD0B3A5072A9817]:0)
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
Error Message:
shard2 is not consistent. Got 152 from
http://127.0.0.1:54688/e_yc/collection1_shard2_replica_n41 (previous client)
and got 178 from http://127.0.0.1:54768/e_yc/collection1_shard2_replica_n45
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 152 from
http://127.0.0.1:54688/e_yc/collection1_shard2_replica_n41 (previous client)
and got 178 from http://127.0.0.1:54768/e_yc/collection1_shard2_replica_n45
at
__randomizedtesting.SeedInfo.seed([4DD0B3A5072A9817:C5848C7FA9D6F5EF]:0)
at org.junit.Assert.fail(Assert.java:93)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1323)
at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test(ChaosMonkeyNothingIsSafeWithPullReplicasTest.java:275)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12828 lines...]
[junit4] Suite:
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
[junit4] 2> 1922568 INFO
(SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[4DD0B3A5072A9817]-worker)
[ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir:
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\init-core-data-001
[junit4] 2> 1922570 INFO
(SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[4DD0B3A5072A9817]-worker)
[ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1922572 INFO
(SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[4DD0B3A5072A9817]-worker)
[ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1922572 INFO
(SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[4DD0B3A5072A9817]-worker)
[ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system
property: /e_yc/
[junit4] 2> 1922573 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ChaosMonkeyNothingIsSafeWithPullReplicasTest Starting
ChaosMonkey test with 2 shards and 6 nodes
[junit4] 2> 1922578 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1922579 INFO (Thread-4540) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1922579 INFO (Thread-4540) [ ] o.a.s.c.ZkTestServer
Starting server
[junit4] 2> 1922586 ERROR (Thread-4540) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 1922682 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ZkTestServer start zk server on port:54640
[junit4] 2> 1922796 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 1922798 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 1922811 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1922847 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 1922847 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 1922858 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 1922886 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 1922888 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1922889 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1922890 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 1922893 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 1922895 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless
explicitly asked otherwise
[junit4] 2> 1924342 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1924343 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@6607e1{/e_yc,null,AVAILABLE}
[junit4] 2> 1924344 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@1dbacdf{HTTP/1.1,[http/1.1]}{127.0.0.1:54647}
[junit4] 2> 1924344 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server Started @1932053ms
[junit4] 2> 1924344 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\tempDir-001/control/data,
replicaType=NRT, hostContext=/e_yc, hostPort=54647,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\control-001\cores}
[junit4] 2> 1924345 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1924345 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 7.1.0
[junit4] 2> 1924345 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1924345 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default
config dir: null
[junit4] 2> 1924345 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-09-15T20:10:42.958Z
[junit4] 2> 1924359 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1924359 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\control-001\solr.xml
[junit4] 2> 1924373 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1924378 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54640/solr
[junit4] 2> 1924626 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1924626 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:54647_e_yc
[junit4] 2> 1924628 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.c.Overseer Overseer
(id=98664857023217668-127.0.0.1:54647_e_yc-n_0000000000) starting
[junit4] 2> 1924650 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:54647_e_yc
[junit4] 2> 1924664 INFO
(OverseerStateUpdate-98664857023217668-127.0.0.1:54647_e_yc-n_0000000000)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 1924973 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1924983 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1924984 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1924988 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54647_e_yc ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\control-001\cores
[junit4] 2> 1925108 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1925121 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at
127.0.0.1:54640/solr ready
[junit4] 2> 1925131 INFO (qtp7228990-19252) [n:127.0.0.1:54647_e_yc ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54647_e_yc&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1925170 INFO
(OverseerThreadFactory-9422-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.CreateCollectionCmd Create collection
control_collection
[junit4] 2> 1925295 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1925296 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1925423 INFO
(zkCallback-2778-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/control_collection/state.json] for collection
[control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1926334 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1926348 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1926454 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1926484 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1'
using configuration from collection control_collection, trusted=true
[junit4] 2> 1926484 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.control_collection.shard1.replica_n1' (registry
'solr.core.control_collection.shard1.replica_n1') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1926484 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1926485 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore
at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\control-001\cores\control_collection_shard1_replica_n1],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\control-001\cores\control_collection_shard1_replica_n1\data\]
[junit4] 2> 1926493 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.MockRandomMergePolicy:
org.apache.lucene.index.MockRandomMergePolicy@1c2c548
[junit4] 2> 1926540 WARN (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1926651 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 1926651 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1926653 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1926653 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1926655 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3906610519120862]
[junit4] 2> 1926656 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@1bdbc78[control_collection_shard1_replica_n1] main]
[junit4] 2> 1926667 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1926668 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1926668 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1926668 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1578637716651769856
[junit4] 2> 1926671 INFO
(searcherExecutor-9425-thread-1-processing-n:127.0.0.1:54647_e_yc
x:control_collection_shard1_replica_n1 s:shard1 c:control_collection)
[n:127.0.0.1:54647_e_yc c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore
[control_collection_shard1_replica_n1] Registered new searcher
Searcher@1bdbc78[control_collection_shard1_replica_n1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1926720 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1926720 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1926720 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.SyncStrategy Sync replicas to
http://127.0.0.1:54647/e_yc/control_collection_shard1_replica_n1/
[junit4] 2> 1926721 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1926721 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.SyncStrategy
http://127.0.0.1:54647/e_yc/control_collection_shard1_replica_n1/ has no
replicas
[junit4] 2> 1926721 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 1926729 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:54647/e_yc/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1926833 INFO
(zkCallback-2778-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/control_collection/state.json] for collection
[control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1926881 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1926892 INFO (qtp7228990-19250) [n:127.0.0.1:54647_e_yc
c:control_collection s:shard1 x:control_collection_shard1_replica_n1]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1597
[junit4] 2> 1926899 INFO (qtp7228990-19252) [n:127.0.0.1:54647_e_yc ]
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most
30 seconds. Check all shard replicas
[junit4] 2> 1927003 INFO
(zkCallback-2778-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/control_collection/state.json] for collection
[control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1927174 INFO
(OverseerCollectionConfigSetProcessor-98664857023217668-127.0.0.1:54647_e_yc-n_0000000000)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1927899 INFO (qtp7228990-19252) [n:127.0.0.1:54647_e_yc ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54647_e_yc&wt=javabin&version=2}
status=0 QTime=2768
[junit4] 2> 1927964 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1927974 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at
127.0.0.1:54640/solr ready
[junit4] 2> 1927974 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause
connection loss:false
[junit4] 2> 1927978 INFO (qtp7228990-19248) [n:127.0.0.1:54647_e_yc ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1927999 INFO
(OverseerThreadFactory-9422-thread-2-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.CreateCollectionCmd Create collection
collection1
[junit4] 2> 1928011 WARN
(OverseerThreadFactory-9422-thread-2-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.CreateCollectionCmd It is unusual to
create a collection (collection1) without cores.
[junit4] 2> 1928246 INFO (qtp7228990-19248) [n:127.0.0.1:54647_e_yc ]
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most
30 seconds. Check all shard replicas
[junit4] 2> 1928250 INFO (qtp7228990-19248) [n:127.0.0.1:54647_e_yc ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2}
status=0 QTime=272
[junit4] 2> 1928986 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-1-001
of type NRT
[junit4] 2> 1928986 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1928986 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@16b44ea{/e_yc,null,AVAILABLE}
[junit4] 2> 1928989 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@b1df8a{HTTP/1.1,[http/1.1]}{127.0.0.1:54688}
[junit4] 2> 1928994 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server Started @1936704ms
[junit4] 2> 1928994 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\tempDir-001/jetty1,
solrconfig=solrconfig.xml, hostContext=/e_yc, hostPort=54688,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-1-001\cores}
[junit4] 2> 1928994 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1928994 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 7.1.0
[junit4] 2> 1928994 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1928994 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default
config dir: null
[junit4] 2> 1928994 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-09-15T20:10:47.607Z
[junit4] 2> 1929014 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1929014 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-1-001\solr.xml
[junit4] 2> 1929028 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1929033 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54640/solr
[junit4] 2> 1929064 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from
client sessionid 0x15e872a2aaf0008, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1929074 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 1929076 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1929079 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:54688_e_yc
[junit4] 2> 1929092 INFO (zkCallback-2785-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1929092 INFO
(zkCallback-2778-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 1929094 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 1929256 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1929266 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1929267 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1929270 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54688_e_yc ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-1-001\cores
[junit4] 2> 1929386 INFO (qtp17120000-19288) [n:127.0.0.1:54688_e_yc ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params
node=127.0.0.1:54688_e_yc&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1929422 INFO
(OverseerCollectionConfigSetProcessor-98664857023217668-127.0.0.1:54647_e_yc-n_0000000000)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1929424 INFO
(OverseerThreadFactory-9422-thread-3-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.AddReplicaCmd Node Identified
127.0.0.1:54688_e_yc for creating new replica
[junit4] 2> 1929439 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1929440 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1929555 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [2])
[junit4] 2> 1930472 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1930484 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema
[collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 1930592 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1930612 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard2_replica_n41' using configuration from
collection collection1, trusted=true
[junit4] 2> 1930612 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard2.replica_n41' (registry
'solr.core.collection1.shard2.replica_n41') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1930612 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1930613 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore
[[collection1_shard2_replica_n41] ] Opening new SolrCore at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-1-001\cores\collection1_shard2_replica_n41],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-1-001\cores\collection1_shard2_replica_n41\data\]
[junit4] 2> 1930620 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.MockRandomMergePolicy:
org.apache.lucene.index.MockRandomMergePolicy@1a0718a
[junit4] 2> 1930666 WARN (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1930764 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1930765 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1930766 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1930766 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1930767 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3906610519120862]
[junit4] 2> 1930767 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@10c2ecf[collection1_shard2_replica_n41] main]
[junit4] 2> 1930769 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1930770 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1930770 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1930771 INFO
(searcherExecutor-9436-thread-1-processing-n:127.0.0.1:54688_e_yc
x:collection1_shard2_replica_n41 s:shard2 c:collection1)
[n:127.0.0.1:54688_e_yc c:collection1 s:shard2
x:collection1_shard2_replica_n41] o.a.s.c.SolrCore
[collection1_shard2_replica_n41] Registered new searcher
Searcher@10c2ecf[collection1_shard2_replica_n41]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1930771 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1578637720954077184
[junit4] 2> 1930778 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1930778 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1930778 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy
Sync replicas to http://127.0.0.1:54688/e_yc/collection1_shard2_replica_n41/
[junit4] 2> 1930779 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy
Sync Success - now sync replicas to me
[junit4] 2> 1930779 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy
http://127.0.0.1:54688/e_yc/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 1930779 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 1930782 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:54688/e_yc/collection1_shard2_replica_n41/ shard2
[junit4] 2> 1930884 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [2])
[junit4] 2> 1930934 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController
I am the leader, no recovery necessary
[junit4] 2> 1930935 INFO (qtp17120000-19297) [n:127.0.0.1:54688_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1496
[junit4] 2> 1930938 INFO (qtp17120000-19288) [n:127.0.0.1:54688_e_yc ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={node=127.0.0.1:54688_e_yc&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
status=0 QTime=1551
[junit4] 2> 1931040 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [2])
[junit4] 2> 1931443 INFO
(OverseerCollectionConfigSetProcessor-98664857023217668-127.0.0.1:54647_e_yc-n_0000000000)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1931527 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-2-001
of type NRT
[junit4] 2> 1931527 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1931527 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@137db69{/e_yc,null,AVAILABLE}
[junit4] 2> 1931529 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@147b158{HTTP/1.1,[http/1.1]}{127.0.0.1:54740}
[junit4] 2> 1931530 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server Started @1939239ms
[junit4] 2> 1931530 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\tempDir-001/jetty2,
replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/e_yc, hostPort=54740,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-2-001\cores}
[junit4] 2> 1931530 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1931530 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 7.1.0
[junit4] 2> 1931530 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1931531 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default
config dir: null
[junit4] 2> 1931531 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-09-15T20:10:50.144Z
[junit4] 2> 1931535 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from
client sessionid 0x15e872a2aaf000a, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1931535 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1931535 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-2-001\solr.xml
[junit4] 2> 1931547 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1931555 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54640/solr
[junit4] 2> 1931570 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (2)
[junit4] 2> 1931572 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1931576 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:54740_e_yc
[junit4] 2> 1931581 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 1931581 INFO
(zkCallback-2778-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 1931583 INFO (zkCallback-2785-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1931583 INFO
(zkCallback-2796-thread-1-processing-n:127.0.0.1:54740_e_yc)
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 1931710 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1931721 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1931722 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1931725 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54740_e_yc ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-2-001\cores
[junit4] 2> 1931769 INFO (qtp17120000-19294) [n:127.0.0.1:54688_e_yc ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params
node=127.0.0.1:54740_e_yc&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1931772 INFO
(OverseerThreadFactory-9422-thread-4-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.AddReplicaCmd Node Identified
127.0.0.1:54740_e_yc for creating new replica
[junit4] 2> 1931780 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1931781 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1931891 INFO
(zkCallback-2796-thread-1-processing-n:127.0.0.1:54740_e_yc)
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1931891 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1932813 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1932825 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema
[collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 1932890 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1932908 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard1_replica_n43' using configuration from
collection collection1, trusted=true
[junit4] 2> 1932908 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard1.replica_n43' (registry
'solr.core.collection1.shard1.replica_n43') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1932908 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1932908 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore
[[collection1_shard1_replica_n43] ] Opening new SolrCore at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-2-001\cores\collection1_shard1_replica_n43],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-2-001\cores\collection1_shard1_replica_n43\data\]
[junit4] 2> 1932913 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.MockRandomMergePolicy:
org.apache.lucene.index.MockRandomMergePolicy@50c67c
[junit4] 2> 1932919 WARN (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1933000 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1933002 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1933003 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1933004 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1933005 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3906610519120862]
[junit4] 2> 1933006 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@507f31[collection1_shard1_replica_n43] main]
[junit4] 2> 1933007 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1933007 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1933008 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1933008 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1578637723299741696
[junit4] 2> 1933012 INFO
(searcherExecutor-9447-thread-1-processing-n:127.0.0.1:54740_e_yc
x:collection1_shard1_replica_n43 s:shard1 c:collection1)
[n:127.0.0.1:54740_e_yc c:collection1 s:shard1
x:collection1_shard1_replica_n43] o.a.s.c.SolrCore
[collection1_shard1_replica_n43] Registered new searcher
Searcher@507f31[collection1_shard1_replica_n43]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1933017 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1933017 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1933017 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy
Sync replicas to http://127.0.0.1:54740/e_yc/collection1_shard1_replica_n43/
[junit4] 2> 1933017 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy
Sync Success - now sync replicas to me
[junit4] 2> 1933017 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy
http://127.0.0.1:54740/e_yc/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 1933017 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 1933020 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:54740/e_yc/collection1_shard1_replica_n43/ shard1
[junit4] 2> 1933131 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1933131 INFO
(zkCallback-2796-thread-1-processing-n:127.0.0.1:54740_e_yc)
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1933205 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController
I am the leader, no recovery necessary
[junit4] 2> 1933212 INFO (qtp28608844-19321) [n:127.0.0.1:54740_e_yc
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1432
[junit4] 2> 1933214 INFO (qtp17120000-19294) [n:127.0.0.1:54688_e_yc ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={node=127.0.0.1:54740_e_yc&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2}
status=0 QTime=1445
[junit4] 2> 1933327 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1933327 INFO
(zkCallback-2796-thread-1-processing-n:127.0.0.1:54740_e_yc)
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1933716 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-3-001
of type NRT
[junit4] 2> 1933716 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1933717 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1683191{/e_yc,null,AVAILABLE}
[junit4] 2> 1933718 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@19fda63{HTTP/1.1,[http/1.1]}{127.0.0.1:54768}
[junit4] 2> 1933719 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.e.j.s.Server Started @1941428ms
[junit4] 2> 1933719 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties:
{solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\tempDir-001/jetty3,
solrconfig=solrconfig.xml, hostContext=/e_yc, hostPort=54768,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-3-001\cores}
[junit4] 2> 1933719 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1933719 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 7.1.0
[junit4] 2> 1933720 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1933720 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default
config dir: null
[junit4] 2> 1933720 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-09-15T20:10:52.333Z
[junit4] 2> 1933724 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1933724 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-3-001\solr.xml
[junit4] 2> 1933735 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1933741 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54640/solr
[junit4] 2> 1933754 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (3)
[junit4] 2> 1933757 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1933762 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:54768_e_yc
[junit4] 2> 1933763 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1933764 INFO
(zkCallback-2796-thread-1-processing-n:127.0.0.1:54740_e_yc)
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1933764 INFO
(zkCallback-2778-thread-1-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1933764 INFO (zkCallback-2785-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1933765 INFO
(zkCallback-2802-thread-1-processing-n:127.0.0.1:54768_e_yc)
[n:127.0.0.1:54768_e_yc ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (4)
[junit4] 2> 1933777 INFO
(OverseerCollectionConfigSetProcessor-98664857023217668-127.0.0.1:54647_e_yc-n_0000000000)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1933870 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1933878 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1933878 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1933880 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817])
[n:127.0.0.1:54768_e_yc ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-3-001\cores
[junit4] 2> 1933943 INFO (qtp17120000-19293) [n:127.0.0.1:54688_e_yc ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params
node=127.0.0.1:54768_e_yc&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1933946 INFO
(OverseerThreadFactory-9422-thread-5-processing-n:127.0.0.1:54647_e_yc)
[n:127.0.0.1:54647_e_yc ] o.a.s.c.AddReplicaCmd Node Identified
127.0.0.1:54768_e_yc for creating new replica
[junit4] 2> 1933952 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1933953 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4
transient cores
[junit4] 2> 1934062 INFO
(zkCallback-2796-thread-1-processing-n:127.0.0.1:54740_e_yc)
[n:127.0.0.1:54740_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [4])
[junit4] 2> 1934062 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [4])
[junit4] 2> 1934062 INFO
(zkCallback-2802-thread-1-processing-n:127.0.0.1:54768_e_yc)
[n:127.0.0.1:54768_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [4])
[junit4] 2> 1934979 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1934989 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema
[collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 1935044 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1935061 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard2_replica_n45' using configuration from
collection collection1, trusted=true
[junit4] 2> 1935062 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard2.replica_n45' (registry
'solr.core.collection1.shard2.replica_n45') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1ed8293
[junit4] 2> 1935062 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1935062 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore
[[collection1_shard2_replica_n45] ] Opening new SolrCore at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-3-001\cores\collection1_shard2_replica_n45],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_4DD0B3A5072A9817-001\shard-3-001\cores\collection1_shard2_replica_n45\data\]
[junit4] 2> 1935073 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.MockRandomMergePolicy:
org.apache.lucene.index.MockRandomMergePolicy@edc570
[junit4] 2> 1935078 WARN (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1935146 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1935146 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1935147 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1935147 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1935148 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=0.3906610519120862]
[junit4] 2> 1935148 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@e014cc[collection1_shard2_replica_n45] main]
[junit4] 2> 1935151 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1935151 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1935152 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1935153 INFO
(searcherExecutor-9458-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2
x:collection1_shard2_replica_n45] o.a.s.c.SolrCore
[collection1_shard2_replica_n45] Registered new searcher
Searcher@e014cc[collection1_shard2_replica_n45]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1935153 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1578637725548937216
[junit4] 2> 1935156 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkController
Core needs to recover:collection1_shard2_replica_n45
[junit4] 2> 1935157 INFO (qtp7250731-19350) [n:127.0.0.1:54768_e_yc
c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1204
[junit4] 2> 1935160 INFO (qtp17120000-19293) [n:127.0.0.1:54688_e_yc ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={node=127.0.0.1:54768_e_yc&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
status=0 QTime=1217
[junit4] 2> 1935160 INFO
(updateExecutor-2799-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1935160 INFO
(recoveryExecutor-2800-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery
process. recoveringAfterStartup=true
[junit4] 2> 1935160 INFO
(recoveryExecutor-2800-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ######
startupVersions=[[]]
[junit4] 2> 1935160 INFO
(recoveryExecutor-2800-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering
updates. core=[collection1_shard2_replica_n45]
[junit4] 2> 1935160 INFO
(recoveryExecutor-2800-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates.
FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1935160 INFO
(recoveryExecutor-2800-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of
core [collection1_shard2_replica_n45] as recovering, leader is
[http://127.0.0.1:54688/e_yc/collection1_shard2_replica_n41/] and I am
[http://127.0.0.1:54768/e_yc/collection1_shard2_replica_n45/]
[junit4] 2> 1935163 INFO
(recoveryExecutor-2800-thread-1-processing-n:127.0.0.1:54768_e_yc
x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46)
[n:127.0.0.1:54768_e_yc c:collection1 s:shard2 r:core_node46
x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep
recovery command to [http://127.0.0.1:54688/e_yc]; [WaitForState:
action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:54768_e_yc&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1935165 INFO (qtp17120000-19292) [n:127.0.0.1:54688_e_yc ]
o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state:
recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true,
maxTime: 183 s
[junit4] 2> 1935165 INFO (qtp17120000-19292) [n:127.0.0.1:54688_e_yc ]
o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1,
shard=shard2, thisCore=collection1_shard2_replica_n41,
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true,
currentState=down, localState=active, nodeName=127.0.0.1:54768_e_yc,
coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps:
core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:54768/e_yc","node_name":"127.0.0.1:54768_e_yc","state":"down","type":"NRT"}
[junit4] 2> 1935264 INFO
(zkCallback-2790-thread-1-processing-n:127.0.0.1:54688_e_yc)
[n:127.0.0.1:54688_e_yc ] o.a.s.c.c.ZkStateReader A cluster state change:
[WatchedEvent state:SyncConn
[...truncated too long message...]
ndThread.run(ClientCnxn.java:1141)
[junit4] 2> NOTE: test params are:
codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
chunkSize=1, maxDocsPerChunk=1, blockSize=2),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
chunkSize=1, blockSize=2)), sim=RandomSimilarity(queryNorm=false): {},
locale=nl, timezone=Europe/Saratov
[junit4] 2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144
(32-bit)/cpus=3,threads=2,free=351689720,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [CachingDirectoryFactoryTest,
TestSchemaVersionResource, CursorMarkTest,
BigEndianAscendingWordDeserializerTest, UpdateLogTest, TestLockTree,
TestDynamicFieldResource, TestSubQueryTransformerCrossCore,
ConnectionManagerTest, TestCopyFieldCollectionResource, RollingRestartTest,
TestCryptoKeys, NodeMutatorTest, BlockDirectoryTest,
DistributedQueryElevationComponentTest, BitVectorTest, TestReload,
QueryResultKeyTest, OpenExchangeRatesOrgProviderTest,
TestExclusionRuleCollectionAccess, TestFieldCacheReopen, TestMergePolicyConfig,
TestGraphMLResponseWriter, UpdateParamsTest, SegmentsInfoRequestHandlerTest,
DistanceUnitsTest, RequestLoggingTest, HdfsTlogReplayBufferedWhileIndexingTest,
MergeStrategyTest, MigrateRouteKeyTest, ShufflingReplicaListTransformerTest,
HighlighterMaxOffsetTest, ZkFailoverTest, TestNRTOpen, TestMacroExpander,
TestCloudRecovery, TestDistributedGrouping, CloudExitableDirectoryReaderTest,
TestPayloadScoreQParserPlugin, RuleEngineTest,
AddSchemaFieldsUpdateProcessorFactoryTest, TestUniqueKeyFieldResource,
ConnectionReuseTest, TestDelegationWithHadoopAuth, CollectionStateFormat2Test,
BlobRepositoryCloudTest, TestCoreDiscovery, TestMaxScoreQueryParser,
TestUninvertingReader, TestFiltering, RemoteQueryErrorTest, TestZkChroot,
OverseerModifyCollectionTest, ClassificationUpdateProcessorIntegrationTest,
V2StandaloneTest, TestSystemCollAutoCreate, BasicDistributedZk2Test,
TestBM25SimilarityFactory, TestCrossCoreJoin, TestJoin,
TestManagedSynonymFilterFactory, DeleteStatusTest, MBeansHandlerTest,
TestReRankQParserPlugin, TestFieldCacheSortRandom, MoveReplicaHDFSTest,
ShardRoutingCustomTest, SuggesterFSTTest, MoreLikeThisHandlerTest,
SolrIndexConfigTest, TestSolrFieldCacheBean, TestConfigsApi, UtilsToolTest,
TestUseDocValuesAsStored, TestSolrCLIRunExample, HdfsRecoveryZkTest,
LukeRequestHandlerTest, SOLR749Test, DataDrivenBlockJoinTest,
SynonymTokenizerTest, TestTrie, SearchHandlerTest, ExitableDirectoryReaderTest,
TestDFISimilarityFactory, TestPerFieldSimilarityWithDefaultOverride,
CacheHeaderTest, SpellingQueryConverterTest,
TestHighFrequencyDictionaryFactory, PluginInfoTest, TestLegacyField,
OverseerStatusTest, TestSchemaResource, SharedFSAutoReplicaFailoverTest,
TestCharFilters, TestCollapseQParserPlugin, TestConfig, CustomCollectionTest,
TestPolicyCloud, MoveReplicaTest, TestSimpleTrackingShardHandler,
TestFileDictionaryLookup, TestStressLucene, CdcrRequestHandlerTest,
DistributedFacetPivotSmallTest, LoggingHandlerTest, TestStressInPlaceUpdates,
TestRuleBasedAuthorizationPlugin, PreAnalyzedFieldManagedSchemaCloudTest,
MetricsConfigTest, TestDistributedMissingSort, HdfsDirectoryTest,
TestSolr4Spatial2, TestSolrCloudWithSecureImpersonation,
TestOverriddenPrefixQueryForCustomFieldType, DistributedSuggestComponentTest,
TestWordDelimiterFilterFactory, SampleTest,
DistributedQueryComponentCustomSortTest, TestSolrConfigHandler,
TestFieldResource, DistributedTermsComponentTest, BadIndexSchemaTest,
SolrCoreCheckLockOnStartupTest, TestCloudNestedDocsSort,
TestDistributedStatsComponentCardinality, DocumentBuilderTest,
SolrJmxReporterTest, TestExportWriter, PolyFieldTest,
TestSuggestSpellingConverter, TestRecovery, TestPerFieldSimilarity,
TestApiFramework, TestNumericTerms32, TriLevelCompositeIdRoutingTest,
CollectionsAPIAsyncDistributedZkTest, TestFieldCacheWithThreads,
TemplateUpdateProcessorTest, DistributedDebugComponentTest, BadCopyFieldTest,
TestNumericRangeQuery64, TestMinMaxOnMultiValuedField,
TestHdfsBackupRestoreCore, BasicAuthStandaloneTest, DeleteReplicaTest,
DOMUtilTest, DistributedIntervalFacetingTest, TestAuthorizationFramework,
QueryEqualityTest, CloneFieldUpdateProcessorFactoryTest, TestSolrQueryParser,
TestCollectionsAPIViaSolrCloudCluster, BadComponentTest,
ShowFileRequestHandlerTest, TestSolrCloudWithDelegationTokens,
TestMultiWordSynonyms, TestAnalyzedSuggestions, TestManagedResource,
SortSpecParsingTest, TestSystemIdResolver, TestElisionMultitermQuery,
SystemInfoHandlerTest, FileUtilsTest, TestLMJelinekMercerSimilarityFactory,
TestShortCircuitedRequests, SpellPossibilityIteratorTest,
HttpSolrCallGetCoreTest, DistributedFacetExistsSmallTest, SuggesterTSTTest,
TestSSLRandomization, ReplicationFactorTest, TestBinaryResponseWriter,
BasicFunctionalityTest, TestLeaderInitiatedRecoveryThread,
TestRandomFlRTGCloud, BlockJoinFacetDistribTest, TestDocTermOrds,
TestTlogReplica, TestCollationField, BasicDistributedZkTest,
ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest,
CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest,
LeaderElectionIntegrationTest, BasicZkTest, FullSolrCloudDistribCmdsTest,
TestReplicationHandler, TestRangeQuery, SolrCoreTest, SpellCheckComponentTest,
SolrCmdDistributorTest, ConvertedLegacyTest, TestLazyCores,
SolrIndexSplitterTest, SpellCheckCollatorTest, SolrRequestParserTest,
TestFoldingMultitermQuery, DocValuesTest, FieldMutatingUpdateProcessorTest,
DefaultValueUpdateProcessorTest, SortByFunctionTest, TestRemoteStreaming,
TestSolrDeletionPolicy1, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest,
DirectSolrSpellCheckerTest, TestQueryTypes, FileBasedSpellCheckerTest,
XmlUpdateRequestHandlerTest, RequestHandlersTest, TestValueSourceCache,
TermVectorComponentTest, FastVectorHighlighterTest, SolrPluginUtilsTest,
QueryParsingTest, BinaryUpdateRequestHandlerTest,
TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName,
HighlighterConfigTest, AlternateDirectoryTest, TestSolrIndexConfig,
TestQuerySenderNoQuery, CopyFieldTest, TestStressRecovery,
TestSolrDeletionPolicy2, TestDocSet, TestBinaryField,
TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestLuceneMatchVersion,
TestCodecSupport, TestFastWriter, TimeZoneUtilsTest, TestFastOutputStream,
URLClassifyProcessorTest, PreAnalyzedFieldTest, DateFieldTest, TestLRUCache,
TestDocumentBuilder, SliceStateTest, CircularListTest,
DistributedMLTComponentTest, AssignTest, CdcrReplicationDistributedZkTest,
ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=ChaosMonkeyNothingIsSafeWithPullReplicasTest
-Dtests.seed=4DD0B3A5072A9817 -Dtests.slow=true -Dtests.locale=nl
-Dtests.timezone=Europe/Saratov -Dtests.asserts=true
-Dtests.file.encoding=Cp1252
[junit4] ERROR 0.00s J1 | ChaosMonkeyNothingIsSafeWithPullReplicasTest
(suite) <<<
[junit4] > Throwable #1:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE
scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest:
[junit4] > 1) Thread[id=19285,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-EventThread,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] > 2) Thread[id=19284,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-SendThread(127.0.0.1:54640),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
[junit4] > 3) Thread[id=19283, name=Connection evictor,
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at
__randomizedtesting.SeedInfo.seed([4DD0B3A5072A9817]:0)Throwable #2:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
threads that couldn't be terminated:
[junit4] > 1) Thread[id=19284,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[4DD0B3A5072A9817]-SendThread(127.0.0.1:54640),
state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
[junit4] > at java.lang.Thread.isInterrupted(Native Method)
[junit4] > at java.lang.Thread.isInterrupted(Thread.java:964)
[junit4] > at
java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
[junit4] > at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
[junit4] > at
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
[junit4] > at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] > at
__randomizedtesting.SeedInfo.seed([4DD0B3A5072A9817]:0)
[junit4] Completed [509/731 (1!)] on J1 in 109.51s, 1 test, 1 failure, 2
errors <<< FAILURES!
[...truncated 42829 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
