Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/564/
Java: 64bit/jdk-10 -XX:-UseCompressedOops -XX:+UseParallelGC
4 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
Error Message:
Timed out waiting for replica core_node54 (1524650049597) to replicate from
leader core_node42 (1524650073572)
Stack Trace:
java.lang.AssertionError: Timed out waiting for replica core_node54
(1524650049597) to replicate from leader core_node42 (1524650073572)
at
__randomizedtesting.SeedInfo.seed([9BF56E73222FC1FA:13A151A98CD3AC02]:0)
at org.junit.Assert.fail(Assert.java:93)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForReplicationFromReplicas(AbstractFullDistribZkTestBase.java:2146)
at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test(ChaosMonkeyNothingIsSafeWithPullReplicasTest.java:268)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
Error Message:
4 threads leaked from SUITE scope at
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest: 1)
Thread[id=13081,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA]-SendThread(127.0.0.1:58336),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/java.lang.Thread.sleep(Native Method) at
app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at
app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063) 2)
Thread[id=13080, name=Connection evictor, state=TIMED_WAITING,
group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at
java.base@10/java.lang.Thread.sleep(Native Method) at
app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.base@10/java.lang.Thread.run(Thread.java:844) 3)
Thread[id=13083, name=zkConnectionManagerCallback-3866-thread-1, state=WAITING,
group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at
java.base@10/jdk.internal.misc.Unsafe.park(Native Method) at
java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at
java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
at
java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10/java.lang.Thread.run(Thread.java:844) 4)
Thread[id=13082,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA]-EventThread,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/jdk.internal.misc.Unsafe.park(Native Method) at
java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at
java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
at
java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE
scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest:
1) Thread[id=13081,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA]-SendThread(127.0.0.1:58336),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/java.lang.Thread.sleep(Native Method)
at
app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
at
app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
2) Thread[id=13080, name=Connection evictor, state=TIMED_WAITING,
group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/java.lang.Thread.sleep(Native Method)
at
app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.base@10/java.lang.Thread.run(Thread.java:844)
3) Thread[id=13083, name=zkConnectionManagerCallback-3866-thread-1,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
at
java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at
java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
at
java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10/java.lang.Thread.run(Thread.java:844)
4) Thread[id=13082,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA]-EventThread,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
at
java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at
java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
at
java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
at __randomizedtesting.SeedInfo.seed([9BF56E73222FC1FA]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
Error Message:
There are still zombie threads that couldn't be terminated: 1)
Thread[id=13081,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA]-SendThread(127.0.0.1:58336),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/java.lang.Thread.sleep(Native Method) at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054) 2)
Thread[id=13083, name=zkConnectionManagerCallback-3866-thread-1, state=WAITING,
group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest] at
java.base@10/jdk.internal.misc.Unsafe.park(Native Method) at
java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at
java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
at
java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
threads that couldn't be terminated:
1) Thread[id=13081,
name=TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA]-SendThread(127.0.0.1:58336),
state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/java.lang.Thread.sleep(Native Method)
at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)
2) Thread[id=13083, name=zkConnectionManagerCallback-3866-thread-1,
state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeWithPullReplicasTest]
at java.base@10/jdk.internal.misc.Unsafe.park(Native Method)
at
java.base@10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at
java.base@10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2075)
at
java.base@10/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at
java.base@10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([9BF56E73222FC1FA]:0)
FAILED:
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader
Error Message:
Timeout occured while waiting response from server at:
http://127.0.0.1:55558/solr
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at: http://127.0.0.1:55558/solr
at
__randomizedtesting.SeedInfo.seed([9BF56E73222FC1FA:15F90E03573745D0]:0)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at
org.apache.solr.cloud.TestPullReplicaErrorHandling.tearDown(TestPullReplicaErrorHandling.java:128)
at jdk.internal.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at
java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 45 more
Build Log:
[...truncated 13227 lines...]
[junit4] Suite:
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
[junit4] 2> Creating dataDir:
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\init-core-data-001
[junit4] 2> 1124920 INFO
(SUITE-ChaosMonkeyNothingIsSafeWithPullReplicasTest-seed#[9BF56E73222FC1FA]-worker)
[ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system
property: /gwv/rz
[junit4] 2> 1124921 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ChaosMonkeyNothingIsSafeWithPullReplicasTest Starting
ChaosMonkey test with 2 shards and 8 nodes
[junit4] 2> 1124922 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1124923 INFO (Thread-2626) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1124923 INFO (Thread-2626) [ ] o.a.s.c.ZkTestServer
Starting server
[junit4] 2> 1124927 ERROR (Thread-2626) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 1125024 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ZkTestServer start zk server on port:58336
[junit4] 2> 1125027 INFO (zkConnectionManagerCallback-3839-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1125048 INFO (zkConnectionManagerCallback-3841-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1125055 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml
to /configs/conf1/solrconfig.xml
[junit4] 2> 1125057 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml
to /configs/conf1/schema.xml
[junit4] 2> 1125057 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1125062 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt
to /configs/conf1/stopwords.txt
[junit4] 2> 1125064 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt
to /configs/conf1/protwords.txt
[junit4] 2> 1125065 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml
to /configs/conf1/currency.xml
[junit4] 2> 1125070 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml
to /configs/conf1/enumsConfig.xml
[junit4] 2> 1125072 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json
to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1125074 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt
to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1125075 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt
to /configs/conf1/old_synonyms.txt
[junit4] 2> 1125077 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractZkTestCase put
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt
to /configs/conf1/synonyms.txt
[junit4] 2> 1125079 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless
explicitly asked otherwise
[junit4] 2> 1125473 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1125473 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1125473 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1125473 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1125475 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@38c7a3e5{/gwv/rz,null,AVAILABLE}
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@20667e71{HTTP/1.1,[http/1.1]}{127.0.0.1:58343}
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server Started @1125570ms
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/gwv/rz,
solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\tempDir-001/control/data,
hostPort=58343,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\control-001\cores}
[junit4] 2> 1125478 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.4.0
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1125478 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-25T09:53:52.643449400Z
[junit4] 2> 1125481 INFO (zkConnectionManagerCallback-3843-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1125482 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1125483 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\control-001\solr.xml
[junit4] 2> 1125485 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Configuration parameter
autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1125485 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Configuration parameter
autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1125487 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1125490 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58336/solr
[junit4] 2> 1125493 INFO (zkConnectionManagerCallback-3847-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1125496 INFO (zkConnectionManagerCallback-3849-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1125625 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1125626 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.OverseerElectionContext I am going to
be the leader 127.0.0.1:58343_gwv%2Frz
[junit4] 2> 1125627 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.Overseer Overseer
(id=72131880518680580-127.0.0.1:58343_gwv%2Frz-n_0000000000) starting
[junit4] 2> 1125637 INFO (zkConnectionManagerCallback-3856-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1125639 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.s.i.ZkClientClusterStateProvider
Cluster at 127.0.0.1:58336/solr ready
[junit4] 2> 1125640 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:58343_gwv%2Frz
[junit4] 2> 1125641 INFO
(OverseerStateUpdate-72131880518680580-127.0.0.1:58343_gwv%2Frz-n_0000000000) [
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1125643 INFO (zkCallback-3855-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1126084 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1126092 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1126092 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1126094 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\control-001\cores
[junit4] 2> 1126112 INFO (zkConnectionManagerCallback-3861-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1126114 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1126115 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at
127.0.0.1:58336/solr ready
[junit4] 2> 1126117 INFO (qtp1573885047-13033)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CollectionsHandler Invoked
Collection Action :create with params
replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:58343_gwv%252Frz&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1126120 INFO (OverseerThreadFactory-4742-thread-1) [ ]
o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1126226 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CoreAdminOperation core create
command
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1126227 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.c.TransientSolrCoreCacheDefault
Allocating transient cache for 4 transient cores
[junit4] 2> 1127239 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene
MatchVersion: 7.4.0
[junit4] 2> 1127253 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema
[control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1127297 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema
test/1.6 with uniqueid field id
[junit4] 2> 1127311 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore
'control_collection_shard1_replica_n1' using configuration from collection
control_collection, trusted=true
[junit4] 2> 1127311 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX
monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry
'solr.core.control_collection.shard1.replica_n1') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1127311 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1127311 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore
[[control_collection_shard1_replica_n1] ] Opening new SolrCore at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\control-001\cores\control_collection_shard1_replica_n1],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\control-001\cores\control_collection_shard1_replica_n1\data\]
[junit4] 2> 1127316 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
[TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=35,
maxMergedSegmentMB=0.8134765625, floorSegmentMB=1.5283203125,
forceMergeDeletesPctAllowed=22.19769318331324, segmentsPerTier=49.0,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1127359 WARN (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID
paramSet a in requestHandler {type = requestHandler,name = /dump,class =
DumpRequestHandler,attributes = {initParams=a, name=/dump,
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1127409 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog
implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1127409 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1127410 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit:
if uncommited for 15000ms;
[junit4] 2> 1127410 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit:
disabled
[junit4] 2> 1127411 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
[TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=39,
maxMergedSegmentMB=23.0400390625, floorSegmentMB=0.28515625,
forceMergeDeletesPctAllowed=27.960044375073842, segmentsPerTier=37.0,
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1127411 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening
[Searcher@24cdcb1b[control_collection_shard1_replica_n1] main]
[junit4] 2> 1127412 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage
Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1127412 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded
null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1127413 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will
be reserved for 10000ms.
[junit4] 2> 1127413 INFO
(searcherExecutor-4745-thread-1-processing-n:127.0.0.1:58343_gwv%2Frz
x:control_collection_shard1_replica_n1 c:control_collection s:shard1)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore
[control_collection_shard1_replica_n1] Registered new searcher
Searcher@24cdcb1b[control_collection_shard1_replica_n1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1127413 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max
version in index or recent updates, using new clock 1598711434657660928
[junit4] 2> 1127420 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update
of terms at /collections/control_collection/terms/shard1 to
Terms{values={core_node2=0}, version=0}
[junit4] 2> 1127423 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext
Enough replicas found to continue.
[junit4] 2> 1127423 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I
may be the new leader - try and sync
[junit4] 2> 1127423 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to
http://127.0.0.1:58343/gwv/rz/control_collection_shard1_replica_n1/
[junit4] 2> 1127423 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now
sync replicas to me
[junit4] 2> 1127424 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy
http://127.0.0.1:58343/gwv/rz/control_collection_shard1_replica_n1/ has no
replicas
[junit4] 2> 1127424 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext
Found all replicas participating in election, clear LIR
[junit4] 2> 1127427 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am
the new leader:
http://127.0.0.1:58343/gwv/rz/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1127581 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader,
no recovery necessary
[junit4] 2> 1127583 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz c:control_collection s:shard1
x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin]
webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1357
[junit4] 2> 1127585 INFO (qtp1573885047-13033)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CollectionsHandler Wait for new
collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1127683 INFO (zkCallback-3848-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/control_collection/state.json] for collection
[control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1128121 INFO
(OverseerCollectionConfigSetProcessor-72131880518680580-127.0.0.1:58343_gwv%2Frz-n_0000000000)
[ ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1128586 INFO (qtp1573885047-13033)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.s.HttpSolrCall [admin] webapp=null
path=/admin/collections
params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:58343_gwv%252Frz&wt=javabin&version=2}
status=0 QTime=2468
[junit4] 2> 1128591 INFO (zkConnectionManagerCallback-3866-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1128592 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1128593 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at
127.0.0.1:58336/solr ready
[junit4] 2> 1128593 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause
connection loss:false
[junit4] 2> 1128594 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CollectionsHandler Invoked
Collection Action :create with params
replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1128596 INFO (OverseerThreadFactory-4742-thread-2) [ ]
o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1128597 WARN (OverseerThreadFactory-4742-thread-2) [ ]
o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection
(collection1) without cores.
[junit4] 2> 1128803 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CollectionsHandler Wait for new
collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1128804 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.s.HttpSolrCall [admin] webapp=null
path=/admin/collections
params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2}
status=0 QTime=209
[junit4] 2> 1129174 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-1-001
of type NRT
[junit4] 2> 1129175 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1129175 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1129175 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1129175 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1129176 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@76d2fcab{/gwv/rz,null,AVAILABLE}
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@52b74743{HTTP/1.1,[http/1.1]}{127.0.0.1:58367}
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server Started @1129269ms
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/gwv/rz,
solrconfig=solrconfig.xml,
solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\tempDir-001/jetty1,
hostPort=58367,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-1-001\cores}
[junit4] 2> 1129177 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.4.0
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1129177 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1129178 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-25T09:53:56.343496700Z
[junit4] 2> 1129180 INFO (zkConnectionManagerCallback-3868-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1129181 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1129181 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-1-001\solr.xml
[junit4] 2> 1129184 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Configuration parameter
autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1129184 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Configuration parameter
autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1129185 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1129189 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58336/solr
[junit4] 2> 1129192 INFO (zkConnectionManagerCallback-3872-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1129195 INFO (zkConnectionManagerCallback-3874-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1129203 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (1)
[junit4] 2> 1129206 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1129208 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.TransientSolrCoreCacheDefault
Allocating transient cache for 4 transient cores
[junit4] 2> 1129208 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:58367_gwv%2Frz
[junit4] 2> 1129209 INFO (zkCallback-3855-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1129209 INFO (zkCallback-3848-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1129210 INFO (zkCallback-3873-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1129210 INFO (zkCallback-3865-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1129367 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1129376 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1129376 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1129377 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-1-001\cores
[junit4] 2> 1129382 INFO (zkConnectionManagerCallback-3881-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1129383 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (2)
[junit4] 2> 1129384 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58367_gwv%2Frz ] o.a.s.c.s.i.ZkClientClusterStateProvider
Cluster at 127.0.0.1:58336/solr ready
[junit4] 2> 1129403 INFO (qtp1573885047-13035)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CollectionsHandler Invoked
Collection Action :addreplica with params
node=127.0.0.1:58367_gwv%252Frz&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1129406 INFO
(OverseerCollectionConfigSetProcessor-72131880518680580-127.0.0.1:58343_gwv%2Frz-n_0000000000)
[ ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1129407 INFO (OverseerThreadFactory-4742-thread-3) [ ]
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:58367_gwv%2Frz for creating
new replica
[junit4] 2> 1129411 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
] o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1130427 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1130438 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema
[collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 1130482 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1130495 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard2_replica_n41' using configuration from
collection collection1, trusted=true
[junit4] 2> 1130496 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard2.replica_n41' (registry
'solr.core.collection1.shard2.replica_n41') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1130496 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1130496 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore
[[collection1_shard2_replica_n41] ] Opening new SolrCore at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-1-001\cores\collection1_shard2_replica_n41],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-1-001\cores\collection1_shard2_replica_n41\data\]
[junit4] 2> 1130500 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=35, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=0.8134765625,
floorSegmentMB=1.5283203125, forceMergeDeletesPctAllowed=22.19769318331324,
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1130538 WARN (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1130587 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1130587 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1130588 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1130588 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1130589 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=44, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=23.0400390625,
floorSegmentMB=0.28515625, forceMergeDeletesPctAllowed=27.960044375073842,
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1130590 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@5157753c[collection1_shard2_replica_n41] main]
[junit4] 2> 1130591 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1130591 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1130592 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1130592 INFO
(searcherExecutor-4756-thread-1-processing-n:127.0.0.1:58367_gwv%2Frz
x:collection1_shard2_replica_n41 c:collection1 s:shard2)
[n:127.0.0.1:58367_gwv%2Frz c:collection1 s:shard2
x:collection1_shard2_replica_n41] o.a.s.c.SolrCore
[collection1_shard2_replica_n41] Registered new searcher
Searcher@5157753c[collection1_shard2_replica_n41]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1130593 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1598711437992132608
[junit4] 2> 1130598 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms
Successful update of terms at /collections/collection1/terms/shard2 to
Terms{values={core_node42=0}, version=0}
[junit4] 2> 1130601 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1130601 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1130601 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy
Sync replicas to http://127.0.0.1:58367/gwv/rz/collection1_shard2_replica_n41/
[junit4] 2> 1130602 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy
Sync Success - now sync replicas to me
[junit4] 2> 1130602 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy
http://127.0.0.1:58367/gwv/rz/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 1130602 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 1130605 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:58367/gwv/rz/collection1_shard2_replica_n41/ shard2
[junit4] 2> 1130709 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController
I am the leader, no recovery necessary
[junit4] 2> 1130711 INFO (qtp433505648-13085) [n:127.0.0.1:58367_gwv%2Frz
c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1300
[junit4] 2> 1130713 INFO (qtp1573885047-13035)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.s.HttpSolrCall [admin] webapp=null
path=/admin/collections
params={node=127.0.0.1:58367_gwv%252Frz&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2}
status=0 QTime=1310
[junit4] 2> 1130811 INFO (zkCallback-3873-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [2])
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-2-001
of type NRT
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@56242ca7{/gwv/rz,null,AVAILABLE}
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@40b609cb{HTTP/1.1,[http/1.1]}{127.0.0.1:58383}
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server Started @1131115ms
[junit4] 2> 1131020 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/gwv/rz,
solrconfig=solrconfig.xml,
solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\tempDir-001/jetty2,
hostPort=58383,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-2-001\cores}
[junit4] 2> 1131020 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1131026 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1131026 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.4.0
[junit4] 2> 1131026 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1131026 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1131026 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-25T09:53:58.191538700Z
[junit4] 2> 1131029 INFO (zkConnectionManagerCallback-3883-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1131029 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in
ZooKeeper)
[junit4] 2> 1131029 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Loading container configuration from
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-2-001\solr.xml
[junit4] 2> 1131031 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Configuration parameter
autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1131031 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig Configuration parameter
autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1131033 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.SolrXmlConfig MBean server found:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd, but no JMX reporters were
configured - adding default JMX reporter.
[junit4] 2> 1131036 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58336/solr
[junit4] 2> 1131037 INFO (zkConnectionManagerCallback-3887-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1131039 INFO (zkConnectionManagerCallback-3889-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1131047 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (2)
[junit4] 2> 1131049 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1131051 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.TransientSolrCoreCacheDefault
Allocating transient cache for 4 transient cores
[junit4] 2> 1131051 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:58383_gwv%2Frz
[junit4] 2> 1131053 INFO (zkCallback-3873-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1131053 INFO (zkCallback-3855-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1131053 INFO (zkCallback-3848-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1131053 INFO (zkCallback-3865-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1131053 INFO (zkCallback-3880-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1131053 INFO (zkCallback-3888-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1131205 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1131216 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1131216 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1131218 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-2-001\cores
[junit4] 2> 1131221 INFO (zkConnectionManagerCallback-3896-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1131222 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.c.ZkStateReader Updated live nodes
from ZooKeeper... (0) -> (3)
[junit4] 2> 1131223 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[n:127.0.0.1:58383_gwv%2Frz ] o.a.s.c.s.i.ZkClientClusterStateProvider
Cluster at 127.0.0.1:58336/solr ready
[junit4] 2> 1131250 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.h.a.CollectionsHandler Invoked
Collection Action :addreplica with params
node=127.0.0.1:58383_gwv%252Frz&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 1131252 INFO
(OverseerCollectionConfigSetProcessor-72131880518680580-127.0.0.1:58343_gwv%2Frz-n_0000000000)
[ ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 1131252 INFO (OverseerThreadFactory-4742-thread-4) [ ]
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:58383_gwv%2Frz for creating
new replica
[junit4] 2> 1131256 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
] o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1131362 INFO (zkCallback-3873-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1132270 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.4.0
[junit4] 2> 1132278 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema
[collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 1132323 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema
Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1132337 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard1_replica_n43' using configuration from
collection collection1, trusted=true
[junit4] 2> 1132338 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr.core.collection1.shard1.replica_n43' (registry
'solr.core.collection1.shard1.replica_n43') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@1e29bd
[junit4] 2> 1132338 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 1132338 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore
[[collection1_shard1_replica_n43] ] Opening new SolrCore at
[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-2-001\cores\collection1_shard1_replica_n43],
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-2-001\cores\collection1_shard1_replica_n43\data\]
[junit4] 2> 1132343 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=35, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=0.8134765625,
floorSegmentMB=1.5283203125, forceMergeDeletesPctAllowed=22.19769318331324,
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1132393 WARN (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type =
requestHandler,name = /dump,class = DumpRequestHandler,attributes =
{initParams=a, name=/dump, class=DumpRequestHandler},args =
{defaults={a=A,b=B}}}
[junit4] 2> 1132455 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1132455 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1132456 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker
Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 1132456 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 1132457 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=44, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=23.0400390625,
floorSegmentMB=0.28515625, forceMergeDeletesPctAllowed=27.960044375073842,
segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1132457 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@57ecdfe2[collection1_shard1_replica_n43] main]
[junit4] 2> 1132459 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf1
[junit4] 2> 1132459 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1132460 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1132461 INFO
(searcherExecutor-4767-thread-1-processing-n:127.0.0.1:58383_gwv%2Frz
x:collection1_shard1_replica_n43 c:collection1 s:shard1)
[n:127.0.0.1:58383_gwv%2Frz c:collection1 s:shard1
x:collection1_shard1_replica_n43] o.a.s.c.SolrCore
[collection1_shard1_replica_n43] Registered new searcher
Searcher@57ecdfe2[collection1_shard1_replica_n43]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1132461 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog
Could not find max version in index or recent updates, using new clock
1598711439950872576
[junit4] 2> 1132466 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkShardTerms
Successful update of terms at /collections/collection1/terms/shard1 to
Terms{values={core_node44=0}, version=0}
[junit4] 2> 1132469 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1132469 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1132469 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy
Sync replicas to http://127.0.0.1:58383/gwv/rz/collection1_shard1_replica_n43/
[junit4] 2> 1132469 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy
Sync Success - now sync replicas to me
[junit4] 2> 1132470 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy
http://127.0.0.1:58383/gwv/rz/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 1132470 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 1132473 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:58383/gwv/rz/collection1_shard1_replica_n43/ shard1
[junit4] 2> 1132575 INFO (zkCallback-3873-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1132625 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController
I am the leader, no recovery necessary
[junit4] 2> 1132629 INFO (qtp745804631-13121) [n:127.0.0.1:58383_gwv%2Frz
c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=1371
[junit4] 2> 1132631 INFO (qtp1573885047-13038)
[n:127.0.0.1:58343_gwv%2Frz ] o.a.s.s.HttpSolrCall [admin] webapp=null
path=/admin/collections
params={node=127.0.0.1:58383_gwv%252Frz&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2}
status=0 QTime=1381
[junit4] 2> 1132728 INFO (zkCallback-3873-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1132729 INFO (zkCallback-3888-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [3])
[junit4] 2> 1133039 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-3-001
of type NRT
[junit4] 2> 1133040 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1133040 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1133040 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1133040 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1133041 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@58026559{/gwv/rz,null,AVAILABLE}
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.AbstractConnector Started
ServerConnector@6b354887{HTTP/1.1,[http/1.1]}{127.0.0.1:58399}
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.e.j.s.Server Started @1133134ms
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/gwv/rz,
solrconfig=solrconfig.xml,
solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\tempDir-001/jetty3,
hostPort=58399,
coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest_9BF56E73222FC1FA-001\shard-3-001\cores,
replicaType=NRT}
[junit4] 2> 1133042 ERROR
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr?
version 7.4.0
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1133042 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-25T09:54:00.207568Z
[junit4] 2> 1133045 INFO (zkConnectionManagerCallback-3898-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1133046 INFO
(TEST-ChaosMonkeyNothingIsSafeWithPullReplicasTest.test-seed#[9BF56E73222FC1FA])
[ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrH
[...truncated too long message...]
ZooKeeper... (4) -> (1)
[junit4] 2> 1468241 INFO (zkCallback-1393-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
[junit4] 2> 1468242 INFO (zkCallback-1431-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
[junit4] 2> 1468242 INFO (zkCallback-1416-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
[junit4] 2> 1468242 INFO (zkCallback-1401-thread-15) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
[junit4] 2> 1468242 INFO (zkCallback-1438-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
[junit4] 2> 1468242 WARN
(OverseerAutoScalingTriggerThread-72131844976803861-127.0.0.1:55542_solr-n_0000000004)
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we
are closed, exiting.
[junit4] 2> 1468243 INFO (jetty-closer-1310-thread-8) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 1468244 INFO (zkCallback-1386-thread-8) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (0)
[junit4] 2> 1468246 INFO (zkCallback-1438-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1468246 INFO (zkCallback-1416-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1468246 INFO (zkCallback-1393-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1468246 INFO (zkCallback-1401-thread-15) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1468246 INFO (zkCallback-1431-thread-5) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1468246 INFO (jetty-closer-1310-thread-3) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@2706009e{/solr,null,UNAVAILABLE}
[junit4] 2> 1468247 INFO (jetty-closer-1310-thread-3) [ ]
o.e.j.s.session Stopped scavenging
[junit4] 2> 1468247 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid
0x1004387e4d60021, likely client has closed socket
[junit4] 2> 1468248 INFO (zkCallback-1401-thread-15) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55558_solr
[junit4] 2> 1468248 INFO (jetty-closer-1310-thread-1) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@69dcd230{/solr,null,UNAVAILABLE}
[junit4] 2> 1468248 INFO (jetty-closer-1310-thread-1) [ ]
o.e.j.s.session Stopped scavenging
[junit4] 2> 1469742 WARN (zkCallback-1408-thread-3) [ ]
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK:
[KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1469743 INFO (jetty-closer-1310-thread-2) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@35a0b6b{/solr,null,UNAVAILABLE}
[junit4] 2> 1469743 INFO (jetty-closer-1310-thread-2) [ ]
o.e.j.s.session Stopped scavenging
[junit4] 2> 1469748 INFO (jetty-closer-1310-thread-8) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@15c919e5{/solr,null,UNAVAILABLE}
[junit4] 2> 1469748 INFO (jetty-closer-1310-thread-8) [ ]
o.e.j.s.session Stopped scavenging
[junit4] 2> 1469749 ERROR
(SUITE-TestPullReplicaErrorHandling-seed#[9BF56E73222FC1FA]-worker) [ ]
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper
server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1469750 INFO
(SUITE-TestPullReplicaErrorHandling-seed#[9BF56E73222FC1FA]-worker) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:55472 55472
[junit4] 2> 1469751 INFO (Thread-808) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:55472 55472
[junit4] 2> 1469752 WARN (Thread-808) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 18 /solr/aliases.json
[junit4] 2> 17 /solr/clusterprops.json
[junit4] 2> 9 /solr/security.json
[junit4] 2> 9 /solr/configs/conf
[junit4] 2> 8
/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/terms/shard1
[junit4] 2> 7
/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/terms/shard1
[junit4] 2> 7
/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard2
[junit4] 2> 5
/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 18 /solr/clusterstate.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 7
/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json
[junit4] 2> 4
/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
[junit4] 2> 3 /solr/autoscaling.json
[junit4] 2> 2
/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/state.json
[junit4] 2> 2
/solr/overseer_elect/election/72131844976803851-127.0.0.1:55485_solr-n_0000000001
[junit4] 2> 2
/solr/overseer_elect/election/72131844976803861-127.0.0.1:55542_solr-n_0000000004
[junit4] 2> 2
/solr/overseer_elect/election/72131844976803850-127.0.0.1:55479_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 18 /solr/collections
[junit4] 2> 17 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at:
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestPullReplicaErrorHandling_9BF56E73222FC1FA-001
[junit4] 2> Apr 25, 2018 9:59:37 AM
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked
thread(s).
[junit4] 2> NOTE: test params are:
codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
chunkSize=1, maxDocsPerChunk=3, blockSize=916),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
chunkSize=1, blockSize=916)), sim=RandomSimilarity(queryNorm=false): {},
locale=ln-CD, timezone=Pacific/Fakaofo
[junit4] 2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 10
(64-bit)/cpus=3,threads=1,free=55117840,total=373817344
[junit4] 2> NOTE: All tests run in this JVM:
[TestSolrCloudWithHadoopAuthPlugin, UtilsToolTest,
TestLeaderInitiatedRecoveryThread, TestTlogReplica, TestRestoreCore,
TestTolerantSearch, AtomicUpdatesTest, UUIDUpdateProcessorFallbackTest,
ExitableDirectoryReaderTest, UnloadDistributedZkTest, LeaderElectionTest,
DeleteNodeTest, BasicAuthStandaloneTest, ComputePlanActionTest,
TestRequestStatusCollectionAPI, TestConfigOverlay, TestInitQParser,
CloneFieldUpdateProcessorFactoryTest, OverseerTaskQueueTest,
TestImplicitCoreProperties, CdcrUpdateLogTest, SolrIndexSplitterTest,
ResourceLoaderTest, TestConfigSetsAPIExclusivity,
TriggerSetPropertiesIntegrationTest, TestJsonFacets, CollectionReloadTest,
TestSolrFieldCacheBean, TestSortableTextField,
AddSchemaFieldsUpdateProcessorFactoryTest, TestSolrConfigHandlerConcurrent,
TestPayloadScoreQParserPlugin, HdfsChaosMonkeyNothingIsSafeTest,
TestCoreAdminApis, SpellingQueryConverterTest, TestSubQueryTransformerDistrib,
TestReload, MetricsConfigTest, IndexSchemaRuntimeFieldTest,
TestSizeLimitedDistributedMap, TestMaxScoreQueryParser,
DistributedQueryElevationComponentTest, TestSolr4Spatial2, SolrJmxReporterTest,
TestJsonRequest, MergeStrategyTest, TestIBSimilarityFactory, CacheHeaderTest,
CursorPagingTest, TestDelegationWithHadoopAuth, DirectSolrSpellCheckerTest,
TestCSVResponseWriter, TestCharFilters, FileUtilsTest, SolrCLIZkUtilsTest,
AutoAddReplicasPlanActionTest, HdfsNNFailoverTest, TestFunctionQuery,
CopyFieldTest, TestCoreBackup, TestPullReplicaErrorHandling]
[junit4] Completed [663/803 (2!)] on J0 in 887.76s, 3 tests, 1 error <<<
FAILURES!
[...truncated 44183 lines...]
[repro] Jenkins log URL:
https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/564/consoleText
[repro] Revision: 5a89f604cdfc6fde68c8e6a5fdfb01f5ac3f732d
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr\core
[repro] ChaosMonkeyNothingIsSafeWithPullReplicasTest
[repro] TestPullReplicaErrorHandling
[repro] ant compile-test
[...truncated 3342 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10
-Dtests.class="*.ChaosMonkeyNothingIsSafeWithPullReplicasTest|*.TestPullReplicaErrorHandling"
-Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
-Dtests.seed=9BF56E73222FC1FA -Dtests.slow=true -Dtests.locale=gd-GB
-Dtests.timezone=America/Cambridge_Bay -Dtests.asserts=true
-Dtests.file.encoding=ISO-8859-1
[...truncated 120 lines...]
[repro] Failures:
[repro] 0/5 failed:
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest
[repro] 0/5 failed: org.apache.solr.cloud.TestPullReplicaErrorHandling
[repro] Exiting with code 0
[...truncated 75 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
