Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3021/
Java: 64bit/jdk-10.0.1 -XX:-UseCompressedOops -XX:+UseSerialGC

4 tests failed.
FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:39431/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:39431/solr
        at 
__randomizedtesting.SeedInfo.seed([3D77588542DE8167:FC8721296F8E4BC0]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
        at 
org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:45593/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:45593/solr
        at 
__randomizedtesting.SeedInfo.seed([3D77588542DE8167:FC8721296F8E4BC0]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
        at 
org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:43005/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:43005/solr
        at 
__randomizedtesting.SeedInfo.seed([3D77588542DE8167:FC8721296F8E4BC0]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
        at 
org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:
Can not find doc 7 in https://127.0.0.1:42259/solr

Stack Trace:
java.lang.AssertionError: Can not find doc 7 in https://127.0.0.1:42259/solr
        at 
__randomizedtesting.SeedInfo.seed([3D77588542DE8167:FC8721296F8E4BC0]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:902)
        at 
org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:567)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 13068 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTlogReplica
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/init-core-data-001
   [junit4]   2> 408536 WARN  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=66 numCloses=66
   [junit4]   2> 408536 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 408537 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 408538 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 408538 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001
   [junit4]   2> 408538 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 408543 INFO  (Thread-665) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 408543 INFO  (Thread-665) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 408552 ERROR (Thread-665) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 408642 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:37327
   [junit4]   2> 408678 INFO  (zkConnectionManagerCallback-812-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 408686 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 10.0.1+10
   [junit4]   2> 408688 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 10.0.1+10
   [junit4]   2> 408702 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 408702 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 408702 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 408702 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 408702 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 408702 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 408706 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@e4a6e9e{/solr,null,AVAILABLE}
   [junit4]   2> 408706 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@e636a26{/solr,null,AVAILABLE}
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@40796954{SSL,[ssl, 
http/1.1]}{127.0.0.1:42259}
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.e.j.s.Server Started @408738ms
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=42259}
   [junit4]   2> 408708 ERROR (jetty-launcher-809-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.6.0
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 408708 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-11-02T09:28:18.070806Z
   [junit4]   2> 408710 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@64509572{SSL,[ssl, 
http/1.1]}{127.0.0.1:43373}
   [junit4]   2> 408710 INFO  (jetty-launcher-809-thread-1) [    ] 
o.e.j.s.Server Started @408741ms
   [junit4]   2> 408710 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=43373}
   [junit4]   2> 408711 ERROR (jetty-launcher-809-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 408711 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 408711 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.6.0
   [junit4]   2> 408711 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 408711 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 408711 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-11-02T09:28:18.073354Z
   [junit4]   2> 408726 INFO  (zkConnectionManagerCallback-814-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 408726 INFO  (zkConnectionManagerCallback-816-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 408726 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 408726 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 408730 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x1001f4d282d0001, likely client has closed socket
   [junit4]   2> 408829 INFO  (jetty-launcher-809-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37327/solr
   [junit4]   2> 408832 INFO  (zkConnectionManagerCallback-820-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 408838 INFO  (zkConnectionManagerCallback-822-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 408893 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:43373_solr
   [junit4]   2> 408893 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.Overseer Overseer 
(id=72092010284908548-127.0.0.1:43373_solr-n_0000000000) starting
   [junit4]   2> 408906 INFO  (zkConnectionManagerCallback-829-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 408907 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:37327/solr ready
   [junit4]   2> 408911 INFO  
(OverseerStateUpdate-72092010284908548-127.0.0.1:43373_solr-n_0000000000) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:43373_solr
   [junit4]   2> 408922 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:43373_solr
   [junit4]   2> 408931 INFO  (zkCallback-821-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 408934 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 408949 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43373.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 408960 INFO  (zkCallback-828-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 408988 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43373.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 408988 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43373.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 408989 INFO  (jetty-launcher-809-thread-1) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node1/.
   [junit4]   2> 409045 INFO  (jetty-launcher-809-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37327/solr
   [junit4]   2> 409066 INFO  (zkConnectionManagerCallback-834-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 409098 INFO  (zkConnectionManagerCallback-836-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 409107 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 409109 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 409109 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:42259_solr
   [junit4]   2> 409110 INFO  (zkCallback-821-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 409111 INFO  (zkCallback-835-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 409111 INFO  (zkCallback-828-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 409120 INFO  (zkConnectionManagerCallback-843-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 409120 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 409121 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:37327/solr ready
   [junit4]   2> 409121 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 409132 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42259.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 409136 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42259.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 409137 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42259.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 409137 INFO  (jetty-launcher-809-thread-2) 
[n:127.0.0.1:42259_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node2/.
   [junit4]   2> 409162 INFO  (zkConnectionManagerCallback-846-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 409173 INFO  (zkConnectionManagerCallback-851-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 409173 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 409173 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37327/solr ready
   [junit4]   2> 409176 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.TestTlogReplica Using legacyCloud?: false
   [junit4]   2> 409194 INFO  (qtp1858180860-3049) [n:127.0.0.1:42259_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params 
val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 409195 INFO  (qtp1858180860-3049) [n:127.0.0.1:42259_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} 
status=0 QTime=0
   [junit4]   2> 409208 INFO  
(TEST-TestTlogReplica.testAddDocs-seed#[3D77588542DE8167]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testAddDocs
   [junit4]   2> 409210 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_add_docs&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=3&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 409219 INFO  
(OverseerThreadFactory-1585-thread-1-processing-n:127.0.0.1:43373_solr) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
tlog_replica_test_add_docs
   [junit4]   2> 409325 WARN  
(OverseerThreadFactory-1585-thread-1-processing-n:127.0.0.1:43373_solr) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.a.c.CreateCollectionCmd Specified number 
of replicas of 3 on collection tlog_replica_test_add_docs is higher than the 
number of Solr instances currently live or live and part of your 
createNodeSet(2). It's unusual to run two replica of the same slice on the same 
Solr-instance.
   [junit4]   2> 409329 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 409339 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 409342 INFO  
(OverseerStateUpdate-72092010284908548-127.0.0.1:43373_solr-n_0000000000) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_add_docs",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_add_docs_shard1_replica_t1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43373/solr";,
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 409343 INFO  
(OverseerStateUpdate-72092010284908548-127.0.0.1:43373_solr-n_0000000000) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_add_docs",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_add_docs_shard1_replica_t2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42259/solr";,
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 409343 INFO  
(OverseerStateUpdate-72092010284908548-127.0.0.1:43373_solr-n_0000000000) 
[n:127.0.0.1:43373_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"tlog_replica_test_add_docs",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"tlog_replica_test_add_docs_shard1_replica_t4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42259/solr";,
   [junit4]   2>   "type":"TLOG",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 409562 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr    
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.a.CoreAdminOperation 
core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 409562 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr    
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.h.a.CoreAdminOperation 
core create command 
qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t4&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 409562 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr    
x:tlog_replica_test_add_docs_shard1_replica_t1] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 409564 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr    
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.a.CoreAdminOperation 
core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 410580 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 7.6.0
   [junit4]   2> 410583 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 7.6.0
   [junit4]   2> 410587 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 7.6.0
   [junit4]   2> 410599 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.IndexSchema 
[tlog_replica_test_add_docs_shard1_replica_t1] Schema name=minimal
   [junit4]   2> 410601 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 410601 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.CoreContainer Creating 
SolrCore 'tlog_replica_test_add_docs_shard1_replica_t1' using configuration 
from collection tlog_replica_test_add_docs, trusted=true
   [junit4]   2> 410602 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 
'solr_43373.solr.core.tlog_replica_test_add_docs.shard1.replica_t1' (registry 
'solr.core.tlog_replica_test_add_docs.shard1.replica_t1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 410602 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.SolrCore 
[[tlog_replica_test_add_docs_shard1_replica_t1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node1/tlog_replica_test_add_docs_shard1_replica_t1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node1/./tlog_replica_test_add_docs_shard1_replica_t1/data/]
   [junit4]   2> 410617 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.IndexSchema 
[tlog_replica_test_add_docs_shard1_replica_t2] Schema name=minimal
   [junit4]   2> 410617 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.IndexSchema 
[tlog_replica_test_add_docs_shard1_replica_t4] Schema name=minimal
   [junit4]   2> 410618 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 410618 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 410618 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.CoreContainer Creating 
SolrCore 'tlog_replica_test_add_docs_shard1_replica_t4' using configuration 
from collection tlog_replica_test_add_docs, trusted=true
   [junit4]   2> 410618 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.CoreContainer Creating 
SolrCore 'tlog_replica_test_add_docs_shard1_replica_t2' using configuration 
from collection tlog_replica_test_add_docs, trusted=true
   [junit4]   2> 410619 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 
'solr_42259.solr.core.tlog_replica_test_add_docs.shard1.replica_t2' (registry 
'solr.core.tlog_replica_test_add_docs.shard1.replica_t2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 410619 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.SolrCore 
[[tlog_replica_test_add_docs_shard1_replica_t2] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node2/tlog_replica_test_add_docs_shard1_replica_t2],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node2/./tlog_replica_test_add_docs_shard1_replica_t2/data/]
   [junit4]   2> 410622 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 
'solr_42259.solr.core.tlog_replica_test_add_docs.shard1.replica_t4' (registry 
'solr.core.tlog_replica_test_add_docs.shard1.replica_t4') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@14649e8
   [junit4]   2> 410622 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SolrCore 
[[tlog_replica_test_add_docs_shard1_replica_t4] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node2/tlog_replica_test_add_docs_shard1_replica_t4],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-001/tempDir-001/node2/./tlog_replica_test_add_docs_shard1_replica_t4/data/]
   [junit4]   2> 410756 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 410756 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 410780 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 410780 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 410781 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@1f8f07b4[tlog_replica_test_add_docs_shard1_replica_t2] main]
   [junit4]   2> 410782 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 410783 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 410783 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 410783 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1616013846270443520
   [junit4]   2> 410788 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 410789 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 410790 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 410790 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 410791 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@4317939c[tlog_replica_test_add_docs_shard1_replica_t4] main]
   [junit4]   2> 410798 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 410802 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 410802 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 410802 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 410803 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 410803 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1616013846291415040
   [junit4]   2> 410804 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 410804 INFO  
(searcherExecutor-1598-thread-1-processing-n:127.0.0.1:42259_solr 
x:tlog_replica_test_add_docs_shard1_replica_t4 c:tlog_replica_test_add_docs 
s:shard1 r:core_node6) [n:127.0.0.1:42259_solr c:tlog_replica_test_add_docs 
s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t4] Registered new 
searcher Searcher@4317939c[tlog_replica_test_add_docs_shard1_replica_t4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 410804 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 410815 INFO  
(searcherExecutor-1599-thread-1-processing-n:127.0.0.1:42259_solr 
x:tlog_replica_test_add_docs_shard1_replica_t2 c:tlog_replica_test_add_docs 
s:shard1 r:core_node5) [n:127.0.0.1:42259_solr c:tlog_replica_test_add_docs 
s:shard1 r:core_node5 x:tlog_replica_test_add_docs_shard1_replica_t2] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t2] Registered new 
searcher Searcher@1f8f07b4[tlog_replica_test_add_docs_shard1_replica_t2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 410816 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@1635b209[tlog_replica_test_add_docs_shard1_replica_t1] main]
   [junit4]   2> 410823 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 410826 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 410826 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.ZkShardTerms Successful 
update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to 
Terms{values={core_node5=0}, version=0}
   [junit4]   2> 410826 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkShardTerms Failed to 
save terms, version is not a match, retrying
   [junit4]   2> 410827 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 410827 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1616013846316580864
   [junit4]   2> 410828 INFO  
(searcherExecutor-1597-thread-1-processing-n:127.0.0.1:43373_solr 
x:tlog_replica_test_add_docs_shard1_replica_t1 c:tlog_replica_test_add_docs 
s:shard1 r:core_node3) [n:127.0.0.1:43373_solr c:tlog_replica_test_add_docs 
s:shard1 r:core_node3 x:tlog_replica_test_add_docs_shard1_replica_t1] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t1] Registered new 
searcher Searcher@1635b209[tlog_replica_test_add_docs_shard1_replica_t1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 410828 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkShardTerms Successful 
update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to 
Terms{values={core_node6=0, core_node5=0}, version=1}
   [junit4]   2> 410846 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.ZkShardTerms Successful 
update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to 
Terms{values={core_node6=0, core_node3=0, core_node5=0}, version=2}
   [junit4]   2> 410847 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=3 found=2 timeoutin=9999ms
   [junit4]   2> 411347 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 411347 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 411347 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SyncStrategy Sync 
replicas to 
https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t4/
   [junit4]   2> 411348 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.PeerSync PeerSync: 
core=tlog_replica_test_add_docs_shard1_replica_t4 
url=https://127.0.0.1:42259/solr START 
replicas=[https://127.0.0.1:43373/solr/tlog_replica_test_add_docs_shard1_replica_t1/,
 https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t2/] 
nUpdates=100
   [junit4]   2> 411348 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.PeerSync PeerSync: 
core=tlog_replica_test_add_docs_shard1_replica_t4 
url=https://127.0.0.1:42259/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 411352 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 411352 INFO  (qtp1858180860-3039) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 411352 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.SyncStrategy Leader's 
attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 411353 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 411353 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 411353 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkController 
tlog_replica_test_add_docs_shard1_replica_t4 stopping background replication 
from leader
   [junit4]   2> 411355 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t4/ 
shard1
   [junit4]   2> 411456 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 411526 INFO  (qtp1858180860-3035) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t4&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG}
 status=0 QTime=1964
   [junit4]   2> 411559 INFO  (zkCallback-835-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/tlog_replica_test_add_docs/state.json] for collection 
[tlog_replica_test_add_docs] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 411846 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.ZkController 
tlog_replica_test_add_docs_shard1_replica_t2 starting background replication 
from leader
   [junit4]   2> 411846 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.c.ReplicateFromLeader 
Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 411848 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.ReplicationHandler Poll 
scheduled at an interval of 3000ms
   [junit4]   2> 411848 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 411848 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Updated masterUrl to 
https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t4/
   [junit4]   2> 411849 INFO  (qtp1858180860-3041) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 411849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 411849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 411849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 411849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 411849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 411850 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@74231cab[tlog_replica_test_add_docs_shard1_replica_t2] main]
   [junit4]   2> 411850 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.ZkController 
tlog_replica_test_add_docs_shard1_replica_t1 starting background replication 
from leader
   [junit4]   2> 411850 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG}
 status=0 QTime=2286
   [junit4]   2> 411850 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.ReplicateFromLeader 
Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 411851 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.ReplicationHandler Poll 
scheduled at an interval of 3000ms
   [junit4]   2> 411851 INFO  (searcherExecutor-1599-thread-1) [    ] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t2] Registered new 
searcher Searcher@74231cab[tlog_replica_test_add_docs_shard1_replica_t2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 411851 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 411853 INFO  (qtp1744471353-3044) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_add_docs_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_add_docs&shard=shard1&wt=javabin&version=2&replicaType=TLOG}
 status=0 QTime=2291
   [junit4]   2> 411860 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 411920 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Updated masterUrl to 
https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t4/
   [junit4]   2> 411921 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 411921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 411921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 411921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 411921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 411921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 411922 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@37cb847b[tlog_replica_test_add_docs_shard1_replica_t1] main]
   [junit4]   2> 411922 INFO  (searcherExecutor-1597-thread-1) [    ] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t1] Registered new 
searcher Searcher@37cb847b[tlog_replica_test_add_docs_shard1_replica_t1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 411953 INFO  (zkCallback-835-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/tlog_replica_test_add_docs/state.json] for collection 
[tlog_replica_test_add_docs] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 411953 INFO  (zkCallback-821-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/tlog_replica_test_add_docs/state.json] for collection 
[tlog_replica_test_add_docs] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 412860 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={pullReplicas=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_add_docs&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=3&wt=javabin&version=2}
 status=0 QTime=3650
   [junit4]   2> 412867 INFO  (qtp1858180860-3039) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.ZkShardTerms Successful 
update of terms at /collections/tlog_replica_test_add_docs/terms/shard1 to 
Terms{values={core_node6=1, core_node3=1, core_node5=1}, version=3}
   [junit4]   2> 412879 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t2]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t4/&wt=javabin&version=2}{add=[1
 (1616013848452530176)]} 0 10
   [junit4]   2> 412880 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:42259/solr/tlog_replica_test_add_docs_shard1_replica_t4/&wt=javabin&version=2}{add=[1
 (1616013848452530176)]} 0 10
   [junit4]   2> 412880 INFO  (qtp1858180860-3039) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[1 (1616013848452530176)]} 0 15
   [junit4]   2> 412886 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node5 
x:tlog_replica_test_add_docs_shard1_replica_t2] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t2]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:43373/solr/tlog_replica_test_add_docs_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 0
   [junit4]   2> 412886 INFO  (qtp1744471353-3048) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:43373/solr/tlog_replica_test_add_docs_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 0
   [junit4]   2> 412886 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.DirectUpdateHandler2 
start 
commit{_version_=1616013848475598848,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 412886 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.SolrIndexWriter Calling 
setCommitData with IW:org.apache.solr.update.SolrIndexWriter@553fd84 
commitCommandVersion:1616013848475598848
   [junit4]   2> 412889 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@7fc25436[tlog_replica_test_add_docs_shard1_replica_t4] main]
   [junit4]   2> 412890 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.u.DirectUpdateHandler2 
end_commit_flush
   [junit4]   2> 412891 INFO  
(searcherExecutor-1598-thread-1-processing-n:127.0.0.1:42259_solr 
x:tlog_replica_test_add_docs_shard1_replica_t4 c:tlog_replica_test_add_docs 
s:shard1 r:core_node6) [n:127.0.0.1:42259_solr c:tlog_replica_test_add_docs 
s:shard1 r:core_node6 x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t4] Registered new 
searcher Searcher@7fc25436[tlog_replica_test_add_docs_shard1_replica_t4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.6.0):C1)))}
   [junit4]   2> 412891 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:43373/solr/tlog_replica_test_add_docs_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 5
   [junit4]   2> 412892 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] 
o.a.s.u.p.LogUpdateProcessorFactory 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/update 
params={_stateVer_=tlog_replica_test_add_docs:6&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 9
   [junit4]   2> 412895 INFO  (qtp1858180860-3111) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
   [junit4]   2> 412906 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413007 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413108 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413209 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413220 INFO  
(OverseerCollectionConfigSetProcessor-72092010284908548-127.0.0.1:43373_solr-n_0000000000)
 [n:127.0.0.1:43373_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 413310 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413411 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413512 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413612 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413713 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413814 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 413915 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414016 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414117 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414217 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414318 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414419 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414520 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414621 INFO  (qtp1744471353-3116) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414723 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414824 INFO  (qtp1744471353-3038) [n:127.0.0.1:43373_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node3 
x:tlog_replica_test_add_docs_shard1_replica_t1] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t1]  webapp=/solr path=/select 
params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 414848 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 414848 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 414849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's version: 1541150902248
   [junit4]   2> 414849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 414849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 414849 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 414849 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&tlogFiles=false&wt=javabin&version=2&command=filelist}
 status=0 QTime=0
   [junit4]   2> 414850 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Number of files in latest index in master: 19
   [junit4]   2> 414854 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Starting download (fullCopy=false) to 
MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@6d5c85d4 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b5a3fea; 
maxCacheMB=0.658203125 maxMergeSizeMB=0.3037109375))
   [junit4]   2> 414855 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_BlockTreeOrds_0.pos&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414857 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414858 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_LuceneVarGapFixedInterval_0.tiv&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414859 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414860 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_LuceneVarGapFixedInterval_0.pos&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414861 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414862 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_BlockTreeOrds_0.tio&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414863 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_LuceneVarGapFixedInterval_0.doc&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414863 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_BlockTreeOrds_0.doc&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414864 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414865 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_Lucene70_0.dvm&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414866 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_BlockTreeOrds_0.tipo&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414867 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_Asserting_0.dvd&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414868 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_LuceneVarGapFixedInterval_0.tib&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414869 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_Lucene70_0.dvd&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414871 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0_Asserting_0.dvm&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414872 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414873 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414873 INFO  (qtp1858180860-3118) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 414874 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Bytes downloaded: 3283, Bytes skipped downloading: 0
   [junit4]   2> 414874 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.h.IndexFetcher Total time taken for download 
(fullCopy=false,bytesDownloaded=3283) : 0 secs (null bytes/sec) to 
MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@6d5c85d4 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b5a3fea; 
maxCacheMB=0.658203125 maxMergeSizeMB=0.3037109375))
   [junit4]   2> 414876 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 414877 INFO  (indexFetcher-1613-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2ddd4f7f[tlog_replica_test_add_docs_shard1_replica_t2] main]
   [junit4]   2> 414879 INFO  (searcherExecutor-1599-thread-1) [    ] 
o.a.s.c.SolrCore [tlog_replica_test_add_docs_shard1_replica_t2] Registered new 
searcher Searcher@2ddd4f7f[tlog_replica_test_add_docs_shard1_replica_t2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.6.0):C1)))}
   [junit4]   2> 414921 INFO  (qtp1858180860-3045) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 414921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 414921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Master's version: 1541150902248
   [junit4]   2> 414921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 414921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 414921 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 414921 INFO  (qtp1858180860-3047) [n:127.0.0.1:42259_solr 
c:tlog_replica_test_add_docs s:shard1 r:core_node6 
x:tlog_replica_test_add_docs_shard1_replica_t4] o.a.s.c.S.Request 
[tlog_replica_test_add_docs_shard1_replica_t4]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&tlogFiles=false&wt=javabin&version=2&command=filelist}
 status=0 QTime=0
   [junit4]   2> 414922 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher Number of files in latest index in master: 19
   [junit4]   2> 414922 INFO  (indexFetcher-1615-thread-1) [    ] 
o.a.s.h.IndexFetcher St

[...truncated too long message...]

ead-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) 
-> (1)
   [junit4]   2> 207933 INFO  (zkCallback-261-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 207933 INFO  (zkCallback-244-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 207933 INFO  (zkCallback-254-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 207933 INFO  (jetty-closer-134-thread-2) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46387_solr
   [junit4]   2> 207933 INFO  (jetty-closer-134-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72092193296023577-127.0.0.1:43005_solr-n_0000000005) closing
   [junit4]   2> 207933 INFO  
(OverseerStateUpdate-72092193296023577-127.0.0.1:43005_solr-n_0000000005) 
[n:127.0.0.1:43005_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:43005_solr
   [junit4]   2> 207934 WARN  
(OverseerAutoScalingTriggerThread-72092193296023577-127.0.0.1:43005_solr-n_0000000005)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 207934 INFO  (jetty-closer-134-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 207935 INFO  (zkCallback-244-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 207935 INFO  (zkCallback-237-thread-3) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 207935 INFO  (zkCallback-254-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 207935 INFO  (zkCallback-261-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 207936 INFO  (zkCallback-254-thread-3) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46387_solr
   [junit4]   2> 207937 INFO  (jetty-closer-134-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7bb8f67c{/solr,null,UNAVAILABLE}
   [junit4]   2> 207937 INFO  (jetty-closer-134-thread-1) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 209438 INFO  (jetty-closer-134-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5a48a23b{/solr,null,UNAVAILABLE}
   [junit4]   2> 209438 INFO  (jetty-closer-134-thread-2) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 209438 ERROR 
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 209438 INFO  
(SUITE-TestTlogReplica-seed#[3D77588542DE8167]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:45981 45981
   [junit4]   2> 209568 INFO  (Thread-98) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:45981 45981
   [junit4]   2> 209568 WARN  (Thread-98) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        32      
/solr/collections/tlog_replica_test_create_delete/terms/shard1
   [junit4]   2>        31      /solr/configs/conf
   [junit4]   2>        30      
/solr/collections/tlog_replica_test_create_delete/terms/shard2
   [junit4]   2>        20      
/solr/collections/tlog_replica_test_remove_leader/terms/shard1
   [junit4]   2>        18      
/solr/collections/tlog_replica_test_recovery/terms/shard1
   [junit4]   2>        17      
/solr/collections/tlog_replica_test_basic_leader_election/terms/shard1
   [junit4]   2>        16      
/solr/collections/tlog_replica_test_kill_leader/terms/shard1
   [junit4]   2>        16      
/solr/collections/tlog_replica_test_kill_tlog_replica/terms/shard1
   [junit4]   2>        15      /solr/aliases.json
   [junit4]   2>        13      
/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/terms/shard1
   [junit4]   2>        13      
/solr/collections/tlog_replica_test_add_docs/terms/shard1
   [junit4]   2>        11      
/solr/collections/tlog_replica_test_delete_by_id/terms/shard1
   [junit4]   2>        11      
/solr/collections/tlog_replica_test_only_leader_indexes/terms/shard1
   [junit4]   2>        8       
/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard2
   [junit4]   2>        7       /solr/security.json
   [junit4]   2>        7       
/solr/collections/tlog_replica_test_add_remove_tlog_replica/terms/shard1
   [junit4]   2>        4       
/solr/collections/tlog_replica_test_real_time_get/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        25      
/solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
   [junit4]   2>        20      
/solr/collections/tlog_replica_test_create_delete/state.json
   [junit4]   2>        15      /solr/clusterprops.json
   [junit4]   2>        15      /solr/clusterstate.json
   [junit4]   2>        11      
/solr/collections/tlog_replica_test_kill_leader/state.json
   [junit4]   2>        9       
/solr/collections/tlog_replica_test_remove_leader/state.json
   [junit4]   2>        8       
/solr/collections/tlog_replica_test_recovery/state.json
   [junit4]   2>        8       
/solr/collections/tlog_replica_test_basic_leader_election/state.json
   [junit4]   2>        7       
/solr/collections/tlog_replica_test_kill_tlog_replica/state.json
   [junit4]   2>        5       /solr/autoscaling.json
   [junit4]   2>        4       
/solr/collections/tlog_replica_test_add_docs/state.json
   [junit4]   2>        3       
/solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
   [junit4]   2>        3       
/solr/collections/tlog_replica_test_only_leader_indexes/state.json
   [junit4]   2>        3       
/solr/collections/tlog_replica_test_delete_by_id/state.json
   [junit4]   2>        2       
/solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/72092193296023565-core_node3-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/72092193296023556-127.0.0.1:43005_solr-n_0000000000
   [junit4]   2>        2       
/solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72092193296023556-core_node5-n_0000000001
   [junit4]   2>        2       
/solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/72092193296023559-core_node9-n_0000000002
   [junit4]   2>        2       
/solr/collections/tlog_replica_test_real_time_get/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        15      /solr/live_nodes
   [junit4]   2>        15      /solr/collections
   [junit4]   2>        5       /solr/overseer/queue
   [junit4]   2>        5       /solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2>        5       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        5       /solr/overseer/collection-queue-work
   [junit4]   2>        5       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_3D77588542DE8167-002
   [junit4]   2> Nov 02, 2018 10:16:31 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{foo=PostingsFormat(name=LuceneVarGapFixedInterval), 
title_s=PostingsFormat(name=Direct), id=BlockTreeOrds(blocksize=128), 
foo_s=PostingsFormat(name=LuceneVarGapFixedInterval)}, 
docValues:{_version_=DocValuesFormat(name=Lucene70), 
id=DocValuesFormat(name=Asserting), 
inplace_updatable_int=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=674, 
maxMBSortInHeap=7.205656944988849, sim=RandomSimilarity(queryNorm=false): {}, 
locale=es-DO, timezone=US/East-Indiana
   [junit4]   2> NOTE: Linux 4.15.0-38-generic amd64/Oracle Corporation 10.0.1 
(64-bit)/cpus=8,threads=1,free=154048912,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestTlogReplica, 
TestTlogReplica]
   [junit4] Completed [5/5 (5!)] on J0 in 101.45s, 13 tests, 1 failure <<< 
FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1567: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1092: 
There were test failures: 5 suites, 65 tests, 5 failures [seed: 
3D77588542DE8167]

Total time: 3 minutes 32 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.TestTlogReplica
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=1d447b75c4e22694fac34b104706533bf56c6689, 
workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #3020
Recording test results
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to