Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/709/

1 tests failed.
FAILED:  org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_stored_idx

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 
seconds
        at 
__randomizedtesting.SeedInfo.seed([6D6AF28660FD5474:7D0B5F7F755F115A]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:187)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecoveriesToFinish(TestStressCloudBlindAtomicUpdates.java:459)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:304)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_stored_idx(TestStressCloudBlindAtomicUpdates.java:234)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12853 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/init-core-data-001
   [junit4]   2> 1944936 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=SSL overhead seems to cause 
OutOfMemory when stress testing)
   [junit4]   2> 1944936 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001
   [junit4]   2> 1944937 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1944937 INFO  (Thread-4946) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1944937 INFO  (Thread-4946) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1945037 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:34084
   [junit4]   2> 1945050 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1945053 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1945054 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2ca04c1b{/solr,null,AVAILABLE}
   [junit4]   2> 1945057 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1945060 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@596e6db5{HTTP/1.1,[http/1.1]}{127.0.0.1:57439}
   [junit4]   2> 1945060 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.e.j.s.Server Started @1949105ms
   [junit4]   2> 1945060 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=57439}
   [junit4]   2> 1945061 ERROR (jetty-launcher-3554-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1945061 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 1945061 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1945061 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1945061 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-08T09:46:31.451Z
   [junit4]   2> 1945066 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6392fa84{/solr,null,AVAILABLE}
   [junit4]   2> 1945066 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4564b63f{HTTP/1.1,[http/1.1]}{127.0.0.1:58388}
   [junit4]   2> 1945066 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.e.j.s.Server Started @1949111ms
   [junit4]   2> 1945066 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=58388}
   [junit4]   2> 1945067 ERROR (jetty-launcher-3554-thread-3) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1945067 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 1945067 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1945067 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1945067 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-08T09:46:31.457Z
   [junit4]   2> 1945068 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1945070 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@78b8b0a7{/solr,null,AVAILABLE}
   [junit4]   2> 1945070 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@2f7f9f55{HTTP/1.1,[http/1.1]}{127.0.0.1:44997}
   [junit4]   2> 1945070 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.e.j.s.Server Started @1949115ms
   [junit4]   2> 1945070 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44997}
   [junit4]   2> 1945071 ERROR (jetty-launcher-3554-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1945071 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 1945071 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1945071 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1945071 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-08T09:46:31.461Z
   [junit4]   2> 1945072 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1945109 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1a656d27{/solr,null,AVAILABLE}
   [junit4]   2> 1945109 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@271ca1b3{HTTP/1.1,[http/1.1]}{127.0.0.1:44692}
   [junit4]   2> 1945110 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.e.j.s.Server Started @1949154ms
   [junit4]   2> 1945110 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44692}
   [junit4]   2> 1945110 ERROR (jetty-launcher-3554-thread-4) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1945110 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.5.0
   [junit4]   2> 1945110 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1945110 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1945110 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-02-08T09:46:31.500Z
   [junit4]   2> 1945113 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1945114 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1945117 INFO  (jetty-launcher-3554-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34084/solr
   [junit4]   2> 1945120 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1945133 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1945141 INFO  (jetty-launcher-3554-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34084/solr
   [junit4]   2> 1945143 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1945146 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a1d1e06200005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1945148 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1945150 INFO  (jetty-launcher-3554-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34084/solr
   [junit4]   2> 1945152 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1945153 INFO  (jetty-launcher-3554-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34084/solr
   [junit4]   2> 1945155 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15a1d1e06200008, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1945179 INFO  (jetty-launcher-3554-thread-3) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:58388_solr
   [junit4]   2> 1945179 INFO  (jetty-launcher-3554-thread-1) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:57439_solr
   [junit4]   2> 1945187 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1945198 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1945200 INFO  (jetty-launcher-3554-thread-2) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44997_solr
   [junit4]   2> 1945213 INFO  (jetty-launcher-3554-thread-3) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.Overseer Overseer 
(id=97422356730871815-127.0.0.1:58388_solr-n_0000000000) starting
   [junit4]   2> 1945213 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1945213 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1945235 INFO  
(zkCallback-3566-thread-1-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1945238 INFO  
(zkCallback-3566-thread-2-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1945250 INFO  (jetty-launcher-3554-thread-4) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1945254 INFO  (jetty-launcher-3554-thread-4) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44692_solr
   [junit4]   2> 1945255 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1945255 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1945262 INFO  
(zkCallback-3566-thread-2-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1945318 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1945323 INFO  (jetty-launcher-3554-thread-4) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node4/.
   [junit4]   2> 1945323 INFO  (jetty-launcher-3554-thread-3) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:58388_solr
   [junit4]   2> 1945324 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1945324 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1945324 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1945327 INFO  
(zkCallback-3566-thread-2-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1945373 INFO  (jetty-launcher-3554-thread-1) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node1/.
   [junit4]   2> 1945403 INFO  (jetty-launcher-3554-thread-2) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node2/.
   [junit4]   2> 1945407 INFO  (jetty-launcher-3554-thread-3) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node3/.
   [junit4]   2> 1948647 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1948648 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34084/solr ready
   [junit4]   2> 1949036 INFO  (qtp1762501581-19328) [n:127.0.0.1:44692_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&name=test_col&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1949039 INFO  
(OverseerThreadFactory-5651-thread-1-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
test_col
   [junit4]   2> 1949156 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1949163 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1949163 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1949177 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1949281 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1949281 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1949281 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1949282 INFO  
(zkCallback-3566-thread-3-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1950198 WARN  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1950199 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.0
   [junit4]   2> 1950209 WARN  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1950235 WARN  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1950235 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.0
   [junit4]   2> 1950235 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.0
   [junit4]   2> 1950241 WARN  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1950242 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.5.0
   [junit4]   2> 1950247 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema 
[test_col_shard1_replica2] Schema name=minimal-atomic-stress
   [junit4]   2> 1950252 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema 
[test_col_shard2_replica1] Schema name=minimal-atomic-stress
   [junit4]   2> 1950263 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1950266 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema 
[test_col_shard1_replica1] Schema name=minimal-atomic-stress
   [junit4]   2> 1950266 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1950268 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard2_replica1' using configuration from collection test_col
   [junit4]   2> 1950269 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard1_replica2' using configuration from collection test_col
   [junit4]   2> 1950270 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore 
[[test_col_shard1_replica2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node3/test_col_shard1_replica2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node3/./test_col_shard1_replica2/data/]
   [junit4]   2> 1950270 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7b693396
   [junit4]   2> 1950270 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema 
[test_col_shard2_replica2] Schema name=minimal-atomic-stress
   [junit4]   2> 1950271 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore 
[[test_col_shard2_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node4/test_col_shard2_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node4/./test_col_shard2_replica1/data/]
   [junit4]   2> 1950271 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7b693396
   [junit4]   2> 1950274 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1950275 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard1_replica1' using configuration from collection test_col
   [junit4]   2> 1950276 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore 
[[test_col_shard1_replica1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node2/test_col_shard1_replica1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node2/./test_col_shard1_replica1/data/]
   [junit4]   2> 1950276 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7b693396
   [junit4]   2> 1950278 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.4162093232663192]
   [junit4]   2> 1950278 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.4162093232663192]
   [junit4]   2> 1950278 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1950279 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard2_replica2' using configuration from collection test_col
   [junit4]   2> 1950279 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore 
[[test_col_shard2_replica2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node1/test_col_shard2_replica2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001/tempDir-001/node1/./test_col_shard2_replica2/data/]
   [junit4]   2> 1950280 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7b693396
   [junit4]   2> 1950281 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.4162093232663192]
   [junit4]   2> 1950282 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.4162093232663192]
   [junit4]   2> 1950292 WARN  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1950293 WARN  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1950305 WARN  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1950331 WARN  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1950345 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1950346 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1950386 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1950386 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1950386 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=44, 
maxMergedSegmentMB=86.0283203125, floorSegmentMB=0.232421875, 
forceMergeDeletesPctAllowed=11.327784592014096, segmentsPerTier=11.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1950387 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@59226d1f[test_col_shard1_replica1] main]
   [junit4]   2> 1950398 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1950398 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1950400 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1950400 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1950400 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=44, 
maxMergedSegmentMB=86.0283203125, floorSegmentMB=0.232421875, 
forceMergeDeletesPctAllowed=11.327784592014096, segmentsPerTier=11.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1950401 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@46921217[test_col_shard1_replica2] main]
   [junit4]   2> 1950402 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950402 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950403 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1950404 INFO  
(searcherExecutor-5660-thread-1-processing-n:127.0.0.1:58388_solr 
x:test_col_shard1_replica2 s:shard1 c:test_col) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore 
[test_col_shard1_replica2] Registered new searcher 
Searcher@46921217[test_col_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1950409 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1558757713430708224
   [junit4]   2> 1950410 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950410 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950410 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1950443 INFO  
(searcherExecutor-5661-thread-1-processing-n:127.0.0.1:44997_solr 
x:test_col_shard1_replica1 s:shard1 c:test_col) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore 
[test_col_shard1_replica1] Registered new searcher 
Searcher@59226d1f[test_col_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1950451 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1950454 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1558757713477894144
   [junit4]   2> 1950465 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1950465 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1950466 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1950466 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1950467 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=44, 
maxMergedSegmentMB=86.0283203125, floorSegmentMB=0.232421875, 
forceMergeDeletesPctAllowed=11.327784592014096, segmentsPerTier=11.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1950468 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@78120d08[test_col_shard2_replica1] main]
   [junit4]   2> 1950469 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950469 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950469 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1950471 INFO  
(searcherExecutor-5659-thread-1-processing-n:127.0.0.1:44692_solr 
x:test_col_shard2_replica1 s:shard2 c:test_col) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore 
[test_col_shard2_replica1] Registered new searcher 
Searcher@78120d08[test_col_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1950471 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1558757713495719936
   [junit4]   2> 1950478 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1950481 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1950481 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1950482 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1950482 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1950482 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=44, 
maxMergedSegmentMB=86.0283203125, floorSegmentMB=0.232421875, 
forceMergeDeletesPctAllowed=11.327784592014096, segmentsPerTier=11.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1950483 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@35b3d3e0[test_col_shard2_replica2] main]
   [junit4]   2> 1950484 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950484 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1950485 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1950486 INFO  
(searcherExecutor-5662-thread-1-processing-n:127.0.0.1:57439_solr 
x:test_col_shard2_replica2 s:shard2 c:test_col) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore 
[test_col_shard2_replica2] Registered new searcher 
Searcher@35b3d3e0[test_col_shard2_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1950486 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1558757713511448576
   [junit4]   2> 1950580 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1950580 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1950580 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1950580 INFO  
(zkCallback-3566-thread-2-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1950952 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1950952 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1950952 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:58388/solr/test_col_shard1_replica2/
   [junit4]   2> 1950952 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard1_replica2 url=http://127.0.0.1:58388/solr START 
replicas=[http://127.0.0.1:44997/solr/test_col_shard1_replica1/] nUpdates=100
   [junit4]   2> 1950953 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard1_replica2 url=http://127.0.0.1:58388/solr DONE.  We have no 
versions.  sync failed.
   [junit4]   2> 1950955 INFO  (qtp2132694965-19312) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] o.a.s.c.S.Request 
[test_col_shard1_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1950956 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SyncStrategy Leader's 
attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1950956 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1950960 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:58388/solr/test_col_shard1_replica2/ shard1
   [junit4]   2> 1950978 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1950978 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1950978 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:44692/solr/test_col_shard2_replica1/
   [junit4]   2> 1950978 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard2_replica1 url=http://127.0.0.1:44692/solr START 
replicas=[http://127.0.0.1:57439/solr/test_col_shard2_replica2/] nUpdates=100
   [junit4]   2> 1950979 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard2_replica1 url=http://127.0.0.1:44692/solr DONE.  We have no 
versions.  sync failed.
   [junit4]   2> 1950981 INFO  (qtp308290062-19288) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] o.a.s.c.S.Request 
[test_col_shard2_replica2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1950981 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SyncStrategy Leader's 
attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1950981 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1950984 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:44692/solr/test_col_shard2_replica1/ shard2
   [junit4]   2> 1951087 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951087 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951087 INFO  
(zkCallback-3566-thread-2-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951087 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951111 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 1951113 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2}
 status=0 QTime=1936
   [junit4]   2> 1951135 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 1951137 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2}
 status=0 QTime=1981
   [junit4]   2> 1951240 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951240 INFO  
(zkCallback-3566-thread-2-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951240 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951240 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951461 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2297
   [junit4]   2> 1951493 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2}
 status=0 QTime=2329
   [junit4]   2> 1951496 INFO  (qtp1762501581-19328) [n:127.0.0.1:44692_solr    
] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 1951601 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951601 INFO  
(zkCallback-3566-thread-3-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951601 INFO  
(zkCallback-3576-thread-1-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1951601 INFO  
(zkCallback-3570-thread-1-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1952496 INFO  (qtp1762501581-19328) [n:127.0.0.1:44692_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=2&property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&name=test_col&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=3460
   [junit4]   2> 1952497 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: 
test_col failOnTimeout:true timeout (sec):330
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> replica:core_node1 rstate:active live:true
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 1952498 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: test_col
   [junit4]   2> 1952506 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] o.a.s.c.S.Request 
[test_col_shard1_replica1]  webapp=/solr path=/schema/fieldtypes/long 
params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1952575 INFO  
(TEST-TestStressCloudBlindAtomicUpdates.test_stored_idx-seed#[6D6AF28660FD5474])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting test_stored_idx
   [junit4]   2> 1952602 INFO  (qtp308290062-19293) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&_version_=-1558757715705069568&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1558757715705069568)} 0 3
   [junit4]   2> 1952633 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&_version_=-1558757715721846784&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1558757715721846784)} 0 13
   [junit4]   2> 1952634 INFO  (qtp248576870-19298) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update 
params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1558757715721846784)} 0 39
   [junit4]   2> 1952634 INFO  (qtp1762501581-19325) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{deleteByQuery=*:* 
(-1558757715705069568)} 0 56
   [junit4]   2> 1952637 INFO  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1952637 WARN  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1952637 INFO  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1952637 INFO  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1952638 WARN  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1952638 INFO  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1952638 INFO  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1952638 WARN  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1952638 INFO  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1952639 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1952639 WARN  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1952639 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1952640 INFO  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1952641 INFO  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1952641 INFO  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 3
   [junit4]   2> 1952641 INFO  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1952642 INFO  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 4
   [junit4]   2> 1952642 INFO  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 5
   [junit4]   2> 1952642 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1952642 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 3
   [junit4]   2> 1952643 INFO  (qtp248576870-19303) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update 
params={_stateVer_=test_col:5&optimize=true&maxSegments=1&waitSearcher=true&wt=javabin&version=2}{optimize=}
 0 7
   [junit4]   2> 1952645 INFO  (qtp1762501581-19330) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] o.a.s.c.S.Request 
[test_col_shard2_replica1]  webapp=/solr path=/schema/fields/long_stored_idx 
params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1952645 INFO  
(TEST-TestStressCloudBlindAtomicUpdates.test_stored_idx-seed#[6D6AF28660FD5474])
 [    ] o.a.s.c.TestStressCloudBlindAtomicUpdates Testing long_stored_idx: 
numDocsToCheck=75, numDocsInIndex=225, incr=3
   [junit4]   2> 1952660 INFO  (qtp2132694965-19312) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[0
 (1558757715785809920)]} 0 1
   [junit4]   2> 1952660 INFO  (qtp248576870-19305) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[0 (1558757715785809920)]} 0 5
   [junit4]   2> 1952665 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[1
 (1558757715793149952)]} 0 0
   [junit4]   2> 1952666 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[1 (1558757715793149952)]} 0 3
   [junit4]   2> 1952672 INFO  (qtp308290062-19295) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[2
 (1558757715798392832)]} 0 1
   [junit4]   2> 1952672 INFO  (qtp1762501581-19329) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[2 (1558757715798392832)]} 0 4
   [junit4]   2> 1952675 INFO  (qtp308290062-19289) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[3
 (1558757715805732864)]} 0 0
   [junit4]   2> 1952676 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[3 (1558757715805732864)]} 0 2
   [junit4]   2> 1952679 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[4
 (1558757715808878592)]} 0 0
   [junit4]   2> 1952680 INFO  (qtp248576870-19299) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[4 (1558757715808878592)]} 0 2
   [junit4]   2> 1952683 INFO  (qtp308290062-19288) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[5
 (1558757715813072896)]} 0 0
   [junit4]   2> 1952683 INFO  (qtp1762501581-19328) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[5 (1558757715813072896)]} 0 2
   [junit4]   2> 1952687 INFO  (qtp308290062-19288) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[6
 (1558757715817267200)]} 0 0
   [junit4]   2> 1952688 INFO  (qtp1762501581-19325) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[6 (1558757715817267200)]} 0 2
   [junit4]   2> 1952692 INFO  (qtp308290062-19293) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[7
 (1558757715822510080)]} 0 0
   [junit4]   2> 1952693 INFO  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[7 (1558757715822510080)]} 0 2
   [junit4]   2> 1952696 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[8
 (1558757715827752960)]} 0 0
   [junit4]   2> 1952697 INFO  (qtp248576870-19298) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[8 (1558757715827752960)]} 0 2
   [junit4]   2> 1952700 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[9
 (1558757715830898688)]} 0 0
   [junit4]   2> 1952700 INFO  (qtp1762501581-19330) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[9 (1558757715830898688)]} 0 2
   [junit4]   2> 1952704 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[10
 (1558757715835092992)]} 0 0
   [junit4]   2> 1952705 INFO  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[10 (1558757715835092992)]} 0 2
   [junit4]   2> 1952709 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[11
 (1558757715840335872)]} 0 0
   [junit4]   2> 1952709 INFO  (qtp248576870-19303) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[11 (1558757715840335872)]} 0 2
   [junit4]   2> 1952713 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[12
 (1558757715844530176)]} 0 0
   [junit4]   2> 1952713 INFO  (qtp248576870-19305) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[12 (1558757715844530176)]} 0 2
   [junit4]   2> 1952716 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[13
 (1558757715848724480)]} 0 0
   [junit4]   2> 1952717 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[13 (1558757715848724480)]} 0 2
   [junit4]   2> 1952720 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[14
 (1558757715851870208)]} 0 0
   [junit4]   2> 1952721 INFO  (qtp248576870-19299) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[14 (1558757715851870208)]} 0 2
   [junit4]   2> 1952724 INFO  (qtp2132694965-19318) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[15
 (1558757715856064512)]} 0 0
   [junit4]   2> 1952724 INFO  (qtp248576870-19298) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[15 (1558757715856064512)]} 0 2
   [junit4]   2> 1952734 INFO  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[16
 (1558757715860258816)]} 0 0
   [junit4]   2> 1952734 INFO  (qtp248576870-19304) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[16 (1558757715860258816)]} 0 7
   [junit4]   2> 1952738 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[17
 (1558757715870744576)]} 0 0
   [junit4]   2> 1952738 INFO  (qtp1762501581-19329) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[17 (1558757715870744576)]} 0 2
   [junit4]   2> 1952742 INFO  (qtp308290062-19294) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[18
 (1558757715874938880)]} 0 0
   [junit4]   2> 1952744 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[18 (1558757715874938880)]} 0 4
   [junit4]   2> 1952748 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[19
 (1558757715882278912)]} 0 0
   [junit4]   2> 1952749 INFO  (qtp1762501581-19328) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[19 (1558757715882278912)]} 0 2
   [junit4]   2> 1952752 INFO  (qtp2132694965-19314) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[20
 (1558757715885424640)]} 0 0
   [junit4]   2> 1952752 INFO  (qtp248576870-19303) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[20 (1558757715885424640)]} 0 2
   [junit4]   2> 1952756 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[21
 (1558757715889618944)]} 0 0
   [junit4]   2> 1952758 INFO  (qtp1762501581-19325) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[21 (1558757715889618944)]} 0 3
   [junit4]   2> 1952761 INFO  (qtp2132694965-19317) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[22
 (1558757715894861824)]} 0 0
   [junit4]   2> 1952762 INFO  (qtp248576870-19305) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[22 (1558757715894861824)]} 0 2
   [junit4]   2> 1952766 INFO  (qtp308290062-19291) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[23
 (1558757715900104704)]} 0 0
   [junit4]   2> 1952767 INFO  (qtp1762501581-19323) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[23 (1558757715900104704)]} 0 2
   [junit4]   2> 1952771 INFO  (qtp2132694965-19319) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[24
 (1558757715905347584)]} 0 0
   [junit4]   2> 1952771 INFO  (qtp248576870-19301) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[24 (1558757715905347584)]} 0 2
   [junit4]   2> 1952775 INFO  (qtp308290062-19295) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[25
 (1558757715909541888)]} 0 0
   [junit4]   2> 1952775 INFO  (qtp1762501581-19330) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[25 (1558757715909541888)]} 0 2
   [junit4]   2> 1952788 INFO  (qtp308290062-19295) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[26
 (1558757715913736192)]} 0 0
   [junit4]   2> 1952788 INFO  (qtp1762501581-19329) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[26 (1558757715913736192)]} 0 11
   [junit4]   2> 1952792 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[27
 (1558757715927367680)]} 0 0
   [junit4]   2> 1952792 INFO  (qtp248576870-19299) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[27 (1558757715927367680)]} 0 2
   [junit4]   2> 1952796 INFO  (qtp2132694965-19316) [n:127.0.0.1:44997_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:58388/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[28
 (1558757715931561984)]} 0 0
   [junit4]   2> 1952796 INFO  (qtp248576870-19298) [n:127.0.0.1:58388_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[28 (1558757715931561984)]} 0 2
   [junit4]   2> 1952800 INFO  (qtp308290062-19295) [n:127.0.0.1:57439_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:44692/solr/test_col_shard2_replica1/&wt=javabin&version=2}{add=[29
 (1558757715935756288)]} 0 0
   [junit4]   2> 1952801 INFO  (qtp1762501581-19324) [n:127.0.0.1:44692_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=

[...truncated too long message...]

der Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2317275 INFO  (coreCloseExecutor-5687-thread-1) 
[n:127.0.0.1:44997_solr c:test_col s:shard1 r:core_node3 
x:test_col_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric reporters 
for: solr.core.test_col.shard1.replica1
   [junit4]   2> 2317296 INFO  
(zkCallback-3566-thread-7-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (2)
   [junit4]   2> 2317297 INFO  
(zkCallback-3570-thread-3-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (2)
   [junit4]   2> 2317320 INFO  (coreCloseExecutor-5685-thread-1) 
[n:127.0.0.1:57439_solr c:test_col s:shard2 r:core_node2 
x:test_col_shard2_replica2] o.a.s.m.SolrMetricManager Closing metric reporters 
for: solr.core.test_col.shard2.replica2
   [junit4]   2> 2317327 INFO  
(zkCallback-3566-thread-7-processing-n:127.0.0.1:58388_solr) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 2317336 INFO  (coreCloseExecutor-5688-thread-1) 
[n:127.0.0.1:58388_solr c:test_col s:shard1 r:core_node4 
x:test_col_shard1_replica2] o.a.s.m.SolrMetricManager Closing metric reporters 
for: solr.core.test_col.shard1.replica2
   [junit4]   2> 2317338 INFO  (jetty-launcher-3554-thread-5) [    ] 
o.a.s.c.Overseer Overseer 
(id=97422356730871815-127.0.0.1:58388_solr-n_0000000000) closing
   [junit4]   2> 2317339 INFO  
(OverseerStateUpdate-97422356730871815-127.0.0.1:58388_solr-n_0000000000) 
[n:127.0.0.1:58388_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:58388_solr
   [junit4]   2> 2317340 INFO  (jetty-launcher-3554-thread-5) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2317341 INFO  (jetty-launcher-3554-thread-5) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6392fa84{/solr,null,UNAVAILABLE}
   [junit4]   2> 2318753 WARN  
(zkCallback-3576-thread-2-processing-n:127.0.0.1:44692_solr) 
[n:127.0.0.1:44692_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2318754 INFO  (jetty-launcher-3554-thread-7) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2318755 INFO  (jetty-launcher-3554-thread-7) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1a656d27{/solr,null,UNAVAILABLE}
   [junit4]   2> 2318796 WARN  
(zkCallback-3574-thread-2-processing-n:127.0.0.1:44997_solr) 
[n:127.0.0.1:44997_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2318796 INFO  (jetty-launcher-3554-thread-6) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2318797 INFO  (jetty-launcher-3554-thread-6) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@78b8b0a7{/solr,null,UNAVAILABLE}
   [junit4]   2> 2318828 WARN  
(zkCallback-3570-thread-3-processing-n:127.0.0.1:57439_solr) 
[n:127.0.0.1:57439_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2318828 INFO  (jetty-launcher-3554-thread-8) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2318829 INFO  (jetty-launcher-3554-thread-8) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2ca04c1b{/solr,null,UNAVAILABLE}
   [junit4]   2> 2318837 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:34084 34084
   [junit4]   2> 2318944 INFO  (Thread-4946) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:34084 34084
   [junit4]   2> 2318945 WARN  (Thread-4946) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/aliases.json
   [junit4]   2>        5       /solr/clusterprops.json
   [junit4]   2>        4       
/solr/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2>        4       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/clusterstate.json
   [junit4]   2>        4       /solr/collections/test_col/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        367     /solr/overseer/collection-queue-work
   [junit4]   2>        29      /solr/overseer/queue
   [junit4]   2>        5       /solr/live_nodes
   [junit4]   2>        5       /solr/collections
   [junit4]   2>        5       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 2318945 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[6D6AF28660FD5474]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_6D6AF28660FD5474-001
   [junit4]   2> Feb 08, 2017 9:52:45 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene62, 
sim=RandomSimilarity(queryNorm=false,coord=no): {}, 
locale=ja-JP-u-ca-japanese-x-lvariant-JP, timezone=SystemV/MST7
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_102 (64-bit)/cpus=4,threads=1,free=217588800,total=530055168
   [junit4]   2> NOTE: All tests run in this JVM: [TermVectorComponentTest, 
TestOnReconnectListenerSupport, TestQueryTypes, TestCloudPseudoReturnFields, 
TestMacroExpander, TestWordDelimiterFilterFactory, TestAnalyzeInfixSuggestions, 
SmileWriterTest, BooleanFieldTest, SimplePostToolTest, ZkCLITest, 
TestDelegationWithHadoopAuth, SampleTest, V2ApiIntegrationTest, 
SolrIndexConfigTest, TlogReplayBufferedWhileIndexingTest, TestInitQParser, 
WordBreakSolrSpellCheckerTest, TestSolrCLIRunExample, TestSolrCoreParser, 
TestPKIAuthenticationPlugin, SolrGraphiteReporterTest, 
TestBM25SimilarityFactory, ChaosMonkeySafeLeaderTest, 
TestSweetSpotSimilarityFactory, TestShortCircuitedRequests, TestLRUCache, 
TestCoreAdminApis, IndexSchemaTest, HttpPartitionTest, BasicFunctionalityTest, 
SearchHandlerTest, TestSolrIndexConfig, CSVRequestHandlerTest, 
OutOfBoxZkACLAndCredentialsProvidersTest, TestRequestStatusCollectionAPI, 
TestFieldCollectionResource, TestBulkSchemaAPI, DateMathParserTest, 
TestCSVResponseWriter, OpenCloseCoreStressTest, 
DistributedIntervalFacetingTest, TestFuzzyAnalyzedSuggestions, 
TestNonDefinedSimilarityFactory, AtomicUpdatesTest, EchoParamsTest, 
TestLeaderInitiatedRecoveryThread, TestRTGBase, TestSimpleTrackingShardHandler, 
TestExactSharedStatsCache, HdfsLockFactoryTest, TestSolrXml, 
DistribDocExpirationUpdateProcessorTest, HdfsChaosMonkeySafeLeaderTest, 
DeleteShardTest, CollectionsAPIDistributedZkTest, TestFastOutputStream, 
TestApiFramework, TestCloudManagedSchema, DeleteLastCustomShardedReplicaTest, 
TestLMDirichletSimilarityFactory, TestFreeTextSuggestions, TestStressVersions, 
TestNoOpRegenerator, SolrIndexMetricsTest, TestCloudDeleteByQuery, 
SpatialFilterTest, SpellCheckCollatorTest, HdfsSyncSliceTest, 
TestManagedResource, TestUpdate, SaslZkACLProviderTest, OverseerTaskQueueTest, 
TestMiniSolrCloudCluster, TestLegacyFieldCache, TestUninvertingReader, 
TestSystemIdResolver, TestHdfsBackupRestoreCore, TestXmlQParserPlugin, 
TestRandomCollapseQParserPlugin, HdfsDirectoryFactoryTest, 
LeaderFailureAfterFreshStartTest, TestRecoveryHdfs, RankQueryTest, 
CoreMergeIndexesAdminHandlerTest, MoreLikeThisHandlerTest, 
RAMDirectoryFactoryTest, TestExportWriter, TestStressLiveNodes, 
DistributedMLTComponentTest, SpellingQueryConverterTest, DocValuesTest, 
SharedFSAutoReplicaFailoverUtilsTest, SuggesterFSTTest, ActionThrottleTest, 
TestConfigOverlay, HdfsBasicDistributedZk2Test, ShardRoutingTest, 
DistributedVersionInfoTest, JsonLoaderTest, HdfsRecoverLeaseTest, 
TestSimpleQParserPlugin, DistributedQueryComponentCustomSortTest, 
BlockDirectoryTest, BlockJoinFacetSimpleTest, ConvertedLegacyTest, 
AsyncCallRequestStatusResponseTest, FacetPivotSmallTest, SystemInfoHandlerTest, 
DocValuesMissingTest, LoggingHandlerTest, URLClassifyProcessorTest, 
TestCoreContainer, TestSolr4Spatial, SolrCmdDistributorTest, 
BadIndexSchemaTest, TestSort, TestLazyCores, TestIndexSearcher, 
SoftAutoCommitTest, TestFoldingMultitermQuery, TestStressLucene, TestTrie, 
TestCSVLoader, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, 
TestPseudoReturnFields, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, 
DocValuesMultiTest, DistanceFunctionTest, SolrInfoMBeanTest, 
IndexBasedSpellCheckerTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, 
PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, 
TestIndexingPerformance, FastVectorHighlighterTest, RegexBoostProcessorTest, 
UpdateRequestProcessorFactoryTest, BinaryUpdateRequestHandlerTest, 
TestPartialUpdateDeduplication, TestComponentsName, TestLFUCache, 
CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, 
ConcurrentDeleteAndCreateCollectionTest, ConnectionManagerTest, 
DeleteStatusTest, DistributedQueueTest, DocValuesNotIndexedTest, 
MigrateRouteKeyTest, OverseerModifyCollectionTest, OverseerRolesTest, 
RecoveryAfterSoftCommitTest, RemoteQueryErrorTest, ReplaceNodeTest, 
SolrCloudExampleTest, TestAuthenticationFramework, TestClusterProperties, 
TestCollectionAPI, TestDeleteCollectionOnDownNodes, TestDistribDocBasedVersion, 
TestRandomFlRTGCloud, TestRequestForwarding, TestSegmentSorting, 
TestStressCloudBlindAtomicUpdates]
   [junit4] Completed [621/690 (1!)] on J1 in 374.78s, 5 tests, 1 failure <<< 
FAILURES!

[...truncated 62714 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to