Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/3832/
Java: 64bit/jdk1.8.0_131 -XX:-UseCompressedOops -XX:+UseG1GC

9 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreContainer

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  
junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdatesDistrib

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([8B46450CA45A642]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdatesDistrib

Error Message:
Captured an uncaught exception in thread: Thread[id=1876, 
name=solr-idle-connections-evictor, state=RUNNABLE, 
group=TGRP-TestInPlaceUpdatesDistrib]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1876, name=solr-idle-connections-evictor, 
state=RUNNABLE, group=TGRP-TestInPlaceUpdatesDistrib]
Caused by: java.lang.OutOfMemoryError: Java heap space
        at __randomizedtesting.SeedInfo.seed([8B46450CA45A642]:0)
        at 
org.apache.http.pool.AbstractConnPool.closeExpired(AbstractConnPool.java:558)
        at 
org.apache.http.impl.conn.PoolingClientConnectionManager.closeExpiredConnections(PoolingClientConnectionManager.java:293)
        at 
org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:267)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdatesDistrib

Error Message:
Captured an uncaught exception in thread: Thread[id=1877, 
name=solr-idle-connections-evictor, state=RUNNABLE, 
group=TGRP-TestInPlaceUpdatesDistrib]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1877, name=solr-idle-connections-evictor, 
state=RUNNABLE, group=TGRP-TestInPlaceUpdatesDistrib]
Caused by: java.lang.OutOfMemoryError: Java heap space


FAILED:  
junit.framework.TestSuite.org.apache.solr.update.TestInPlaceUpdatesDistrib

Error Message:
Captured an uncaught exception in thread: Thread[id=1809, 
name=solr-idle-connections-evictor, state=RUNNABLE, 
group=TGRP-TestInPlaceUpdatesDistrib]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1809, name=solr-idle-connections-evictor, 
state=RUNNABLE, group=TGRP-TestInPlaceUpdatesDistrib]
Caused by: java.lang.OutOfMemoryError: Java heap space


FAILED:  org.apache.solr.cloud.CleanupOldIndexTest.initializationError

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space


FAILED:  org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv

Error Message:
java.lang.RuntimeException: Error from server at 
http://127.0.0.1:34057/solr/test_col: Async exception during distributed 
update: Error from server at 
http://127.0.0.1:39893/solr/test_col_shard2_replica2: Server Error    request: 
http://127.0.0.1:39893/solr/test_col_shard2_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A34057%2Fsolr%2Ftest_col_shard1_replica2%2F&wt=javabin&version=2
 Remote error message: Failed synchronous update on shard StdNode: 
http://127.0.0.1:44837/solr/test_col_shard2_replica1/ update: 
org.apache.solr.client.solrj.request.UpdateRequest@36ea24aa

Stack Trace:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error from 
server at http://127.0.0.1:34057/solr/test_col: Async exception during 
distributed update: Error from server at 
http://127.0.0.1:39893/solr/test_col_shard2_replica2: Server Error



request: 
http://127.0.0.1:39893/solr/test_col_shard2_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A34057%2Fsolr%2Ftest_col_shard1_replica2%2F&wt=javabin&version=2
Remote error message: Failed synchronous update on shard StdNode: 
http://127.0.0.1:44837/solr/test_col_shard2_replica1/ update: 
org.apache.solr.client.solrj.request.UpdateRequest@36ea24aa
        at 
__randomizedtesting.SeedInfo.seed([8B46450CA45A642:3EA0061640189C53]:0)
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.checkField(TestStressCloudBlindAtomicUpdates.java:281)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.test_dv(TestStressCloudBlindAtomicUpdates.java:193)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Error from server at 
http://127.0.0.1:34057/solr/test_col: Async exception during distributed 
update: Error from server at 
http://127.0.0.1:39893/solr/test_col_shard2_replica2: Server Error



request: 
http://127.0.0.1:39893/solr/test_col_shard2_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A34057%2Fsolr%2Ftest_col_shard1_replica2%2F&wt=javabin&version=2
Remote error message: Failed synchronous update on shard StdNode: 
http://127.0.0.1:44837/solr/test_col_shard2_replica1/ update: 
org.apache.solr.client.solrj.request.UpdateRequest@36ea24aa
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates$Worker.run(TestStressCloudBlindAtomicUpdates.java:409)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        ... 1 more
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:34057/solr/test_col: Async exception during 
distributed update: Error from server at 
http://127.0.0.1:39893/solr/test_col_shard2_replica2: Server Error



request: 
http://127.0.0.1:39893/solr/test_col_shard2_replica2/update?update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A34057%2Fsolr%2Ftest_col_shard1_replica2%2F&wt=javabin&version=2
Remote error message: Failed synchronous update on shard StdNode: 
http://127.0.0.1:44837/solr/test_col_shard2_replica1/ update: 
org.apache.solr.client.solrj.request.UpdateRequest@36ea24aa
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:594)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:261)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:250)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:177)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates$Worker.doRandomAtomicUpdate(TestStressCloudBlindAtomicUpdates.java:368)
        at 
org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates$Worker.run(TestStressCloudBlindAtomicUpdates.java:397)
        ... 6 more


FAILED:  org.apache.solr.update.TestInPlaceUpdatesDistrib.test

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([8B46450CA45A642]:0)


FAILED:  
org.apache.solr.update.processor.TolerantUpdateProcessorTest.initializationError

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space




Build Log:
[...truncated 12466 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/init-core-data-001
   [junit4]   2> 1920161 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 1920162 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=SSL overhead seems to cause 
OutOfMemory when stress testing)
   [junit4]   2> 1920162 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001
   [junit4]   2> 1920163 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1920173 INFO  (Thread-4154) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1920173 INFO  (Thread-4154) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1920174 ERROR (Thread-4154) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1920273 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:42841
   [junit4]   2> 1920277 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1920277 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1920277 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1920278 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1920278 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@508e8d10{/solr,null,AVAILABLE}
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6d03b2ac{/solr,null,AVAILABLE}
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@25364552{HTTP/1.1,[http/1.1]}{127.0.0.1:34057}
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.e.j.s.Server Started @1921931ms
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=34057}
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4aa4b5b6{HTTP/1.1,[http/1.1]}{127.0.0.1:39893}
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.e.j.s.Server Started @1921932ms
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39893}
   [junit4]   2> 1920279 ERROR (jetty-launcher-3068-thread-4) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1920279 ERROR (jetty-launcher-3068-thread-3) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-24T05:13:34.503Z
   [junit4]   2> 1920279 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-24T05:13:34.503Z
   [junit4]   2> 1920287 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@28d2bbcb{/solr,null,AVAILABLE}
   [junit4]   2> 1920287 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@18045b13{HTTP/1.1,[http/1.1]}{127.0.0.1:42803}
   [junit4]   2> 1920288 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.e.j.s.Server Started @1921941ms
   [junit4]   2> 1920288 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=42803}
   [junit4]   2> 1920289 ERROR (jetty-launcher-3068-thread-2) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1920289 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1920289 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1920289 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1920289 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-24T05:13:34.513Z
   [junit4]   2> 1920332 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1920338 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@60186d9{/solr,null,AVAILABLE}
   [junit4]   2> 1920338 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1920338 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@6dd7f64d{HTTP/1.1,[http/1.1]}{127.0.0.1:44837}
   [junit4]   2> 1920338 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.e.j.s.Server Started @1921991ms
   [junit4]   2> 1920339 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44837}
   [junit4]   2> 1920339 ERROR (jetty-launcher-3068-thread-1) [    ] 
o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1920339 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
6.7.0
   [junit4]   2> 1920339 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1920339 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1920339 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-06-24T05:13:34.563Z
   [junit4]   2> 1920340 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1920342 INFO  (jetty-launcher-3068-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42841/solr
   [junit4]   2> 1920343 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1920344 INFO  (jetty-launcher-3068-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42841/solr
   [junit4]   2> 1920344 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1920345 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1920349 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1920350 INFO  (jetty-launcher-3068-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42841/solr
   [junit4]   2> 1920359 INFO  (jetty-launcher-3068-thread-1) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1920359 INFO  (jetty-launcher-3068-thread-2) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1920359 INFO  (jetty-launcher-3068-thread-1) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:44837_solr
   [junit4]   2> 1920359 INFO  (jetty-launcher-3068-thread-3) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1920359 INFO  (jetty-launcher-3068-thread-2) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:42803_solr
   [junit4]   2> 1920360 INFO  (jetty-launcher-3068-thread-1) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.Overseer Overseer 
(id=98191357666787338-127.0.0.1:44837_solr-n_0000000000) starting
   [junit4]   2> 1920391 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1920391 INFO  
(zkCallback-3086-thread-1-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1920392 INFO  (jetty-launcher-3068-thread-3) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39893_solr
   [junit4]   2> 1920392 INFO  (jetty-launcher-3068-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42841/solr
   [junit4]   2> 1920396 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1920397 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1920397 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1920397 INFO  
(OverseerStateUpdate-98191357666787338-127.0.0.1:44837_solr-n_0000000000) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1920397 INFO  (jetty-launcher-3068-thread-1) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44837_solr
   [junit4]   2> 1920398 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1920398 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1920398 INFO  
(zkCallback-3086-thread-1-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1920434 INFO  (jetty-launcher-3068-thread-2) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node4/.
   [junit4]   2> 1920443 INFO  (jetty-launcher-3068-thread-4) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1920443 INFO  (jetty-launcher-3068-thread-4) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1920444 INFO  (jetty-launcher-3068-thread-4) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34057_solr
   [junit4]   2> 1920445 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1920445 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1920452 INFO  (jetty-launcher-3068-thread-3) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node3/.
   [junit4]   2> 1920453 INFO  
(zkCallback-3086-thread-2-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1920453 INFO  
(zkCallback-3093-thread-1-processing-n:127.0.0.1:34057_solr) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1920472 INFO  (jetty-launcher-3068-thread-1) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node1/.
   [junit4]   2> 1920545 INFO  (jetty-launcher-3068-thread-4) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node2/.
   [junit4]   2> 1920553 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1920555 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42841/solr ready
   [junit4]   2> 1920709 INFO  (qtp418942917-17723) [n:127.0.0.1:39893_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&name=test_col&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1920714 INFO  
(OverseerThreadFactory-7955-thread-1-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
test_col
   [junit4]   2> 1920818 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1920818 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1920818 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1920819 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1920819 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1920819 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1920820 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1920820 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1920923 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1920923 INFO  
(zkCallback-3093-thread-1-processing-n:127.0.0.1:34057_solr) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1920924 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1920924 INFO  
(zkCallback-3086-thread-2-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1921831 WARN  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1921832 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.7.0
   [junit4]   2> 1921835 WARN  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1921835 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.7.0
   [junit4]   2> 1921874 WARN  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1921875 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.7.0
   [junit4]   2> 1921891 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema 
[test_col_shard1_replica1] Schema name=minimal-atomic-stress
   [junit4]   2> 1921892 WARN  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.Config Beginning with 
Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1921893 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.7.0
   [junit4]   2> 1921896 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema 
[test_col_shard2_replica2] Schema name=minimal-atomic-stress
   [junit4]   2> 1921897 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1921897 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard1_replica1' using configuration from collection 
test_col, trusted=true
   [junit4]   2> 1921898 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1921898 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore 
[[test_col_shard1_replica1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node4/test_col_shard1_replica1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node4/./test_col_shard1_replica1/data/]
   [junit4]   2> 1921898 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@21cc06c4
   [junit4]   2> 1921898 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1921899 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard2_replica2' using configuration from collection 
test_col, trusted=true
   [junit4]   2> 1921900 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1921900 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore 
[[test_col_shard2_replica2] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node3/test_col_shard2_replica2],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node3/./test_col_shard2_replica2/data/]
   [junit4]   2> 1921900 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: 
[LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, 
maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1921900 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@21cc06c4
   [junit4]   2> 1921901 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema 
[test_col_shard1_replica2] Schema name=minimal-atomic-stress
   [junit4]   2> 1921901 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: 
[LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, 
maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1921903 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1921903 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard1_replica2' using configuration from collection 
test_col, trusted=true
   [junit4]   2> 1921904 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1921904 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore 
[[test_col_shard1_replica2] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node2/test_col_shard1_replica2],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node2/./test_col_shard1_replica2/data/]
   [junit4]   2> 1921904 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@21cc06c4
   [junit4]   2> 1921905 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: 
[LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, 
maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1921907 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema 
[test_col_shard2_replica1] Schema name=minimal-atomic-stress
   [junit4]   2> 1921908 WARN  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1921910 WARN  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1921914 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema Loaded 
schema minimal-atomic-stress/1.6 with uniqueid field id
   [junit4]   2> 1921915 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.CoreContainer Creating 
SolrCore 'test_col_shard2_replica1' using configuration from collection 
test_col, trusted=true
   [junit4]   2> 1921915 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1921915 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore 
[[test_col_shard2_replica1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node1/test_col_shard2_replica1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestStressCloudBlindAtomicUpdates_8B46450CA45A642-001/tempDir-001/node1/./test_col_shard2_replica1/data/]
   [junit4]   2> 1921915 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.JmxMonitoredMap JMX 
monitoring is enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@21cc06c4
   [junit4]   2> 1921916 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: 
[LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, 
maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1921917 WARN  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1921921 WARN  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.RequestHandlers 
INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class 
= DumpRequestHandler,attributes = {initParams=a, name=/dump, 
class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1921950 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1921950 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1921950 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1921950 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1921951 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1921951 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1921951 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1921951 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1921952 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=35, 
maxMergedSegmentMB=53.9189453125, floorSegmentMB=0.23046875, 
forceMergeDeletesPctAllowed=20.887221297762682, segmentsPerTier=33.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1921952 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=35, 
maxMergedSegmentMB=53.9189453125, floorSegmentMB=0.23046875, 
forceMergeDeletesPctAllowed=20.887221297762682, segmentsPerTier=33.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1921952 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1921952 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@76a7205b[test_col_shard2_replica2] main]
   [junit4]   2> 1921992 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1921993 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1921993 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@439965ed[test_col_shard1_replica2] main]
   [junit4]   2> 1921993 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1921993 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921993 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921993 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1921994 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921994 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921994 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1921994 INFO  
(searcherExecutor-7965-thread-1-processing-n:127.0.0.1:39893_solr 
x:test_col_shard2_replica2 s:shard2 c:test_col) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore 
[test_col_shard2_replica2] Registered new searcher 
Searcher@76a7205b[test_col_shard2_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1921995 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1571061724578054144
   [junit4]   2> 1921995 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1921995 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1921995 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=35, 
maxMergedSegmentMB=53.9189453125, floorSegmentMB=0.23046875, 
forceMergeDeletesPctAllowed=20.887221297762682, segmentsPerTier=33.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1921995 INFO  
(searcherExecutor-7966-thread-1-processing-n:127.0.0.1:34057_solr 
x:test_col_shard1_replica2 s:shard1 c:test_col) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore 
[test_col_shard1_replica2] Registered new searcher 
Searcher@439965ed[test_col_shard1_replica2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1921996 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1571061724579102720
   [junit4]   2> 1921996 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1921996 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1921997 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy 
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: 
[TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=35, 
maxMergedSegmentMB=53.9189453125, floorSegmentMB=0.23046875, 
forceMergeDeletesPctAllowed=20.887221297762682, segmentsPerTier=33.0, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1921997 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@43bd9fc8[test_col_shard2_replica1] main]
   [junit4]   2> 1921997 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@7f369228[test_col_shard1_replica1] main]
   [junit4]   2> 1921998 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921998 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921998 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921998 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1921998 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set
   [junit4]   2> 1921998 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.h.ReplicationHandler 
Commits will be reserved for  10000
   [junit4]   2> 1921998 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1921999 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1921999 INFO  
(searcherExecutor-7964-thread-1-processing-n:127.0.0.1:42803_solr 
x:test_col_shard1_replica1 s:shard1 c:test_col) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore 
[test_col_shard1_replica1] Registered new searcher 
Searcher@7f369228[test_col_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1921999 INFO  
(searcherExecutor-7967-thread-1-processing-n:127.0.0.1:44837_solr 
x:test_col_shard2_replica1 s:shard2 c:test_col) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore 
[test_col_shard2_replica1] Registered new searcher 
Searcher@43bd9fc8[test_col_shard2_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1922000 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1571061724583297024
   [junit4]   2> 1922001 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1571061724584345600
   [junit4]   2> 1922101 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922101 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922101 INFO  
(zkCallback-3086-thread-2-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922101 INFO  
(zkCallback-3093-thread-1-processing-n:127.0.0.1:34057_solr) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922499 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1922499 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1922499 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:39893/solr/test_col_shard2_replica2/
   [junit4]   2> 1922499 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard2_replica2 url=http://127.0.0.1:39893/solr START 
replicas=[http://127.0.0.1:44837/solr/test_col_shard2_replica1/] nUpdates=100
   [junit4]   2> 1922499 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1922499 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1922499 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SyncStrategy Sync 
replicas to http://127.0.0.1:34057/solr/test_col_shard1_replica2/
   [junit4]   2> 1922500 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard1_replica2 url=http://127.0.0.1:34057/solr START 
replicas=[http://127.0.0.1:42803/solr/test_col_shard1_replica1/] nUpdates=100
   [junit4]   2> 1922509 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard2_replica2 url=http://127.0.0.1:39893/solr DONE.  We have no 
versions.  sync failed.
   [junit4]   2> 1922512 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.PeerSync PeerSync: 
core=test_col_shard1_replica2 url=http://127.0.0.1:34057/solr DONE.  We have no 
versions.  sync failed.
   [junit4]   2> 1922519 INFO  (qtp1721556082-17745) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] o.a.s.c.S.Request 
[test_col_shard1_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1922519 INFO  (qtp299134424-17718) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] o.a.s.c.S.Request 
[test_col_shard2_replica1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1922519 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SyncStrategy Leader's 
attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1922519 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1922519 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1922519 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SyncStrategy Leader's 
attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1922519 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1922519 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1922522 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:34057/solr/test_col_shard1_replica2/ shard1
   [junit4]   2> 1922524 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:39893/solr/test_col_shard2_replica2/ shard2
   [junit4]   2> 1922626 INFO  
(zkCallback-3093-thread-1-processing-n:127.0.0.1:34057_solr) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922626 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922626 INFO  
(zkCallback-3086-thread-2-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922626 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922673 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 1922675 INFO  (qtp1103092530-17730) [n:127.0.0.1:34057_solr 
c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2}
 status=0 QTime=1854
   [junit4]   2> 1922675 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 1922676 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica2&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2}
 status=0 QTime=1857
   [junit4]   2> 1922778 INFO  
(zkCallback-3086-thread-2-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922781 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922781 INFO  
(zkCallback-3093-thread-1-processing-n:127.0.0.1:34057_solr) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1922785 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1923004 INFO  (qtp1721556082-17743) [n:127.0.0.1:42803_solr 
c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard1_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard1&wt=javabin&version=2}
 status=0 QTime=2185
   [junit4]   2> 1923006 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&newCollection=true&name=test_col_shard2_replica1&action=CREATE&numShards=2&collection=test_col&shard=shard2&wt=javabin&version=2}
 status=0 QTime=2187
   [junit4]   2> 1923009 INFO  (qtp418942917-17723) [n:127.0.0.1:39893_solr    
] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 1923111 INFO  
(zkCallback-3093-thread-1-processing-n:127.0.0.1:34057_solr) 
[n:127.0.0.1:34057_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1923111 INFO  
(zkCallback-3086-thread-2-processing-n:127.0.0.1:44837_solr) 
[n:127.0.0.1:44837_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1923113 INFO  
(zkCallback-3084-thread-1-processing-n:127.0.0.1:39893_solr) 
[n:127.0.0.1:39893_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1923113 INFO  
(zkCallback-3081-thread-1-processing-n:127.0.0.1:42803_solr) 
[n:127.0.0.1:42803_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/test_col/state.json] for collection [test_col] has occurred - 
updating... (live nodes size: [4])
   [junit4]   2> 1924012 INFO  (qtp418942917-17723) [n:127.0.0.1:39893_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=2&property.config=solrconfig-tlog.xml&property.schema=schema-minimal-atomic-stress.xml&collection.configName=org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates_config-set&name=test_col&action=CREATE&numShards=2&wt=javabin&version=2}
 status=0 QTime=3303
   [junit4]   2> 1924013 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: 
test_col failOnTimeout:true timeout (sec):330
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> replica:core_node1 rstate:active live:true
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 1924021 INFO  
(SUITE-TestStressCloudBlindAtomicUpdates-seed#[8B46450CA45A642]-worker) [    ] 
o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: test_col
   [junit4]   2> 1924032 INFO  (qtp1721556082-17726) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] o.a.s.c.S.Request 
[test_col_shard1_replica1]  webapp=/solr path=/schema/fieldtypes/long 
params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1924093 INFO  
(TEST-TestStressCloudBlindAtomicUpdates.test_dv-seed#[8B46450CA45A642]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting test_dv
   [junit4]   2> 1924111 INFO  (qtp1721556082-17745) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&_version_=-1571061726779015168&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1571061726779015168)} 0 7
   [junit4]   2> 1924121 INFO  (qtp299134424-17718) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&_version_=-1571061726788452352&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1571061726788452352)} 0 3
   [junit4]   2> 1924121 INFO  (qtp418942917-17713) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{deleteByQuery=*:*
 (-1571061726788452352)} 0 18
   [junit4]   2> 1924121 INFO  (qtp1103092530-17714) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{deleteByQuery=*:* 
(-1571061726779015168)} 0 27
   [junit4]   2> 1924126 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1924126 WARN  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1924126 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1924126 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1924128 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1924128 WARN  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1924128 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1924128 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 2
   [junit4]   2> 1924128 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1924128 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 0
   [junit4]   2> 1924139 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1924139 WARN  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1924139 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1924139 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1924140 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1924140 WARN  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 Starting optimize... Reading and rewriting the 
entire index! Use with care.
   [junit4]   2> 1924140 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1924140 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1924141 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 0
   [junit4]   2> 1924141 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&optimize=true&maxSegments=1&waitSearcher=true&openSearcher=true&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{optimize=}
 0 1
   [junit4]   2> 1924145 INFO  (qtp1103092530-17733) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update 
params={_stateVer_=test_col:5&optimize=true&maxSegments=1&waitSearcher=true&wt=javabin&version=2}{optimize=}
 0 20
   [junit4]   2> 1924147 INFO  (qtp418942917-17725) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] o.a.s.c.S.Request 
[test_col_shard2_replica2]  webapp=/solr path=/schema/fields/long_dv 
params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1924147 INFO  
(TEST-TestStressCloudBlindAtomicUpdates.test_dv-seed#[8B46450CA45A642]) [    ] 
o.a.s.c.TestStressCloudBlindAtomicUpdates Testing long_dv: numDocsToCheck=146, 
numDocsInIndex=1022, incr=7
   [junit4]   2> 1924158 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[0
 (1571061726842978304)]} 0 0
   [junit4]   2> 1924158 INFO  (qtp1103092530-17711) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[0 (1571061726842978304)]} 0 3
   [junit4]   2> 1924162 INFO  (qtp1721556082-17721) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[1
 (1571061726848221184)]} 0 0
   [junit4]   2> 1924162 INFO  (qtp1103092530-17714) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[1 (1571061726848221184)]} 0 2
   [junit4]   2> 1924173 INFO  (qtp299134424-17709) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[2
 (1571061726858706944)]} 0 0
   [junit4]   2> 1924173 INFO  (qtp418942917-17712) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[2 (1571061726858706944)]} 0 3
   [junit4]   2> 1924177 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[3
 (1571061726863949824)]} 0 0
   [junit4]   2> 1924177 INFO  (qtp418942917-17713) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[3 (1571061726863949824)]} 0 1
   [junit4]   2> 1924181 INFO  (qtp1721556082-17721) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[4
 (1571061726868144128)]} 0 0
   [junit4]   2> 1924181 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[4 (1571061726868144128)]} 0 2
   [junit4]   2> 1924185 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[5
 (1571061726872338432)]} 0 0
   [junit4]   2> 1924193 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[5 (1571061726872338432)]} 0 9
   [junit4]   2> 1924204 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[6
 (1571061726892261376)]} 0 0
   [junit4]   2> 1924204 INFO  (qtp418942917-17725) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[6 (1571061726892261376)]} 0 2
   [junit4]   2> 1924208 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[7
 (1571061726896455680)]} 0 0
   [junit4]   2> 1924208 INFO  (qtp418942917-17712) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[7 (1571061726896455680)]} 0 2
   [junit4]   2> 1924212 INFO  (qtp1721556082-17721) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[8
 (1571061726900649984)]} 0 0
   [junit4]   2> 1924212 INFO  (qtp1103092530-17733) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[8 (1571061726900649984)]} 0 1
   [junit4]   2> 1924215 INFO  (qtp299134424-17724) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[9
 (1571061726904844288)]} 0 0
   [junit4]   2> 1924216 INFO  (qtp418942917-17713) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[9 (1571061726904844288)]} 0 2
   [junit4]   2> 1924219 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[10
 (1571061726907990016)]} 0 0
   [junit4]   2> 1924219 INFO  (qtp1103092530-17711) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[10 (1571061726907990016)]} 0 2
   [junit4]   2> 1924223 INFO  (qtp1721556082-17745) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[11
 (1571061726912184320)]} 0 0
   [junit4]   2> 1924223 INFO  (qtp1103092530-17714) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[11 (1571061726912184320)]} 0 2
   [junit4]   2> 1924226 INFO  (qtp1721556082-17745) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[12
 (1571061726916378624)]} 0 0
   [junit4]   2> 1924227 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[12 (1571061726916378624)]} 0 1
   [junit4]   2> 1924230 INFO  (qtp1721556082-17745) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[13
 (1571061726919524352)]} 0 0
   [junit4]   2> 1924231 INFO  (qtp1103092530-17733) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[13 (1571061726919524352)]} 0 2
   [junit4]   2> 1924234 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[14
 (1571061726923718656)]} 0 0
   [junit4]   2> 1924234 INFO  (qtp1103092530-17711) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[14 (1571061726923718656)]} 0 2
   [junit4]   2> 1924238 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[15
 (1571061726927912960)]} 0 0
   [junit4]   2> 1924238 INFO  (qtp1103092530-17714) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[15 (1571061726927912960)]} 0 2
   [junit4]   2> 1924242 INFO  (qtp1721556082-17719) [n:127.0.0.1:42803_solr 
c:test_col s:shard1 r:core_node3 x:test_col_shard1_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34057/solr/test_col_shard1_replica2/&wt=javabin&version=2}{add=[16
 (1571061726932107264)]} 0 0
   [junit4]   2> 1924242 INFO  (qtp1103092530-17716) [n:127.0.0.1:34057_solr 
c:test_col s:shard1 r:core_node4 x:test_col_shard1_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard1_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[16 (1571061726932107264)]} 0 2
   [junit4]   2> 1924246 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[17
 (1571061726936301568)]} 0 0
   [junit4]   2> 1924246 INFO  (qtp418942917-17736) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica2]  webapp=/solr 
path=/update params={wt=javabin&version=2}{add=[17 (1571061726936301568)]} 0 2
   [junit4]   2> 1924249 INFO  (qtp299134424-17749) [n:127.0.0.1:44837_solr 
c:test_col s:shard2 r:core_node1 x:test_col_shard2_replica1] 
o.a.s.u.p.LogUpdateProcessorFactory [test_col_shard2_replica1]  webapp=/solr 
path=/update 
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:39893/solr/test_col_shard2_replica2/&wt=javabin&version=2}{add=[18
 (1571061726940495872)]} 0 0
   [junit4]   2> 1924249 INFO  (qtp418942917-17725) [n:127.0.0.1:39893_solr 
c:test_col s:shard2 r:core_node2 x:test_col_shard2_re

[...truncated too long message...]

>         at 
> org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]   2>         at 
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>   21) Thread[id=1816, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestInPlaceUpdatesDistrib]
   [junit4]   2>         at sun.nio.ch.IOUtil.drain(Native Method)
   [junit4]   2>         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:104)
   [junit4]   2>         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]   2>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]   2>         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:173)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>   22) Thread[id=1933, name=qtp649670403-1933, state=RUNNABLE, 
group=TGRP-TestInPlaceUpdatesDistrib]
   [junit4]   2>         at sun.nio.ch.IOUtil.drain(Native Method)
   [junit4]   2>         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:104)
   [junit4]   2>         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]   2>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]   2>         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   [junit4]   2>         at 
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]   2>         at 
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2>         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): 
{title_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), 
id=PostingsFormat(name=Direct), 
id_field_copy_that_does_not_support_in_place_update_s=PostingsFormat(name=LuceneVarGapDocFreqInterval)},
 docValues:{inplace_updatable_float=DocValuesFormat(name=Asserting), 
id_i=DocValuesFormat(name=Lucene54), _version_=DocValuesFormat(name=Asserting), 
id=DocValuesFormat(name=Lucene54), 
inplace_updatable_int_with_default=DocValuesFormat(name=Asserting), 
inplace_updatable_float_with_default=DocValuesFormat(name=Lucene54)}, 
maxPointsInLeafNode=239, maxMBSortInHeap=6.592193958523996, 
sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=sq, 
timezone=Africa/Monrovia
   [junit4]   2> NOTE: Linux 4.10.0-21-generic amd64/Oracle Corporation 
1.8.0_131 (64-bit)/cpus=8,threads=33,free=29366232,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrCoreSnapshots, 
TestConfigSets, TestRequestForwarding, SparseHLLTest, TestJsonFacets, 
TestMiniSolrCloudClusterSSL, StatelessScriptUpdateProcessorFactoryTest, 
TestNumericTerms32, TestWriterPerf, DeleteInactiveReplicaTest, 
SimpleMLTQParserTest, TestOverriddenPrefixQueryForCustomFieldType, 
TestLockTree, TestFieldSortValues, SolrIndexConfigTest, TestIntervalFaceting, 
AnalyticsMergeStrategyTest, TestExclusionRuleCollectionAccess, TestDocTermOrds, 
TestInitParams, UpdateRequestProcessorFactoryTest, 
DistributedFacetPivotLargeTest, TestPartialUpdateDeduplication, 
BlockJoinFacetRandomTest, BasicAuthIntegrationTest, VersionInfoTest, 
TestHashPartitioner, TestInPlaceUpdatesDistrib]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestInPlaceUpdatesDistrib -Dtests.seed=8B46450CA45A642 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sq 
-Dtests.timezone=Africa/Monrovia -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestInPlaceUpdatesDistrib (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8B46450CA45A642]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1876, name=solr-idle-connections-evictor, 
state=RUNNABLE, group=TGRP-TestInPlaceUpdatesDistrib]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8B46450CA45A642]:0)
   [junit4]    >        at 
org.apache.http.pool.AbstractConnPool.closeExpired(AbstractConnPool.java:558)
   [junit4]    >        at 
org.apache.http.impl.conn.PoolingClientConnectionManager.closeExpiredConnections(PoolingClientConnectionManager.java:293)
   [junit4]    >        at 
org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:267)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)Throwable #3: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1877, name=solr-idle-connections-evictor, 
state=RUNNABLE, group=TGRP-TestInPlaceUpdatesDistrib]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap 
spaceThrowable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: 
Captured an uncaught exception in thread: Thread[id=1809, 
name=solr-idle-connections-evictor, state=RUNNABLE, 
group=TGRP-TestInPlaceUpdatesDistrib]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4] Completed [622/713 (2!)] on J1 in 7226.83s, 1 test, 5 errors <<< 
FAILURES!

[...truncated 131 lines...]
   [junit4] Suite: org.apache.solr.update.processor.TolerantUpdateProcessorTest
   [junit4] ERROR   0.00s J1 | TolerantUpdateProcessorTest.initializationError 
<<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4] Completed [651/713 (3!)] on J1 in 0.00s, 1 test, 1 error <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.cloud.CleanupOldIndexTest
   [junit4] ERROR   0.00s J1 | CleanupOldIndexTest.initializationError <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4] Completed [652/713 (4!)] on J1 in 0.00s, 1 test, 1 error <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.core.TestCoreContainer
   [junit4] ERROR   0.00s J1 | TestCoreContainer (suite) <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4] Completed [653/713 (5!)] on J1 in 0.00s, 0 tests, 1 error <<< 
FAILURES!

[...truncated 185 lines...]
   [junit4] JVM J1: stdout was not empty, see: 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/temp/junit4-J1-20170624_044132_5365951783998888274891.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/heapdumps/java_pid23792.hprof ...
   [junit4] Heap dump file created [532343221 bytes in 3.236 secs]
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J1: stderr was not empty, see: 
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/temp/junit4-J1-20170624_044132_5363915890029272922315.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the 
UncaughtExceptionHandler in thread 
"TEST-TestInPlaceUpdatesDistrib.test-seed#[8B46450CA45A642]-SendThread(127.0.0.1:34565)"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the 
UncaughtExceptionHandler in thread 
"TEST-TestInPlaceUpdatesDistrib.test-seed#[8B46450CA45A642]-SendThread(127.0.0.1:34565)"
   [junit4] 
   [junit4] Exception: java.lang.IllegalArgumentException thrown from the 
UncaughtExceptionHandler in thread "solr-idle-connections-evictor"
   [junit4] 
   [junit4] Exception: java.lang.IllegalArgumentException thrown from the 
UncaughtExceptionHandler in thread "solr-idle-connections-evictor"
   [junit4] 
   [junit4] Exception: java.lang.IllegalArgumentException thrown from the 
UncaughtExceptionHandler in thread "solr-idle-connections-evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the 
UncaughtExceptionHandler in thread "NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0"
   [junit4] <<< JVM J1: EOF ----

[...truncated 7481 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:810: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:762: Some of the tests 
produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? 
Dumps created:
* java_pid23792.hprof

Total time: 153 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to