Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4255/
Java: 64bit/jdk-9 -XX:+UseCompressedOops -XX:+UseSerialGC --illegal-access=deny

1 tests failed.
FAILED:  
org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Timeout waiting for all live and active

Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
        at 
__randomizedtesting.SeedInfo.seed([2EDDAA7C6B11585A:166E8E824CE28C8B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:95)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 11540 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
   [junit4]   2> 34903 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/init-core-data-001
   [junit4]   2> 34905 WARN  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 34905 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 34906 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 34906 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001
   [junit4]   2> 34906 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 34906 INFO  (Thread-87) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 34906 INFO  (Thread-87) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 34910 ERROR (Thread-87) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 35009 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:49656
   [junit4]   2> 35027 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.Server 
jetty-9.3.20.v20170531
   [junit4]   2> 35032 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.Server 
jetty-9.3.20.v20170531
   [junit4]   2> 35032 INFO  (jetty-launcher-68-thread-3) [    ] o.e.j.s.Server 
jetty-9.3.20.v20170531
   [junit4]   2> 35035 INFO  (jetty-launcher-68-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@255419ae{/solr,null,AVAILABLE}
   [junit4]   2> 35035 INFO  (jetty-launcher-68-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3472664f{/solr,null,AVAILABLE}
   [junit4]   2> 35036 INFO  (jetty-launcher-68-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3dd2d1e8{/solr,null,AVAILABLE}
   [junit4]   2> 35037 INFO  (jetty-launcher-68-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@1a025d32{HTTP/1.1,[http/1.1]}{127.0.0.1:49661}
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-2) [    ] o.e.j.s.Server 
Started @37249ms
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@2a2ab205{HTTP/1.1,[http/1.1]}{127.0.0.1:49660}
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=49661}
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] o.e.j.s.Server 
Started @37249ms
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=49660}
   [junit4]   2> 35038 ERROR (jetty-launcher-68-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@3160151f{HTTP/1.1,[http/1.1]}{127.0.0.1:49659}
   [junit4]   2> 35038 ERROR (jetty-launcher-68-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-1) [    ] o.e.j.s.Server 
Started @37249ms
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=49659}
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 35038 ERROR (jetty-launcher-68-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-10-30T11:15:42.370861Z
   [junit4]   2> 35038 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-10-30T11:15:42.370885Z
   [junit4]   2> 35039 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 35039 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 35039 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 35039 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2017-10-30T11:15:42.371402Z
   [junit4]   2> 35043 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 35044 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 35044 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 35058 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49656/solr
   [junit4]   2> 35062 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49656/solr
   [junit4]   2> 35067 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49656/solr
   [junit4]   2> 35269 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 35270 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 35271 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49659_solr
   [junit4]   2> 35272 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:49661_solr
   [junit4]   2> 35272 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=98917557353906185-127.0.0.1:49659_solr-n_0000000000) starting
   [junit4]   2> 35274 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 35274 INFO  (zkCallback-85-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 35275 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 35278 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 35282 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:49660_solr
   [junit4]   2> 35285 INFO  (zkCallback-85-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 35285 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 35295 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 35296 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 35297 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 35298 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 35298 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion -1
   [junit4]   2> 35298 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 1
   [junit4]   2> 35298 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:49659_solr
   [junit4]   2> 35301 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 35302 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 35302 INFO  (zkCallback-85-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 35304 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 35305 DEBUG 
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion 1
   [junit4]   2> 35305 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 35426 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49659.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35440 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49661.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35457 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49660.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35480 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49659.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35481 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49659.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35484 INFO  (jetty-launcher-68-thread-1) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/.
   [junit4]   2> 35490 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49661.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35490 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49661.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35494 INFO  (jetty-launcher-68-thread-2) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node2/.
   [junit4]   2> 35495 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49660.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35495 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49660.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 35501 INFO  (jetty-launcher-68-thread-3) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/.
   [junit4]   2> 35620 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 35622 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49656/solr ready
   [junit4]   2> 35651 INFO  
(TEST-AutoAddReplicasIntegrationTest.testSimple-seed#[2EDDAA7C6B11585A]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testSimple
   [junit4]   2> 35657 INFO  (qtp2142824487-385) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:49660_solr,127.0.0.1:49659_solr&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 35661 INFO  (OverseerThreadFactory-234-thread-1) [    ] 
o.a.s.c.CreateCollectionCmd Create collection testSimple1
   [junit4]   2> 35784 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49659/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 35787 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49660/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 35791 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49659/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 35796 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49660/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 36003 INFO  (qtp2142824487-386) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 36004 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 36005 INFO  (qtp2142824487-388) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 36007 INFO  (qtp1342394644-394) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 36007 INFO  (qtp1342394644-396) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 36008 INFO  (qtp1342394644-394) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 36116 INFO  (zkCallback-85-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 36116 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 36116 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 36116 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 36310 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 37044 INFO  (qtp2142824487-388) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 37045 INFO  (qtp1342394644-394) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 37058 INFO  (qtp2142824487-386) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 37069 INFO  (qtp1342394644-394) [    ] o.a.s.s.IndexSchema 
[testSimple1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 37071 INFO  (qtp2142824487-388) [    ] o.a.s.s.IndexSchema 
[testSimple1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 37071 INFO  (qtp1342394644-394) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 37072 INFO  (qtp1342394644-394) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from 
collection testSimple1, trusted=true
   [junit4]   2> 37072 INFO  (qtp1342394644-394) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49660.solr.core.testSimple1.shard2.replica_n6' (registry 
'solr.core.testSimple1.shard2.replica_n6') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 37072 INFO  (qtp1342394644-394) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 37072 INFO  (qtp1342394644-394) [    ] o.a.s.c.SolrCore 
[[testSimple1_shard2_replica_n6] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/testSimple1_shard2_replica_n6],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/./testSimple1_shard2_replica_n6/data/]
   [junit4]   2> 37072 INFO  (qtp2142824487-388) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 37073 INFO  (qtp2142824487-388) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from 
collection testSimple1, trusted=true
   [junit4]   2> 37073 INFO  (qtp2142824487-388) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49659.solr.core.testSimple1.shard2.replica_n4' (registry 
'solr.core.testSimple1.shard2.replica_n4') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 37073 INFO  (qtp2142824487-388) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 37073 INFO  (qtp2142824487-388) [    ] o.a.s.c.SolrCore 
[[testSimple1_shard2_replica_n4] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/testSimple1_shard2_replica_n4],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/./testSimple1_shard2_replica_n4/data/]
   [junit4]   2> 37076 INFO  (qtp1342394644-396) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 37088 INFO  (qtp2142824487-386) [    ] o.a.s.s.IndexSchema 
[testSimple1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 37089 INFO  (qtp2142824487-386) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 37089 INFO  (qtp2142824487-386) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from 
collection testSimple1, trusted=true
   [junit4]   2> 37090 INFO  (qtp2142824487-386) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49659.solr.core.testSimple1.shard1.replica_n1' (registry 
'solr.core.testSimple1.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 37090 INFO  (qtp1342394644-396) [    ] o.a.s.s.IndexSchema 
[testSimple1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 37090 INFO  (qtp2142824487-386) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 37090 INFO  (qtp2142824487-386) [    ] o.a.s.c.SolrCore 
[[testSimple1_shard1_replica_n1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/testSimple1_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/./testSimple1_shard1_replica_n1/data/]
   [junit4]   2> 37092 INFO  (qtp1342394644-396) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 37092 INFO  (qtp1342394644-396) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from 
collection testSimple1, trusted=true
   [junit4]   2> 37093 INFO  (qtp1342394644-396) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49660.solr.core.testSimple1.shard1.replica_n2' (registry 
'solr.core.testSimple1.shard1.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 37093 INFO  (qtp1342394644-396) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 37093 INFO  (qtp1342394644-396) [    ] o.a.s.c.SolrCore 
[[testSimple1_shard1_replica_n2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/testSimple1_shard1_replica_n2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/./testSimple1_shard1_replica_n2/data/]
   [junit4]   2> 37209 INFO  (qtp2142824487-386) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 37209 INFO  (qtp2142824487-386) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 37213 INFO  (qtp2142824487-386) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 37213 INFO  (qtp2142824487-386) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 37217 INFO  (qtp2142824487-388) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 37217 INFO  (qtp2142824487-388) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 37219 INFO  (qtp2142824487-386) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@168a5457[testSimple1_shard1_replica_n1] main]
   [junit4]   2> 37220 INFO  (qtp2142824487-388) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 37220 INFO  (qtp2142824487-388) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 37222 INFO  (qtp2142824487-386) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 37223 INFO  (qtp2142824487-386) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 37224 INFO  (qtp2142824487-386) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 37226 INFO  (searcherExecutor-243-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher 
Searcher@168a5457[testSimple1_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 37226 INFO  (qtp1342394644-394) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 37226 INFO  (qtp1342394644-394) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 37228 INFO  (qtp1342394644-394) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 37228 INFO  (qtp1342394644-394) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 37226 INFO  (qtp2142824487-386) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680920092049408
   [junit4]   2> 37234 INFO  (qtp2142824487-388) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@1496f02e[testSimple1_shard2_replica_n4] main]
   [junit4]   2> 37236 INFO  (qtp2142824487-388) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 37236 INFO  (qtp2142824487-388) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 37237 INFO  (qtp2142824487-388) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 37239 INFO  (qtp1342394644-394) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7fc1f6d4[testSimple1_shard2_replica_n6] main]
   [junit4]   2> 37239 INFO  (searcherExecutor-242-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher 
Searcher@1496f02e[testSimple1_shard2_replica_n4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 37239 INFO  (qtp2142824487-388) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680920105680896
   [junit4]   2> 37241 INFO  (qtp1342394644-394) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 37242 INFO  (qtp1342394644-394) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 37243 INFO  (qtp1342394644-394) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 37245 INFO  (searcherExecutor-241-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple1_shard2_replica_n6] Registered new searcher 
Searcher@7fc1f6d4[testSimple1_shard2_replica_n6] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 37245 INFO  (qtp1342394644-394) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680920111972352
   [junit4]   2> 37248 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9998ms
   [junit4]   2> 37250 INFO  (qtp2142824487-388) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 37250 INFO  (qtp2142824487-388) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 37250 INFO  (qtp2142824487-388) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:49659/solr/testSimple1_shard2_replica_n4/
   [junit4]   2> 37251 INFO  (qtp2142824487-388) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple1_shard2_replica_n4 url=http://127.0.0.1:49659/solr 
START replicas=[http://127.0.0.1:49660/solr/testSimple1_shard2_replica_n6/] 
nUpdates=100
   [junit4]   2> 37254 INFO  (qtp1342394644-398) [    ] o.a.s.c.S.Request 
[testSimple1_shard2_replica_n6]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 37255 INFO  (qtp1342394644-396) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 37255 INFO  (qtp1342394644-396) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 37257 INFO  (qtp1342394644-396) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 37257 INFO  (qtp1342394644-396) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 37259 INFO  (qtp1342394644-396) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5098637b[testSimple1_shard1_replica_n2] main]
   [junit4]   2> 37290 INFO  (qtp1342394644-396) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 37291 INFO  (qtp1342394644-396) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 37292 INFO  (qtp1342394644-396) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 37293 INFO  (searcherExecutor-244-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher 
Searcher@5098637b[testSimple1_shard1_replica_n2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 37293 INFO  (qtp1342394644-396) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680920162304000
   [junit4]   2> 37311 DEBUG (ScheduledTrigger-232-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 37362 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37362 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37363 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37362 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37562 INFO  (qtp2142824487-388) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple1_shard2_replica_n4 url=http://127.0.0.1:49659/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 37562 INFO  (qtp2142824487-388) [    ] o.a.s.c.SyncStrategy 
Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 37562 INFO  (qtp2142824487-388) [    ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 37562 INFO  (qtp2142824487-388) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 37569 INFO  (qtp2142824487-388) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49659/solr/testSimple1_shard2_replica_n4/ shard2
   [junit4]   2> 37682 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37682 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37682 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37682 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37740 INFO  (qtp2142824487-388) [    ] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 37743 INFO  (qtp2142824487-388) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1738
   [junit4]   2> 37757 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 37757 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 37757 INFO  (qtp2142824487-386) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:49659/solr/testSimple1_shard1_replica_n1/
   [junit4]   2> 37758 INFO  (qtp2142824487-386) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple1_shard1_replica_n1 url=http://127.0.0.1:49659/solr 
START replicas=[http://127.0.0.1:49660/solr/testSimple1_shard1_replica_n2/] 
nUpdates=100
   [junit4]   2> 37760 INFO  (qtp1342394644-399) [    ] o.a.s.c.S.Request 
[testSimple1_shard1_replica_n2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 37845 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37845 INFO  (zkCallback-85-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37845 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 37845 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38065 INFO  (qtp2142824487-386) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple1_shard1_replica_n1 url=http://127.0.0.1:49659/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 38065 INFO  (qtp2142824487-386) [    ] o.a.s.c.SyncStrategy 
Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 38065 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 38065 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 38071 INFO  (qtp2142824487-386) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49659/solr/testSimple1_shard1_replica_n1/ shard1
   [junit4]   2> 38179 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38179 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38179 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38179 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38184 INFO  (qtp2142824487-386) [    ] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 38186 INFO  (qtp2142824487-386) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2183
   [junit4]   2> 38256 INFO  (qtp1342394644-394) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2249
   [junit4]   2> 38303 INFO  (qtp1342394644-396) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2295
   [junit4]   2> 38308 INFO  (qtp2142824487-385) [    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 38313 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 38410 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38410 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38410 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 38410 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 39313 INFO  (qtp2142824487-385) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/collections 
params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:49660_solr,127.0.0.1:49659_solr&wt=javabin&version=2}
 status=0 QTime=3656
   [junit4]   2> 39315 INFO  (qtp2142824487-391) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:49659_solr,127.0.0.1:49661_solr&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 39322 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 39324 INFO  (OverseerThreadFactory-234-thread-2) [    ] 
o.a.s.c.CreateCollectionCmd Create collection testSimple2
   [junit4]   2> 39325 INFO  
(OverseerCollectionConfigSetProcessor-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 39555 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49661/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 39560 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple2_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49659/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 39564 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple2_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49661/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 39568 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple2_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49659/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 39784 INFO  (qtp2142824487-383) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 39784 INFO  (qtp2142824487-387) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 39785 INFO  (qtp1735575440-390) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 39787 INFO  (qtp1735575440-390) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 39788 INFO  (qtp1735575440-401) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 39906 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 39906 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 39906 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 39906 INFO  (zkCallback-84-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 40322 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 40816 INFO  (qtp2142824487-383) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 40846 INFO  (qtp1735575440-390) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 40847 INFO  (qtp2142824487-387) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 40865 INFO  (qtp1735575440-401) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 40877 INFO  (qtp2142824487-383) [    ] o.a.s.s.IndexSchema 
[testSimple2_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 40877 INFO  (qtp1735575440-390) [    ] o.a.s.s.IndexSchema 
[testSimple2_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 40878 INFO  (qtp2142824487-387) [    ] o.a.s.s.IndexSchema 
[testSimple2_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 40881 INFO  (qtp2142824487-387) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 40881 INFO  (qtp2142824487-387) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple2_shard2_replica_n6' using configuration from 
collection testSimple2, trusted=true
   [junit4]   2> 40882 INFO  (qtp2142824487-387) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49659.solr.core.testSimple2.shard2.replica_n6' (registry 
'solr.core.testSimple2.shard2.replica_n6') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 40882 INFO  (qtp2142824487-387) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 40883 INFO  (qtp2142824487-387) [    ] o.a.s.c.SolrCore 
[[testSimple2_shard2_replica_n6] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/testSimple2_shard2_replica_n6],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/./testSimple2_shard2_replica_n6/data/]
   [junit4]   2> 40883 INFO  (qtp1735575440-390) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 40883 INFO  (qtp1735575440-390) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple2_shard2_replica_n4' using configuration from 
collection testSimple2, trusted=true
   [junit4]   2> 40884 INFO  (qtp1735575440-390) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49661.solr.core.testSimple2.shard2.replica_n4' (registry 
'solr.core.testSimple2.shard2.replica_n4') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 40884 INFO  (qtp1735575440-390) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 40884 INFO  (qtp1735575440-390) [    ] o.a.s.c.SolrCore 
[[testSimple2_shard2_replica_n4] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node2/testSimple2_shard2_replica_n4],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node2/./testSimple2_shard2_replica_n4/data/]
   [junit4]   2> 40885 INFO  (qtp2142824487-383) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 40885 INFO  (qtp2142824487-383) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple2_shard1_replica_n2' using configuration from 
collection testSimple2, trusted=true
   [junit4]   2> 40886 INFO  (qtp2142824487-383) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49659.solr.core.testSimple2.shard1.replica_n2' (registry 
'solr.core.testSimple2.shard1.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 40886 INFO  (qtp2142824487-383) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 40886 INFO  (qtp2142824487-383) [    ] o.a.s.c.SolrCore 
[[testSimple2_shard1_replica_n2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/testSimple2_shard1_replica_n2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node1/./testSimple2_shard1_replica_n2/data/]
   [junit4]   2> 40887 INFO  (qtp1735575440-401) [    ] o.a.s.s.IndexSchema 
[testSimple2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 40889 INFO  (qtp1735575440-401) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 40889 INFO  (qtp1735575440-401) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple2_shard1_replica_n1' using configuration from 
collection testSimple2, trusted=true
   [junit4]   2> 40889 INFO  (qtp1735575440-401) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49661.solr.core.testSimple2.shard1.replica_n1' (registry 
'solr.core.testSimple2.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 40890 INFO  (qtp1735575440-401) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 40890 INFO  (qtp1735575440-401) [    ] o.a.s.c.SolrCore 
[[testSimple2_shard1_replica_n1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node2/testSimple2_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node2/./testSimple2_shard1_replica_n1/data/]
   [junit4]   2> 41049 INFO  (qtp2142824487-383) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 41049 INFO  (qtp2142824487-383) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 41051 INFO  (qtp2142824487-387) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 41051 INFO  (qtp2142824487-387) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 41054 INFO  (qtp2142824487-387) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 41054 INFO  (qtp2142824487-387) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 41073 INFO  (qtp2142824487-383) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 41073 INFO  (qtp2142824487-383) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 41074 INFO  (qtp1735575440-401) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 41074 INFO  (qtp1735575440-401) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 41076 INFO  (qtp1735575440-401) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 41076 INFO  (qtp1735575440-401) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 41081 INFO  (qtp1735575440-390) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 41081 INFO  (qtp1735575440-390) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 41083 INFO  (qtp2142824487-387) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@6023b52d[testSimple2_shard2_replica_n6] main]
   [junit4]   2> 41083 INFO  (qtp1735575440-390) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 41083 INFO  (qtp1735575440-390) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 41085 INFO  (qtp2142824487-387) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 41085 INFO  (qtp2142824487-387) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 41085 INFO  (qtp2142824487-383) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2ebf91db[testSimple2_shard1_replica_n2] main]
   [junit4]   2> 41086 INFO  (qtp2142824487-387) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 41088 INFO  (qtp1735575440-401) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@5459e011[testSimple2_shard1_replica_n1] main]
   [junit4]   2> 41088 INFO  (searcherExecutor-261-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple2_shard2_replica_n6] Registered new searcher 
Searcher@6023b52d[testSimple2_shard2_replica_n6] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 41088 INFO  (qtp2142824487-387) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680924141649920
   [junit4]   2> 41090 INFO  (qtp1735575440-401) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 41090 INFO  (qtp2142824487-383) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 41090 INFO  (qtp1735575440-401) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 41091 INFO  (qtp2142824487-383) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 41092 INFO  (qtp1735575440-401) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 41093 INFO  (qtp1735575440-390) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@22f8cd83[testSimple2_shard2_replica_n4] main]
   [junit4]   2> 41093 INFO  (searcherExecutor-264-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple2_shard1_replica_n1] Registered new searcher 
Searcher@5459e011[testSimple2_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 41093 INFO  (qtp1735575440-401) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680924146892800
   [junit4]   2> 41096 INFO  (qtp2142824487-383) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 41097 INFO  (qtp1735575440-390) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 41099 INFO  (searcherExecutor-263-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple2_shard1_replica_n2] Registered new searcher 
Searcher@2ebf91db[testSimple2_shard1_replica_n2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 41099 INFO  (qtp2142824487-387) [    ] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 41099 INFO  (qtp1735575440-390) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 41099 INFO  (qtp2142824487-383) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680924153184256
   [junit4]   2> 41099 INFO  (qtp1735575440-390) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 41104 INFO  (searcherExecutor-262-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple2_shard2_replica_n4] Registered new searcher 
Searcher@22f8cd83[testSimple2_shard2_replica_n4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 41105 INFO  (qtp1735575440-390) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680924159475712
   [junit4]   2> 41106 INFO  (qtp1735575440-401) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 41107 INFO  (qtp1735575440-401) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 41107 INFO  (qtp1735575440-401) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:49661/solr/testSimple2_shard1_replica_n1/
   [junit4]   2> 41107 INFO  (qtp1735575440-401) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple2_shard1_replica_n1 url=http://127.0.0.1:49661/solr 
START replicas=[http://127.0.0.1:49659/solr/testSimple2_shard1_replica_n2/] 
nUpdates=100
   [junit4]   2> 41111 INFO  (qtp2142824487-388) [    ] o.a.s.c.S.Request 
[testSimple2_shard1_replica_n2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 41212 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41212 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41212 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41212 INFO  (zkCallback-84-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41333 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 41417 INFO  (qtp1735575440-401) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple2_shard1_replica_n1 url=http://127.0.0.1:49661/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 41418 INFO  (qtp1735575440-401) [    ] o.a.s.c.SyncStrategy 
Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 41418 INFO  (qtp1735575440-401) [    ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 41418 INFO  (qtp1735575440-401) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 41425 INFO  (qtp1735575440-401) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49661/solr/testSimple2_shard1_replica_n1/ shard1
   [junit4]   2> 41535 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41535 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41535 INFO  (zkCallback-84-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41535 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41579 INFO  (qtp1735575440-401) [    ] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 41582 INFO  (qtp1735575440-401) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1794
   [junit4]   2> 41601 INFO  (qtp2142824487-387) [    ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 41601 INFO  (qtp2142824487-387) [    ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 41601 INFO  (qtp2142824487-387) [    ] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:49659/solr/testSimple2_shard2_replica_n6/
   [junit4]   2> 41602 INFO  (qtp2142824487-387) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple2_shard2_replica_n6 url=http://127.0.0.1:49659/solr 
START replicas=[http://127.0.0.1:49661/solr/testSimple2_shard2_replica_n4/] 
nUpdates=100
   [junit4]   2> 41604 INFO  (qtp1735575440-404) [    ] o.a.s.c.S.Request 
[testSimple2_shard2_replica_n4]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 41683 INFO  (zkCallback-85-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41683 INFO  (zkCallback-84-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41683 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41683 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 41904 INFO  (qtp2142824487-387) [    ] o.a.s.u.PeerSync 
PeerSync: core=testSimple2_shard2_replica_n6 url=http://127.0.0.1:49659/solr 
DONE.  We have no versions.  sync failed.
   [junit4]   2> 41904 INFO  (qtp2142824487-387) [    ] o.a.s.c.SyncStrategy 
Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 41904 INFO  (qtp2142824487-387) [    ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 41904 INFO  (qtp2142824487-387) [    ] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 41911 INFO  (qtp2142824487-387) [    ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:49659/solr/testSimple2_shard2_replica_n6/ shard2
   [junit4]   2> 42015 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42015 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42015 INFO  (zkCallback-84-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42015 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42033 INFO  (qtp2142824487-387) [    ] o.a.s.c.ZkController I 
am the leader, no recovery necessary
   [junit4]   2> 42035 INFO  (qtp2142824487-387) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2251
   [junit4]   2> 42119 INFO  (qtp1735575440-390) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2334
   [junit4]   2> 42119 INFO  (qtp2142824487-383) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2335
   [junit4]   2> 42129 INFO  (qtp2142824487-391) [    ] 
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 42237 INFO  (zkCallback-85-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42237 INFO  (zkCallback-84-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42237 INFO  (zkCallback-84-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42237 INFO  (zkCallback-85-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple2/state.json] for collection [testSimple2] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 42337 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 43133 INFO  (qtp2142824487-391) [    ] o.a.s.s.HttpSolrCall 
[admin] webapp=null path=/admin/collections 
params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:49659_solr,127.0.0.1:49661_solr&wt=javabin&version=2}
 status=0 QTime=3817
   [junit4]   2> 43135 INFO  (qtp2142824487-386) [    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&collection.configName=conf&maxShardsPerNode=3&autoAddReplicas=false&name=testSimple3&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=127.0.0.1:49660_solr&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 43139 INFO  (OverseerThreadFactory-234-thread-3) [    ] 
o.a.s.c.CreateCollectionCmd Create collection testSimple3
   [junit4]   2> 43141 INFO  
(OverseerCollectionConfigSetProcessor-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 43337 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 43361 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple3_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49660/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 43365 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple3",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple3_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49660/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 43370 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple3",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"testSimple3_shard3_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49660/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 43593 INFO  (qtp1342394644-392) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple3_shard1_replica_n1&action=CREATE&numShards=3&collection=testSimple3&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 43595 INFO  (qtp1342394644-398) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple3_shard2_replica_n2&action=CREATE&numShards=3&collection=testSimple3&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 43595 INFO  (qtp1342394644-397) [    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=testSimple3_shard3_replica_n4&action=CREATE&numShards=3&collection=testSimple3&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 43713 INFO  (zkCallback-83-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple3/state.json] for collection [testSimple3] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 43713 INFO  (zkCallback-83-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple3/state.json] for collection [testSimple3] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 44348 DEBUG (ScheduledTrigger-232-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: [127.0.0.1:49659_solr, 127.0.0.1:49660_solr, 
127.0.0.1:49661_solr]
   [junit4]   2> 44639 INFO  (qtp1342394644-392) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 44641 INFO  (qtp1342394644-398) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 44658 INFO  (qtp1342394644-397) [    ] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 44665 INFO  (qtp1342394644-392) [    ] o.a.s.s.IndexSchema 
[testSimple3_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 44665 INFO  (qtp1342394644-398) [    ] o.a.s.s.IndexSchema 
[testSimple3_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 44665 INFO  (qtp1342394644-397) [    ] o.a.s.s.IndexSchema 
[testSimple3_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 44669 INFO  (qtp1342394644-398) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 44670 INFO  (qtp1342394644-398) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple3_shard2_replica_n2' using configuration from 
collection testSimple3, trusted=true
   [junit4]   2> 44670 INFO  (qtp1342394644-398) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49660.solr.core.testSimple3.shard2.replica_n2' (registry 
'solr.core.testSimple3.shard2.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 44671 INFO  (qtp1342394644-392) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 44671 INFO  (qtp1342394644-392) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple3_shard1_replica_n1' using configuration from 
collection testSimple3, trusted=true
   [junit4]   2> 44671 INFO  (qtp1342394644-392) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49660.solr.core.testSimple3.shard1.replica_n1' (registry 
'solr.core.testSimple3.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 44671 INFO  (qtp1342394644-392) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 44671 INFO  (qtp1342394644-392) [    ] o.a.s.c.SolrCore 
[[testSimple3_shard1_replica_n1] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/testSimple3_shard1_replica_n1],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/./testSimple3_shard1_replica_n1/data/]
   [junit4]   2> 44673 INFO  (qtp1342394644-397) [    ] o.a.s.s.IndexSchema 
Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 44673 INFO  (qtp1342394644-397) [    ] o.a.s.c.CoreContainer 
Creating SolrCore 'testSimple3_shard3_replica_n4' using configuration from 
collection testSimple3, trusted=true
   [junit4]   2> 44673 INFO  (qtp1342394644-398) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 44673 INFO  (qtp1342394644-398) [    ] o.a.s.c.SolrCore 
[[testSimple3_shard2_replica_n2] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/testSimple3_shard2_replica_n2],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/./testSimple3_shard2_replica_n2/data/]
   [junit4]   2> 44674 INFO  (qtp1342394644-397) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_49660.solr.core.testSimple3.shard3.replica_n4' (registry 
'solr.core.testSimple3.shard3.replica_n4') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@59926aeb
   [junit4]   2> 44674 INFO  (qtp1342394644-397) [    ] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 44675 INFO  (qtp1342394644-397) [    ] o.a.s.c.SolrCore 
[[testSimple3_shard3_replica_n4] ] Opening new SolrCore at 
[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/testSimple3_shard3_replica_n4],
 
dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001/tempDir-001/node3/./testSimple3_shard3_replica_n4/data/]
   [junit4]   2> 44756 INFO  (qtp1342394644-398) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 44756 INFO  (qtp1342394644-398) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 44757 INFO  (qtp1342394644-398) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 44757 INFO  (qtp1342394644-398) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 44758 INFO  (qtp1342394644-392) [    ] o.a.s.u.UpdateHandler 
Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 44758 INFO  (qtp1342394644-392) [    ] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 44760 INFO  (qtp1342394644-392) [    ] o.a.s.u.CommitTracker 
Hard AutoCommit: disabled
   [junit4]   2> 44760 INFO  (qtp1342394644-392) [    ] o.a.s.u.CommitTracker 
Soft AutoCommit: disabled
   [junit4]   2> 44763 INFO  (qtp1342394644-398) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@4c928a8d[testSimple3_shard2_replica_n2] main]
   [junit4]   2> 44766 INFO  (qtp1342394644-398) [    ] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 44766 INFO  (qtp1342394644-398) [    ] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 44767 INFO  (qtp1342394644-398) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 44767 INFO  (qtp1342394644-398) [    ] o.a.s.u.UpdateLog Could 
not find max version in index or recent updates, using new clock 
1582680927999361024
   [junit4]   2> 44769 INFO  (qtp1342394644-392) [    ] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2b4bfc23[testSimple3_shard1_replica_n1] main]
   [junit4]   2> 44769 INFO  (searcherExecutor-281-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple3_shard2_replica

[...truncated too long message...]

ize: [1])
   [junit4]   2> 177681 INFO  (coreCloseExecutor-334-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.testSimple1.shard1.leader, tag=517144418
   [junit4]   2> 177683 INFO  (jetty-closer-69-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 177683 INFO  (jetty-closer-69-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@216c7fed: rootName = 
solr_49660, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@6eb09069
   [junit4]   2> 177697 INFO  (jetty-closer-69-thread-1) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:49660_solr
   [junit4]   2> 177698 INFO  (jetty-closer-69-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=98917557353906185-127.0.0.1:49659_solr-n_0000000000) closing
   [junit4]   2> 177698 INFO  
(OverseerStateUpdate-98917557353906185-127.0.0.1:49659_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:49659_solr
   [junit4]   2> 177700 WARN  
(OverseerAutoScalingTriggerThread-98917557353906185-127.0.0.1:49659_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 177701 DEBUG (jetty-closer-69-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 177709 INFO  (zkCallback-100-thread-3) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 177709 INFO  (zkCallback-84-thread-6) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 177710 INFO  (zkCallback-85-thread-4) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 177710 INFO  (jetty-closer-69-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 177712 INFO  (coreCloseExecutor-337-thread-1) [    ] 
o.a.s.c.SolrCore [testSimple3_shard1_replica_n1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@3ac7316a
   [junit4]   2> 177712 INFO  (coreCloseExecutor-337-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.testSimple3.shard1.replica_n1, tag=986132842
   [junit4]   2> 177712 INFO  (coreCloseExecutor-337-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@56cb02f5: rootName = 
solr_49660, domain = solr.core.testSimple3.shard1.replica_n1, service url = 
null, agent id = null] for registry solr.core.testSimple3.shard1.replica_n1 / 
com.codahale.metrics.MetricRegistry@29fce06f
   [junit4]   2> 177721 INFO  (coreCloseExecutor-337-thread-2) [    ] 
o.a.s.c.SolrCore [testSimple1_shard1_replica_n2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@6c203516
   [junit4]   2> 177721 INFO  (coreCloseExecutor-337-thread-3) [    ] 
o.a.s.c.SolrCore [testSimple3_shard2_replica_n2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@1097e94e
   [junit4]   2> 177722 INFO  (coreCloseExecutor-337-thread-4) [    ] 
o.a.s.c.SolrCore [testSimple3_shard3_replica_n4]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@720008b2
   [junit4]   2> 177728 INFO  (zkCallback-84-thread-5) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49661_solr
   [junit4]   2> 177751 INFO  (coreCloseExecutor-337-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.testSimple1.shard1.replica_n2, tag=1814050070
   [junit4]   2> 177751 INFO  (coreCloseExecutor-337-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@14a41fab: rootName = 
solr_49660, domain = solr.core.testSimple1.shard1.replica_n2, service url = 
null, agent id = null] for registry solr.core.testSimple1.shard1.replica_n2 / 
com.codahale.metrics.MetricRegistry@162edaaf
   [junit4]   2> 177758 INFO  (jetty-closer-69-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@255419ae{/solr,null,UNAVAILABLE}
   [junit4]   2> 177760 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15f6cfe8c210008, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 177761 INFO  (coreCloseExecutor-337-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.testSimple1.shard1.leader, tag=1814050070
   [junit4]   2> 177761 INFO  (zkCallback-100-thread-3) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49660_solr
   [junit4]   2> 177761 INFO  (coreCloseExecutor-337-thread-3) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.testSimple3.shard2.replica_n2, tag=278391118
   [junit4]   2> 177761 INFO  (coreCloseExecutor-337-thread-3) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2a98ccf1: rootName = 
solr_49660, domain = solr.core.testSimple3.shard2.replica_n2, service url = 
null, agent id = null] for registry solr.core.testSimple3.shard2.replica_n2 / 
com.codahale.metrics.MetricRegistry@698c735e
   [junit4]   2> 177761 INFO  (jetty-closer-69-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3dd2d1e8{/solr,null,UNAVAILABLE}
   [junit4]   2> 177778 INFO  (coreCloseExecutor-337-thread-3) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.testSimple3.shard2.leader, tag=278391118
   [junit4]   2> 177778 INFO  (coreCloseExecutor-337-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.testSimple3.shard3.replica_n4, tag=1912604850
   [junit4]   2> 177778 INFO  (coreCloseExecutor-337-thread-4) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@12735f11: rootName = 
solr_49660, domain = solr.core.testSimple3.shard3.replica_n4, service url = 
null, agent id = null] for registry solr.core.testSimple3.shard3.replica_n4 / 
com.codahale.metrics.MetricRegistry@4d518982
   [junit4]   2> 177793 INFO  (coreCloseExecutor-337-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.testSimple3.shard3.leader, tag=1912604850
   [junit4]   2> 177793 INFO  (coreCloseExecutor-337-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.testSimple3.shard1.leader, tag=986132842
   [junit4]   2> 177812 INFO  (jetty-closer-69-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@692747ec{/solr,null,UNAVAILABLE}
   [junit4]   2> 177813 ERROR 
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 177813 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[2EDDAA7C6B11585A]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:49656 49656
   [junit4]   2> 177833 INFO  (Thread-87) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:49656 49656
   [junit4]   2> 178021 WARN  (Thread-87) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/aliases.json
   [junit4]   2>        5       /solr/clusterprops.json
   [junit4]   2>        4       /solr/security.json
   [junit4]   2>        4       /solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        49      /solr/collections/testSimple1/state.json
   [junit4]   2>        21      /solr/collections/testSimple2/state.json
   [junit4]   2>        10      /solr/collections/testSimple3/state.json
   [junit4]   2>        5       /solr/clusterstate.json
   [junit4]   2>        2       
/solr/collections/testSimple1/leader_elect/shard1/election/98917557353906185-core_node3-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/98917557353906184-127.0.0.1:49661_solr-n_0000000001
   [junit4]   2>        2       
/solr/collections/testSimple1/leader_elect/shard2/election/98917557353906185-core_node7-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/live_nodes
   [junit4]   2>        5       /solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_2EDDAA7C6B11585A-001
   [junit4]   2> Oct 30, 2017 11:18:05 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=788, maxMBSortInHeap=7.346818565801845, 
sim=RandomSimilarity(queryNorm=false): {}, locale=mn-MN, timezone=Asia/Thimphu
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 
(64-bit)/cpus=3,threads=1,free=59635256,total=202387456
   [junit4]   2> NOTE: All tests run in this JVM: [HttpSolrCallGetCoreTest, 
BaseCdcrDistributedZkTest, OverseerCollectionConfigSetProcessorTest, 
TestMaxTokenLenTokenizer, SuggestComponentTest, TemplateUpdateProcessorTest, 
AutoAddReplicasIntegrationTest]
   [junit4] Completed [18/746 (1!)] on J1 in 143.92s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 42474 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to