Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/456/

8 tests failed.
FAILED:  org.apache.solr.cloud.AliasIntegrationTest.testModifyMetadataV1

Error Message:
Error from server at https://127.0.0.1:45287/solr: Collection : collection2meta 
is part of alias testModifyMetadataV1 remove or modify the alias before 
removing this collection.

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at https://127.0.0.1:45287/solr: Collection : collection2meta is 
part of alias testModifyMetadataV1 remove or modify the alias before removing 
this collection.
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
        at 
org.apache.solr.cloud.AliasIntegrationTest.tearDown(AliasIntegrationTest.java:92)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.ShardSplitTest.test

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 
seconds
        at 
__randomizedtesting.SeedInfo.seed([C75D142C6B15175C:4F092BF6C5E97AA4]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:909)
        at 
org.apache.solr.cloud.api.collections.ShardSplitTest.splitByUniqueKeyTest(ShardSplitTest.java:658)
        at 
org.apache.solr.cloud.api.collections.ShardSplitTest.test(ShardSplitTest.java:103)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple

Error Message:
Waiting for collection testSimple1 null Live Nodes: [127.0.0.1:35699_solr, 
127.0.0.1:36359_solr] Last available state: 
DocCollection(testSimple1//collections/testSimple1/state.json/21)={   
"pullReplicas":"0",   "replicationFactor":"2",   "shards":{     "shard1":{      
 "range":"80000000-ffffffff",       "state":"active",       "replicas":{        
 "core_node3":{           "core":"testSimple1_shard1_replica_n1",           
"base_url":"http://127.0.0.1:36359/solr";,           
"node_name":"127.0.0.1:36359_solr",           "state":"active",           
"type":"NRT",           "leader":"true"},         "core_node12":{           
"core":"testSimple1_shard1_replica_n11",           
"base_url":"http://127.0.0.1:36359/solr";,           
"node_name":"127.0.0.1:36359_solr",           "state":"active",           
"type":"NRT"}}},     "shard2":{       "range":"0-7fffffff",       
"state":"active",       "replicas":{         "core_node7":{           
"core":"testSimple1_shard2_replica_n4",           
"base_url":"http://127.0.0.1:36359/solr";,           
"node_name":"127.0.0.1:36359_solr",           "state":"active",           
"type":"NRT",           "leader":"true"},         "core_node10":{           
"core":"testSimple1_shard2_replica_n9",           
"base_url":"http://127.0.0.1:39199/solr";,           
"node_name":"127.0.0.1:39199_solr",           "state":"down",           
"type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",  
 "autoAddReplicas":"true",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple1
null
Live Nodes: [127.0.0.1:35699_solr, 127.0.0.1:36359_solr]
Last available state: 
DocCollection(testSimple1//collections/testSimple1/state.json/21)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{
    "shard1":{
      "range":"80000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"testSimple1_shard1_replica_n1",
          "base_url":"http://127.0.0.1:36359/solr";,
          "node_name":"127.0.0.1:36359_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node12":{
          "core":"testSimple1_shard1_replica_n11",
          "base_url":"http://127.0.0.1:36359/solr";,
          "node_name":"127.0.0.1:36359_solr",
          "state":"active",
          "type":"NRT"}}},
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node7":{
          "core":"testSimple1_shard2_replica_n4",
          "base_url":"http://127.0.0.1:36359/solr";,
          "node_name":"127.0.0.1:36359_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node10":{
          "core":"testSimple1_shard2_replica_n9",
          "base_url":"http://127.0.0.1:39199/solr";,
          "node_name":"127.0.0.1:39199_solr",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"true",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
        at 
__randomizedtesting.SeedInfo.seed([C75D142C6B15175C:FFEE30D24CE6C38D]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
        at 
org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:103)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections

Error Message:
The operations computed by ComputePlanAction should not be 
nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], 
BEFORE_ACTION=[compute_plan, null]}

Stack Trace:
java.lang.AssertionError: The operations computed by ComputePlanAction should 
not be nullSolrClientNodeStateProvider.DEBUG{AFTER_ACTION=[compute_plan, null], 
BEFORE_ACTION=[compute_plan, null]}
        at 
__randomizedtesting.SeedInfo.seed([C75D142C6B15175C:FDF3F1F55571CE32]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testSelectedCollections(ComputePlanActionTest.java:469)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testSearchRate

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
        at 
__randomizedtesting.SeedInfo.seed([C75D142C6B15175C:9A150AA5A4D3B113]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testSearchRate(TestTriggerIntegration.java:1179)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:10014_solr should have been deleted

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:10014_solr 
should have been deleted
        at 
__randomizedtesting.SeedInfo.seed([C75D142C6B15175C:DFE79C206520DAB3]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertFalse(Assert.java:68)
        at 
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testNodeMarkersRegistration(TestTriggerIntegration.java:844)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.hdfs.StressHdfsTest.test

Error Message:
Error from server at http://127.0.0.1:36747/ect: Could not fully remove 
collection: delete_data_dir

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:36747/ect: Could not fully remove collection: 
delete_data_dir
        at 
__randomizedtesting.SeedInfo.seed([C75D142C6B15175C:4F092BF6C5E97AA4]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:223)
        at 
org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:105)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testDistributions

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([CDD4F9781892E6A3:722BB8D2C668063F]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testDistributions(StreamExpressionTest.java:6639)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12550 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
   [junit4]   2> 1196464 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/init-core-data-001
   [junit4]   2> 1196465 WARN  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1196465 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1196481 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1196498 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001
   [junit4]   2> 1196498 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1196506 INFO  (Thread-1292) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1196506 INFO  (Thread-1292) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1196520 ERROR (Thread-1292) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1196606 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:34252
   [junit4]   2> 1196622 INFO  (zkConnectionManagerCallback-1338-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196634 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1196634 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1196634 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T03:27:37+06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1196635 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@276721cb{/solr,null,AVAILABLE}
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@50104929{/solr,null,AVAILABLE}
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@1c0c39fe{HTTP/1.1,[http/1.1]}{127.0.0.1:39199}
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.e.j.s.Server Started @1199774ms
   [junit4]   2> 1196636 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39199}
   [junit4]   2> 1196637 ERROR (jetty-launcher-1335-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1196644 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@5d63966b{HTTP/1.1,[http/1.1]}{127.0.0.1:36359}
   [junit4]   2> 1196644 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.e.j.s.Server Started @1199782ms
   [junit4]   2> 1196644 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36359}
   [junit4]   2> 1196645 ERROR (jetty-launcher-1335-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1196645 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@38d479a{/solr,null,AVAILABLE}
   [junit4]   2> 1196645 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@544fac39{HTTP/1.1,[http/1.1]}{127.0.0.1:35699}
   [junit4]   2> 1196645 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.e.j.s.Server Started @1199783ms
   [junit4]   2> 1196645 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=35699}
   [junit4]   2> 1196646 ERROR (jetty-launcher-1335-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1196646 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1196646 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1196646 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1196646 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-25T19:50:24.732Z
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-25T19:50:24.733Z
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1196647 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-25T19:50:24.733Z
   [junit4]   2> 1196693 INFO  (zkConnectionManagerCallback-1342-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196694 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1196694 INFO  (zkConnectionManagerCallback-1340-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196695 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1196743 INFO  (jetty-launcher-1335-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34252/solr
   [junit4]   2> 1196795 INFO  (zkConnectionManagerCallback-1344-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196802 INFO  (jetty-launcher-1335-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34252/solr
   [junit4]   2> 1196803 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1196848 INFO  (zkConnectionManagerCallback-1349-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196876 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x10072c6b6c60004, likely client has closed socket
   [junit4]   2> 1196897 INFO  (zkConnectionManagerCallback-1352-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196898 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x10072c6b6c60005, likely client has closed socket
   [junit4]   2> 1196899 INFO  
(zkConnectionManagerCallback-1354-thread-1-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1196913 INFO  (jetty-launcher-1335-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34252/solr
   [junit4]   2> 1197000 INFO  (zkConnectionManagerCallback-1360-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1197001 INFO  
(zkConnectionManagerCallback-1356-thread-1-processing-n:127.0.0.1:39199_solr) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1197083 INFO  
(zkConnectionManagerCallback-1363-thread-1-processing-n:127.0.0.1:35699_solr) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1198159 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1198192 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:39199_solr
   [junit4]   2> 1198193 INFO  (jetty-launcher-1335-thread-1) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1198194 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.Overseer Overseer 
(id=72183791833448455-127.0.0.1:39199_solr-n_0000000000) starting
   [junit4]   2> 1198194 INFO  (jetty-launcher-1335-thread-1) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36359_solr
   [junit4]   2> 1198251 INFO  
(zkCallback-1355-thread-1-processing-n:127.0.0.1:39199_solr) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1198252 INFO  
(zkCallback-1353-thread-1-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1198271 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1198272 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1198282 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:35699_solr
   [junit4]   2> 1198299 INFO  
(OverseerStateUpdate-72183791833448455-127.0.0.1:39199_solr-n_0000000000) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1198299 INFO  
(zkCallback-1353-thread-1-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1198299 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 1198372 INFO  
(zkCallback-1362-thread-1-processing-n:127.0.0.1:35699_solr) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1198372 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 1
   [junit4]   2> 1198373 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:35699_solr, 127.0.0.1:36359_solr]
   [junit4]   2> 1198373 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 1198373 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 1
   [junit4]   2> 1198400 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 1198428 DEBUG 
(OverseerAutoScalingTriggerThread-72183791833448455-127.0.0.1:39199_solr-n_0000000000)
 [n:127.0.0.1:39199_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1198429 DEBUG (ScheduledTrigger-2120-thread-1) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1198457 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39199_solr
   [junit4]   2> 1198458 INFO  
(zkCallback-1362-thread-1-processing-n:127.0.0.1:35699_solr) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1198458 INFO  
(zkCallback-1353-thread-1-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1198459 INFO  
(zkCallback-1355-thread-1-processing-n:127.0.0.1:39199_solr) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1198569 INFO  (jetty-launcher-1335-thread-1) 
[n:127.0.0.1:36359_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36359.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198573 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35699.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198641 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35699.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198660 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35699.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198661 INFO  (jetty-launcher-1335-thread-1) 
[n:127.0.0.1:36359_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36359.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198661 INFO  (jetty-launcher-1335-thread-1) 
[n:127.0.0.1:36359_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36359.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198661 INFO  (jetty-launcher-1335-thread-2) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node2/.
   [junit4]   2> 1198662 INFO  (jetty-launcher-1335-thread-1) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node1/.
   [junit4]   2> 1198734 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39199.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198762 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39199.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198762 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39199.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1198763 INFO  (jetty-launcher-1335-thread-3) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node3/.
   [junit4]   2> 1198871 INFO  (zkConnectionManagerCallback-1370-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1198874 INFO  (zkConnectionManagerCallback-1374-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1198875 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1198876 INFO  
(SUITE-AutoAddReplicasIntegrationTest-seed#[C75D142C6B15175C]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34252/solr ready
   [junit4]   2> 1198935 INFO  
(TEST-AutoAddReplicasIntegrationTest.testSimple-seed#[C75D142C6B15175C]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testSimple
   [junit4]   2> 1198952 INFO  (qtp416880921-5526) [n:127.0.0.1:39199_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:35699_solr,127.0.0.1:36359_solr&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1198953 INFO  
(OverseerThreadFactory-2122-thread-1-processing-n:127.0.0.1:39199_solr) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
testSimple1
   [junit4]   2> 1199072 INFO  
(OverseerStateUpdate-72183791833448455-127.0.0.1:39199_solr-n_0000000000) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36359/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1199074 INFO  
(OverseerStateUpdate-72183791833448455-127.0.0.1:39199_solr-n_0000000000) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testSimple1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35699/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1199076 INFO  
(OverseerStateUpdate-72183791833448455-127.0.0.1:39199_solr-n_0000000000) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36359/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1199078 INFO  
(OverseerStateUpdate-72183791833448455-127.0.0.1:39199_solr-n_0000000000) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testSimple1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testSimple1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35699/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1199442 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1199442 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 1199458 DEBUG (ScheduledTrigger-2120-thread-1) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 1199469 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1199469 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 1199550 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1199552 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1199741 INFO  
(zkCallback-1362-thread-1-processing-n:127.0.0.1:35699_solr) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1199741 INFO  
(zkCallback-1353-thread-1-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1199741 INFO  
(zkCallback-1353-thread-2-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1199741 INFO  
(zkCallback-1353-thread-3-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1200469 DEBUG (ScheduledTrigger-2120-thread-2) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 1200638 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1200730 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 1200745 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1200745 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using 
configuration from collection testSimple1, trusted=true
   [junit4]   2> 1200746 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35699.solr.core.testSimple1.shard2.replica_n6' (registry 
'solr.core.testSimple1.shard2.replica_n6') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1200746 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1200746 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node2/testSimple1_shard2_replica_n6],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node2/./testSimple1_shard2_replica_n6/data/]
   [junit4]   2> 1200828 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1200891 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1200901 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1200922 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 1200929 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 1200931 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1200931 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using 
configuration from collection testSimple1, trusted=true
   [junit4]   2> 1200937 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1200937 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using 
configuration from collection testSimple1, trusted=true
   [junit4]   2> 1200937 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1200938 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36359.solr.core.testSimple1.shard2.replica_n4' (registry 
'solr.core.testSimple1.shard2.replica_n4') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1200938 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1200938 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node1/testSimple1_shard2_replica_n4],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node1/./testSimple1_shard2_replica_n4/data/]
   [junit4]   2> 1200953 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1200953 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using 
configuration from collection testSimple1, trusted=true
   [junit4]   2> 1200953 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36359.solr.core.testSimple1.shard1.replica_n1' (registry 
'solr.core.testSimple1.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1200954 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1200954 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node1/testSimple1_shard1_replica_n1],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node1/./testSimple1_shard1_replica_n1/data/]
   [junit4]   2> 1200972 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35699.solr.core.testSimple1.shard1.replica_n2' (registry 
'solr.core.testSimple1.shard1.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5303cdd0
   [junit4]   2> 1200972 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1200973 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node2/testSimple1_shard1_replica_n2],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_C75D142C6B15175C-001/tempDir-001/node2/./testSimple1_shard1_replica_n2/data/]
   [junit4]   2> 1201216 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1201216 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201217 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201217 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201236 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7f568e50[testSimple1_shard2_replica_n6] main]
   [junit4]   2> 1201237 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1201238 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201238 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1201238 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1593403747151642624
   [junit4]   2> 1201261 INFO  
(searcherExecutor-2129-thread-1-processing-n:127.0.0.1:35699_solr 
x:testSimple1_shard2_replica_n6 s:shard2 c:testSimple1 r:core_node8) 
[n:127.0.0.1:35699_solr c:testSimple1 s:shard2 r:core_node8 
x:testSimple1_shard2_replica_n6] o.a.s.c.SolrCore 
[testSimple1_shard2_replica_n6] Registered new searcher 
Searcher@7f568e50[testSimple1_shard2_replica_n6] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1201291 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1201382 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1201382 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201383 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201383 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201385 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7fae5ba5[testSimple1_shard1_replica_n1] main]
   [junit4]   2> 1201398 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1201398 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201399 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1201399 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1593403747320463360
   [junit4]   2> 1201417 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1201471 INFO  
(searcherExecutor-2132-thread-1-processing-n:127.0.0.1:36359_solr 
x:testSimple1_shard1_replica_n1 s:shard1 c:testSimple1 r:core_node3) 
[n:127.0.0.1:36359_solr c:testSimple1 s:shard1 r:core_node3 
x:testSimple1_shard1_replica_n1] o.a.s.c.SolrCore 
[testSimple1_shard1_replica_n1] Registered new searcher 
Searcher@7fae5ba5[testSimple1_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1201475 DEBUG (ScheduledTrigger-2120-thread-1) 
[n:127.0.0.1:39199_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 1201498 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1201498 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201499 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201499 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201513 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@7e8ccf0a[testSimple1_shard1_replica_n2] main]
   [junit4]   2> 1201514 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1201514 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201515 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1201532 INFO  
(searcherExecutor-2130-thread-1-processing-n:127.0.0.1:35699_solr 
x:testSimple1_shard1_replica_n2 s:shard1 c:testSimple1 r:core_node5) 
[n:127.0.0.1:35699_solr c:testSimple1 s:shard1 r:core_node5 
x:testSimple1_shard1_replica_n2] o.a.s.c.SolrCore 
[testSimple1_shard1_replica_n2] Registered new searcher 
Searcher@7e8ccf0a[testSimple1_shard1_replica_n2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1201532 INFO  (qtp931109749-5532) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1593403747459923968
   [junit4]   2> 1201549 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1201549 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201550 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201551 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201565 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@6316916d[testSimple1_shard2_replica_n4] main]
   [junit4]   2> 1201565 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf
   [junit4]   2> 1201566 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201566 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1201567 INFO  
(searcherExecutor-2131-thread-1-processing-n:127.0.0.1:36359_solr 
x:testSimple1_shard2_replica_n4 s:shard2 c:testSimple1 r:core_node7) 
[n:127.0.0.1:36359_solr c:testSimple1 s:shard2 r:core_node7 
x:testSimple1_shard2_replica_n4] o.a.s.c.SolrCore 
[testSimple1_shard2_replica_n4] Registered new searcher 
Searcher@6316916d[testSimple1_shard2_replica_n4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1201567 INFO  (qtp958120514-5529) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1593403747496624128
   [junit4]   2> 1201581 INFO  
(zkCallback-1353-thread-2-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1201581 INFO  
(zkCallback-1353-thread-1-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1201583 INFO  
(zkCallback-1362-thread-1-processing-n:127.0.0.1:35699_solr) 
[n:127.0.0.1:35699_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1201596 INFO  
(zkCallback-1353-thread-3-processing-n:127.0.0.1:36359_solr) 
[n:127.0.0.1:36359_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testSimple1/state.json] for collection [testSimple1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 1201792 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1201792 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1201792 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:35699/solr/testSimple1_shard2_replica_n6/
   [junit4]   2> 1201792 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n6 
url=http://127.0.0.1:35699/solr START 
replicas=[http://127.0.0.1:36359/solr/testSimple1_shard2_replica_n4/] 
nUpdates=100
   [junit4]   2> 1201804 INFO  (qtp958120514-5544) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] 
o.a.s.c.S.Request [testSimple1_shard2_replica_n4]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=9
   [junit4]   2> 1201925 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1201925 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1201925 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:36359/solr/testSimple1_shard1_replica_n1/
   [junit4]   2> 1201926 INFO  (qtp958120514-5525) [n:127.0.0.1:36359_solr 
c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] 
o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 
url=http://127.0.0.1:36359/solr START 
replicas=[http://127.0.0.1:35699/solr/testSimple1_shard1_replica_n2/] 
nUpdates=100
   [junit4]   2> 1201961 INFO  (qtp931109749-5546) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard1 r:core_node5 x:testSimple1_shard1_replica_n2] 
o.a.s.c.S.Request [testSimple1_shard1_replica_n2]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 1202093 INFO  (qtp931109749-5538) [n:127.0.0.1:35699_solr 
c:testSimple1 s:shard2 r:core_node8 x:testSimple1_shard2_replica_n6] 
o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n6 
url=http://127.0.0.1:35699/solr DONE.  We have no versions.  sync failed.
 

[...truncated too long message...]

:43568_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [0])
   [junit4]   2> 415643 WARN  
(zkCallback-1222-thread-1-processing-n:127.0.0.1:38746_solr) 
[n:127.0.0.1:38746_solr    ] o.a.s.c.ZkController Unable to register nodeLost 
path for 127.0.0.1:38746_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:38746_solr
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:365)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:365)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:885)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:724)
   [junit4]   2>        at 
java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:723)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1105)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 415646 INFO  (jetty-closer-1190-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@49a5f808{/solr,null,UNAVAILABLE}
   [junit4]   2> 415647 INFO  (jetty-closer-1190-thread-3) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 415718 WARN  
(zkCallback-2915-thread-1-processing-n:127.0.0.1:43568_solr 
x:collection1_shard2_replica_n3 s:shard2 c:collection1 r:core_node4) 
[n:127.0.0.1:43568_solr c:collection1 s:shard2 r:core_node4 
x:collection1_shard2_replica_n3] o.a.s.c.c.ZkStateReader ZooKeeper watch 
triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for 
/live_nodes]
   [junit4]   2> 415720 INFO  (jetty-closer-1190-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72184067749838854-127.0.0.1:38182_solr-n_0000000000) closing
   [junit4]   2> 415720 INFO  
(OverseerStateUpdate-72184067749838854-127.0.0.1:38182_solr-n_0000000000) 
[n:127.0.0.1:38182_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:38182_solr
   [junit4]   2> 415734 WARN  
(OverseerAutoScalingTriggerThread-72184067749838854-127.0.0.1:38182_solr-n_0000000000)
 [n:127.0.0.1:38182_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 415735 INFO  (jetty-closer-1190-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@d9f50a3{/solr,null,UNAVAILABLE}
   [junit4]   2> 415736 INFO  (jetty-closer-1190-thread-2) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 415737 INFO  (jetty-closer-1190-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@16f2294b{/solr,null,UNAVAILABLE}
   [junit4]   2> 415770 INFO  (jetty-closer-1190-thread-1) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 415771 ERROR 
(SUITE-StreamExpressionTest-seed#[CDD4F9781892E6A3]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 415771 INFO  
(SUITE-StreamExpressionTest-seed#[CDD4F9781892E6A3]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:46875 46875
   [junit4]   2> 415838 INFO  (Thread-142) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:46875 46875
   [junit4]   2> 415840 WARN  (Thread-142) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        99      /solr/aliases.json
   [junit4]   2>        99      /solr/clusterprops.json
   [junit4]   2>        15      /solr/configs/conf
   [junit4]   2>        8       /solr/configs/ml
   [junit4]   2>        8       
/solr/collections/destinationCollection/terms/shard2
   [junit4]   2>        8       
/solr/collections/destinationCollection/terms/shard1
   [junit4]   2>        7       
/solr/collections/parallelDestinationCollection1/terms/shard2
   [junit4]   2>        6       
/solr/collections/parallelDestinationCollection1/terms/shard1
   [junit4]   2>        5       
/solr/collections/parallelDestinationCollection/terms/shard2
   [junit4]   2>        4       /solr/security.json
   [junit4]   2>        4       
/solr/collections/parallelDestinationCollection/terms/shard1
   [junit4]   2>        3       /solr/collections/workQueue1/terms/shard1
   [junit4]   2>        3       /solr/collections/destination1/terms/shard1
   [junit4]   2>        3       /solr/collections/destination1/terms/shard2
   [junit4]   2>        3       /solr/collections/mainCorpus1/terms/shard1
   [junit4]   2>        3       /solr/collections/modelCollection/terms/shard1
   [junit4]   2>        3       
/solr/collections/checkpointCollection/terms/shard2
   [junit4]   2>        3       /solr/collections/mainCorpus/terms/shard2
   [junit4]   2>        3       /solr/collections/mainCorpus/terms/shard1
   [junit4]   2>        2       /solr/collections/workQueue1/terms/shard2
   [junit4]   2>        2       /solr/collections/mainCorpus1/terms/shard2
   [junit4]   2>        2       /solr/collections/modelCollection/terms/shard2
   [junit4]   2>        2       /solr/collections/destination/terms/shard2
   [junit4]   2>        2       /solr/collections/destination/terms/shard1
   [junit4]   2>        2       
/solr/collections/checkpointCollection/terms/shard1
   [junit4]   2>        2       /solr/collections/collection1/terms/shard1
   [junit4]   2>        2       /solr/collections/collection1/terms/shard2
   [junit4]   2>        2       /solr/collections/uknownCollection/terms/shard2
   [junit4]   2>        2       /solr/collections/uknownCollection/terms/shard1
   [junit4]   2>        2       /solr/collections/workQueue/terms/shard2
   [junit4]   2>        2       /solr/collections/workQueue/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        99      /solr/clusterstate.json
   [junit4]   2>        40      
/solr/collections/destinationCollection/state.json
   [junit4]   2>        30      
/solr/collections/parallelDestinationCollection1/state.json
   [junit4]   2>        20      
/solr/collections/parallelDestinationCollection/state.json
   [junit4]   2>        14      /solr/collections/collection1/state.json
   [junit4]   2>        10      /solr/collections/mainCorpus1/state.json
   [junit4]   2>        10      /solr/collections/destination/state.json
   [junit4]   2>        10      /solr/collections/destination1/state.json
   [junit4]   2>        10      /solr/collections/workQueue1/state.json
   [junit4]   2>        10      /solr/collections/workQueue/state.json
   [junit4]   2>        10      /solr/collections/uknownCollection/state.json
   [junit4]   2>        10      /solr/collections/modelCollection/state.json
   [junit4]   2>        10      
/solr/collections/checkpointCollection/state.json
   [junit4]   2>        10      /solr/collections/mainCorpus/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/72184067749838858-127.0.0.1:43568_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        99      /solr/live_nodes
   [junit4]   2>        99      /solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.stream.StreamExpressionTest_CDD4F9781892E6A3-001
   [junit4]   2> Feb 25, 2018 9:03:40 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene70, 
sim=RandomSimilarity(queryNorm=true): {}, locale=bg, timezone=America/Yakutat
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 
1.8.0_152 (64-bit)/cpus=4,threads=1,free=38513736,total=419954688
   [junit4]   2> NOTE: All tests run in this JVM: [TestEmbeddedSolrServer, 
TestSpellCheckResponse, JdbcTest, ConcurrentUpdateSolrClientBuilderTest, 
HyperbolicTangentEvaluatorTest, GreaterThanEvaluatorTest, ArcSineEvaluatorTest, 
TestClusteringResponse, AndEvaluatorTest, TestPathTrie, TestPolicy, 
CloudSolrClientCacheTest, TestConfigSetAdminRequest, StreamingTest, 
ReverseEvaluatorTest, EmpiricalDistributionEvaluatorTest, GraphExpressionTest, 
FieldAnalysisResponseTest, TestXMLEscaping, RawValueEvaluatorTest, 
TermsResponseTest, NaturalLogEvaluatorTest, SolrExampleStreamingTest, 
SolrExampleEmbeddedTest, TestNamedListCodec, TestJavaBinCodec, 
TestDocumentObjectBinder, SolrQueryTest, ModifiableSolrParamsTest, 
SolrDocumentTest, NamedListTest, UsingSolrJRefGuideExamplesTest, 
CloudSolrClientMultiConstructorTest, HttpSolrClientConPoolTest, GraphTest, 
StreamExpressionTest]
   [junit4] Completed [146/146 (1!)] on J0 in 186.63s, 155 tests, 1 failure <<< 
FAILURES!

[...truncated 47570 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to