Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/335/

5 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain

Error Message:
Could not load collection from ZK: 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection
        at __randomizedtesting.SeedInfo.seed([39B3207A8764B2DF]:0)
        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1108)
        at 
org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:647)
        at 
org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:137)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
        at 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain.waitForRecoveriesToFinish(TestCloudJSONFacetJoinDomain.java:806)
        at 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain.createMiniSolrCloudCluster(TestCloudJSONFacetJoinDomain.java:119)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for 
/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:339)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:339)
        at 
org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1120)
        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1106)
        ... 29 more


FAILED:  org.apache.solr.cloud.TestUtilizeNode.test

Error Message:
no replica should be present in  127.0.0.1:44718_solr

Stack Trace:
java.lang.AssertionError: no replica should be present in  127.0.0.1:44718_solr
        at 
__randomizedtesting.SeedInfo.seed([39B3207A8764B2DF:B1E71FA02998DF27]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.apache.solr.cloud.TestUtilizeNode.test(TestUtilizeNode.java:99)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testCooldown

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([39B3207A8764B2DF:80D4D9EF9CEC72D]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testCooldown(TriggerIntegrationTest.java:1177)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<5> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<0>
        at 
__randomizedtesting.SeedInfo.seed([39B3207A8764B2DF:544F84873D2C4DD8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:241)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([39B3207A8764B2DF:83BF17F5D88C6490]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.junit.Assert.assertNull(Assert.java:562)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12129 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCloudJSONFacetJoinDomain
   [junit4]   2> Creating dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestCloudJSONFacetJoinDomain_39B3207A8764B2DF-001/init-core-data-001
   [junit4]   2> 1015031 WARN  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1015031 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1015032 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1015033 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1015046 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestCloudJSONFacetJoinDomain_39B3207A8764B2DF-001/tempDir-001
   [junit4]   2> 1015046 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1015047 INFO  (Thread-1358) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1015047 INFO  (Thread-1358) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1015087 ERROR (Thread-1358) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1015151 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:45533
   [junit4]   2> 1015179 INFO  (zkConnectionManagerCallback-911-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1015235 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1015235 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1015235 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1015235 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1015235 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@537896fc{/solr,null,AVAILABLE}
   [junit4]   2> 1015305 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@413bd421{SSL,[ssl, 
http/1.1]}{127.0.0.1:37564}
   [junit4]   2> 1015305 INFO  (jetty-launcher-908-thread-1) [    ] 
o.e.j.s.Server Started @1025711ms
   [junit4]   2> 1015305 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37564}
   [junit4]   2> 1015306 ERROR (jetty-launcher-908-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1015306 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 1015306 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1015306 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1015306 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-27T00:09:06.467Z
   [junit4]   2> 1015338 INFO  (zkConnectionManagerCallback-913-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1015351 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1015395 INFO  (jetty-launcher-908-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45533/solr
   [junit4]   2> 1015398 INFO  (zkConnectionManagerCallback-917-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1015409 INFO  
(zkConnectionManagerCallback-919-thread-1-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1015877 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1015878 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:37564_solr
   [junit4]   2> 1015949 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.Overseer Overseer 
(id=99418881802043395-127.0.0.1:37564_solr-n_0000000000) starting
   [junit4]   2> 1016140 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37564_solr
   [junit4]   2> 1016143 INFO  
(zkCallback-918-thread-1-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1016510 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37564.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@160ce943
   [junit4]   2> 1016545 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37564.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@160ce943
   [junit4]   2> 1016545 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37564.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@160ce943
   [junit4]   2> 1016546 INFO  (jetty-launcher-908-thread-1) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestCloudJSONFacetJoinDomain_39B3207A8764B2DF-001/tempDir-001/node1/.
   [junit4]   2> 1016587 INFO  (zkConnectionManagerCallback-923-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1016602 INFO  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1016603 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1016603 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45533/solr ready
   [junit4]   2> 1017701 INFO  (qtp1409660235-5526) [n:127.0.0.1:37564_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=1&property.config=solrconfig-tlog.xml&property.schema=schema_latest.xml&collection.configName=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_config-set&name=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1017720 INFO  
(OverseerThreadFactory-2745-thread-1-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection
   [junit4]   2> 1017892 INFO  
(OverseerStateUpdate-99418881802043395-127.0.0.1:37564_solr-n_0000000000) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   
"collection":"org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   
"core":"org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37564/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1018181 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_config-set&newCollection=true&collection=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection&version=2&replicaType=NRT&property.config=solrconfig-tlog.xml&property.schema=schema_latest.xml&coreNodeName=core_node2&name=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 1018181 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1018558 INFO  
(zkCallback-918-thread-1-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json]
 for collection [org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection] 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1018559 INFO  
(zkCallback-918-thread-2-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json]
 for collection [org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection] 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1019512 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1019622 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.s.IndexSchema 
[org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 Schema name=example
   [junit4]   2> 1020019 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.s.IndexSchema Loaded schema example/1.6 with uniqueid field id
   [junit4]   2> 1020089 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.CoreContainer Creating SolrCore 
'org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1'
 using configuration from collection 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection, trusted=true
   [junit4]   2> 1020103 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37564.solr.core.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection.shard1.replica_n1'
 (registry 
'solr.core.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection.shard1.replica_n1')
 enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@160ce943
   [junit4]   2> 1020103 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1020103 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SolrCore 
[[org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestCloudJSONFacetJoinDomain_39B3207A8764B2DF-001/tempDir-001/node1/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestCloudJSONFacetJoinDomain_39B3207A8764B2DF-001/tempDir-001/node1/./org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1/data/]
   [junit4]   2> 1020106 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 1020140 WARN  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 1020427 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1020427 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1020428 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1020428 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1020446 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.700460739531595]
   [junit4]   2> 1020447 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.s.SolrIndexSearcher Opening 
[Searcher@4941609d[org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 main]
   [junit4]   2> 1020519 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_config-set
   [junit4]   2> 1020556 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_config-set
   [junit4]   2> 1020556 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1020557 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1590702114569453568
   [junit4]   2> 1020559 INFO  
(searcherExecutor-2748-thread-1-processing-n:127.0.0.1:37564_solr 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1
 s:shard1 c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection 
r:core_node2) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SolrCore 
[org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 Registered new searcher 
Searcher@4941609d[org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1020610 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1020610 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1020610 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:37564/solr/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1/
   [junit4]   2> 1020610 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1020610 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SyncStrategy 
https://127.0.0.1:37564/solr/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1/
 has no replicas
   [junit4]   2> 1020610 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 1020612 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:37564/solr/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1/
 shard1
   [junit4]   2> 1020718 INFO  
(zkCallback-918-thread-2-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json]
 for collection [org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection] 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1020718 INFO  
(zkCallback-918-thread-1-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json]
 for collection [org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection] 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1020750 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1020803 INFO  (qtp1409660235-5522) [n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_config-set&newCollection=true&collection=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection&version=2&replicaType=NRT&property.config=solrconfig-tlog.xml&property.schema=schema_latest.xml&coreNodeName=core_node2&name=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin}
 status=0 QTime=2622
   [junit4]   2> 1027985 WARN  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker-SendThread(127.0.0.1:45533))
 [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server 
in 10206ms for sessionid 0x16134f23dc70005
   [junit4]   2> 1028048 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x16134f23dc70005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1028095 INFO  
(zkCallback-918-thread-2-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json]
 for collection [org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection] 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1028095 INFO  
(zkCallback-918-thread-1-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json]
 for collection [org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection] 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1028099 INFO  (qtp1409660235-5526) [n:127.0.0.1:37564_solr    
] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 
30 seconds. Check all shard replicas
   [junit4]   2> 1028167 WARN  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@13fb4590 name: 
ZooKeeperConnection Watcher:127.0.0.1:45533/solr got event WatchedEvent 
state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 1028167 WARN  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 1029107 INFO  (qtp1409660235-5526) [n:127.0.0.1:37564_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={replicationFactor=1&property.config=solrconfig-tlog.xml&property.schema=schema_latest.xml&collection.configName=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_config-set&name=org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=11405
   [junit4]   2> 1029107 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection 
failOnTimeout:true timeout (sec):330
   [junit4]   1> -
   [junit4]   2> 1029415 WARN  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker-SendThread(127.0.0.1:45533))
 [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 
0x16134f23dc70005 has expired
   [junit4]   2> 1029427 WARN  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@13fb4590 name: 
ZooKeeperConnection Watcher:127.0.0.1:45533/solr got event WatchedEvent 
state:Expired type:None path:null path: null type: None
   [junit4]   2> 1029427 WARN  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. 
Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 1029427 WARN  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 1029460 INFO  
(zkConnectionManagerCallback-927-thread-1-EventThread) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1029460 INFO  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 1029462 INFO  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 1029462 INFO  (zkConnectionManagerCallback-927-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient Connected:true
   [junit4]   2> 1029569 INFO  (jetty-closer-909-thread-1) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@413bd421{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1029569 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1673904333
   [junit4]   2> 1029621 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 1029622 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@298db0f: rootName = 
solr_37564, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@77d1b85c
   [junit4]   2> 1029637 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 1029638 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@a26f85b: rootName = 
solr_37564, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@1c579c46
   [junit4]   2> 1029640 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 1029640 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4998a6ed: rootName = 
solr_37564, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@18680b14
   [junit4]   2> 1029642 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37564_solr
   [junit4]   2> 1029643 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1029643 INFO  
(zkCallback-918-thread-2-processing-n:127.0.0.1:37564_solr) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (0)
   [junit4]   2> 1029666 INFO  (coreCloseExecutor-2753-thread-1) 
[n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.c.SolrCore 
[org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
  CLOSING SolrCore org.apache.solr.core.SolrCore@ce14d2f
   [junit4]   2> 1029666 INFO  (coreCloseExecutor-2753-thread-1) 
[n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection.shard1.replica_n1,
 tag=216091951
   [junit4]   2> 1029666 INFO  (coreCloseExecutor-2753-thread-1) 
[n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@69fb10a7: rootName = 
solr_37564, domain = 
solr.core.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection.shard1.replica_n1,
 service url = null, agent id = null] for registry 
solr.core.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection.shard1.replica_n1
 / com.codahale.metrics.MetricRegistry@11aa05a0
   [junit4]   2> 1029672 INFO  (coreCloseExecutor-2753-thread-1) 
[n:127.0.0.1:37564_solr 
c:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection s:shard1 
r:core_node2 
x:org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection_shard1_replica_n1]
 o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection.shard1.leader,
 tag=216091951
   [junit4]   2> 1029695 INFO  (jetty-closer-909-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=99418881802043395-127.0.0.1:37564_solr-n_0000000000) closing
   [junit4]   2> 1029695 WARN  
(OverseerAutoScalingTriggerThread-99418881802043395-127.0.0.1:37564_solr-n_0000000000)
 [n:127.0.0.1:37564_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1029698 INFO  
(OverseerStateUpdate-99418881802043395-127.0.0.1:37564_solr-n_0000000000) 
[n:127.0.0.1:37564_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:37564_solr
   [junit4]   2> 1029759 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x16134f23dc70003, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1029763 INFO  (jetty-closer-909-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@537896fc{/solr,null,UNAVAILABLE}
   [junit4]   2> 1029763 INFO  (jetty-closer-909-thread-1) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 1029833 ERROR 
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1029848 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:45533 45533
   [junit4]   2> 1029954 INFO  (Thread-1358) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:45533 45533
   [junit4]   2> 1029955 WARN  (Thread-1358) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       
/solr/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2>        3       /solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2>        3       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1029955 INFO  
(SUITE-TestCloudJSONFacetJoinDomain-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ------------------------------------------------------- 
Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=1523, maxMBSortInHeap=6.7920742367185865, 
sim=RandomSimilarity(queryNorm=false): {}, locale=zh-HK, 
timezone=America/Matamoros
   [junit4]   2> NOTE: Linux 4.4.0-104-generic amd64/Oracle Corporation 
1.8.0_152 (64-bit)/cpus=4,threads=1,free=270459600,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [SystemInfoHandlerTest, 
DistributedExpandComponentTest, TestPushWriter, TestReplicationHandler, 
TestExactStatsCache, QueryElevationComponentTest, 
TestSweetSpotSimilarityFactory, LeaderElectionContextKeyTest, 
TestCollapseQParserPlugin, HighlighterTest, TestRecovery, ConfigSetsAPITest, 
TestDynamicFieldResource, TestManagedSchemaThreadSafety, 
TlogReplayBufferedWhileIndexingTest, DirectUpdateHandlerOptimizeTest, 
BigEndianAscendingWordSerializerTest, AlternateDirectoryTest, 
MigrateRouteKeyTest, OverseerCollectionConfigSetProcessorTest, 
ShardRoutingCustomTest, TestDefaultStatsCache, TestBulkSchemaAPI, 
TestRestoreCore, TestSimpleQParserPlugin, DeleteStatusTest, ShardSplitTest, 
TestLeaderElectionZkExpiry, TestRetrieveFieldsOptimizer, SortByFunctionTest, 
SecurityConfHandlerTest, SolrSlf4jReporterTest, CdcrVersionReplicationTest, 
TestSearchPerf, TestCloudJSONFacetJoinDomain]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestCloudJSONFacetJoinDomain -Dtests.seed=39B3207A8764B2DF 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=zh-HK 
-Dtests.timezone=America/Matamoros -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestCloudJSONFacetJoinDomain (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not 
load collection from ZK: 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([39B3207A8764B2DF]:0)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1108)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:647)
   [junit4]    >        at 
org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:137)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
   [junit4]    >        at 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain.waitForRecoveriesToFinish(TestCloudJSONFacetJoinDomain.java:806)
   [junit4]    >        at 
org.apache.solr.cloud.TestCloudJSONFacetJoinDomain.createMiniSolrCloudCluster(TestCloudJSONFacetJoinDomain.java:119)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for 
/collections/org.apache.solr.cloud.TestCloudJSONFacetJoinDomain_collection/state.json
   [junit4]    >        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]    >        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    >        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:339)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:339)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1120)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1106)
   [junit4]    >        ... 29 more
   [junit4] Completed [137/769 (1!)] on J1 in 15.00s, 0 tests, 1 error <<< 
FAILURES!

[...truncated 1350 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestUtilizeNode
   [junit4]   2> Creating dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestUtilizeNode_39B3207A8764B2DF-001/init-core-data-001
   [junit4]   2> 3349365 WARN  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1213 numCloses=1213
   [junit4]   2> 3349365 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 3349366 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 3349366 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 3349379 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestUtilizeNode_39B3207A8764B2DF-001/tempDir-001
   [junit4]   2> 3349379 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3349387 INFO  (Thread-4198) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3349387 INFO  (Thread-4198) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 3349428 ERROR (Thread-4198) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3349493 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:42184
   [junit4]   2> 3349500 INFO  (zkConnectionManagerCallback-6584-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3349570 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T02:27:37+05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3349572 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T02:27:37+05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3349573 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T02:27:37+05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3349590 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T02:27:37+05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3349591 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3349591 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3349591 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3349591 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@64773885{/solr,null,AVAILABLE}
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@13f202bf{SSL,[ssl, 
http/1.1]}{127.0.0.1:44470}
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.e.j.s.Server Started @3360070ms
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44470}
   [junit4]   2> 3349592 ERROR (jetty-launcher-6581-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3349592 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-27T00:48:00.835Z
   [junit4]   2> 3349606 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3349606 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3349606 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 3349607 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3349607 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3349607 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3349608 INFO  (zkConnectionManagerCallback-6586-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3349609 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3349672 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1457943d{/solr,null,AVAILABLE}
   [junit4]   2> 3349672 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@be5e9f5{/solr,null,AVAILABLE}
   [junit4]   2> 3349675 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3349675 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3349675 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3349675 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@422fb1a{/solr,null,AVAILABLE}
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@52d31b38{SSL,[ssl, 
http/1.1]}{127.0.0.1:37787}
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.e.j.s.Server Started @3360154ms
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37787}
   [junit4]   2> 3349676 ERROR (jetty-launcher-6581-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3349676 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-27T00:48:00.919Z
   [junit4]   2> 3349727 INFO  (zkConnectionManagerCallback-6588-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3349727 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@60b5bd2a{SSL,[ssl, 
http/1.1]}{127.0.0.1:38417}
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.e.j.s.Server Started @3360330ms
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=38417}
   [junit4]   2> 3349852 ERROR (jetty-launcher-6581-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3349852 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-27T00:48:01.095Z
   [junit4]   2> 3349865 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@563c9802{SSL,[ssl, 
http/1.1]}{127.0.0.1:40574}
   [junit4]   2> 3349867 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.e.j.s.Server Started @3360345ms
   [junit4]   2> 3349867 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=40574}
   [junit4]   2> 3349867 ERROR (jetty-launcher-6581-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 3349882 INFO  (jetty-launcher-6581-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42184/solr
   [junit4]   2> 3349893 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.3.0
   [junit4]   2> 3350019 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3350019 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3350019 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-27T00:48:01.262Z
   [junit4]   2> 3350019 INFO  (jetty-launcher-6581-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42184/solr
   [junit4]   2> 3349965 INFO  (zkConnectionManagerCallback-6594-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350021 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3350022 INFO  (zkConnectionManagerCallback-6600-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350047 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1613515dc760005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3350104 INFO  (zkConnectionManagerCallback-6592-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350128 INFO  (jetty-launcher-6581-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42184/solr
   [junit4]   2> 3350141 INFO  (zkConnectionManagerCallback-6598-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350230 INFO  
(zkConnectionManagerCallback-6602-thread-1-processing-n:127.0.0.1:37787_solr) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350230 INFO  
(zkConnectionManagerCallback-6608-thread-1-processing-n:127.0.0.1:44470_solr) 
[n:127.0.0.1:44470_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350286 INFO  (zkConnectionManagerCallback-6606-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350287 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1613515dc760008, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3350287 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3350326 INFO  
(zkConnectionManagerCallback-6611-thread-1-processing-n:127.0.0.1:38417_solr) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350424 INFO  (jetty-launcher-6581-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42184/solr
   [junit4]   2> 3350432 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3350433 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:37787_solr
   [junit4]   2> 3350434 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.Overseer Overseer 
(id=99419034788167687-127.0.0.1:37787_solr-n_0000000000) starting
   [junit4]   2> 3350448 INFO  (zkConnectionManagerCallback-6616-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350525 INFO  
(zkConnectionManagerCallback-6618-thread-1-processing-n:127.0.0.1:40574_solr) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3350528 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37787_solr
   [junit4]   2> 3350590 INFO  
(OverseerStateUpdate-99419034788167687-127.0.0.1:37787_solr-n_0000000000) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 3350627 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 3350629 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3350672 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 3350674 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3350708 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40574_solr
   [junit4]   2> 3350712 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38417_solr
   [junit4]   2> 3350837 INFO  
(zkCallback-6601-thread-2-processing-n:127.0.0.1:37787_solr) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 3350838 INFO  
(zkCallback-6601-thread-2-processing-n:127.0.0.1:37787_solr) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 3350838 INFO  
(zkCallback-6617-thread-2-processing-n:127.0.0.1:40574_solr) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (3)
   [junit4]   2> 3350951 INFO  
(zkCallback-6610-thread-1-processing-n:127.0.0.1:38417_solr) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 3351056 INFO  
(zkCallback-6610-thread-2-processing-n:127.0.0.1:38417_solr) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 3351197 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 3351203 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38417.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351220 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40574.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351260 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3351276 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44470_solr
   [junit4]   2> 3351277 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37787.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351301 INFO  
(zkCallback-6601-thread-2-processing-n:127.0.0.1:37787_solr) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 3351301 INFO  
(zkCallback-6610-thread-2-processing-n:127.0.0.1:38417_solr) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 3351352 INFO  
(zkCallback-6607-thread-1-processing-n:127.0.0.1:44470_solr) 
[n:127.0.0.1:44470_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 3351352 INFO  
(zkCallback-6617-thread-1-processing-n:127.0.0.1:40574_solr) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 3351357 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40574.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351357 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40574.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351359 INFO  (jetty-launcher-6581-thread-2) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestUtilizeNode_39B3207A8764B2DF-001/tempDir-001/node2/.
   [junit4]   2> 3351373 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38417.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351373 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38417.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351374 INFO  (jetty-launcher-6581-thread-3) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestUtilizeNode_39B3207A8764B2DF-001/tempDir-001/node3/.
   [junit4]   2> 3351409 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37787.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351409 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37787.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351410 INFO  (jetty-launcher-6581-thread-4) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestUtilizeNode_39B3207A8764B2DF-001/tempDir-001/node4/.
   [junit4]   2> 3351519 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44470.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351594 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44470.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351594 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44470.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4932c3e3
   [junit4]   2> 3351628 INFO  (jetty-launcher-6581-thread-1) 
[n:127.0.0.1:44470_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestUtilizeNode_39B3207A8764B2DF-001/tempDir-001/node1/.
   [junit4]   2> 3352308 INFO  (zkConnectionManagerCallback-6626-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3352344 INFO  (zkConnectionManagerCallback-6630-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3352344 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 3352345 INFO  
(SUITE-TestUtilizeNode-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42184/solr ready
   [junit4]   2> 3352537 INFO  (qtp1719663402-23473) [n:127.0.0.1:40574_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3352717 INFO  (qtp1719663402-23473) [n:127.0.0.1:40574_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=180
   [junit4]   2> 3352938 INFO  
(TEST-TestUtilizeNode.test-seed#[39B3207A8764B2DF]) [    ] o.a.s.SolrTestCaseJ4 
###Starting test
   [junit4]   2> 3352938 INFO  
(TEST-TestUtilizeNode.test-seed#[39B3207A8764B2DF]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 3352972 INFO  (zkConnectionManagerCallback-6633-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3352975 INFO  (qtp1719663402-23472) [n:127.0.0.1:40574_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf1&name=utilizenodecoll&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 3353073 INFO  
(OverseerCollectionConfigSetProcessor-99419034788167687-127.0.0.1:37787_solr-n_0000000000)
 [n:127.0.0.1:37787_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 3353074 INFO  
(OverseerThreadFactory-7655-thread-2-processing-n:127.0.0.1:37787_solr) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
utilizenodecoll
   [junit4]   2> 3353181 INFO  
(OverseerStateUpdate-99419034788167687-127.0.0.1:37787_solr-n_0000000000) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"utilizenodecoll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"utilizenodecoll_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44470/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3353211 INFO  
(OverseerStateUpdate-99419034788167687-127.0.0.1:37787_solr-n_0000000000) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"utilizenodecoll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"utilizenodecoll_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37787/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3353241 INFO  
(OverseerStateUpdate-99419034788167687-127.0.0.1:37787_solr-n_0000000000) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"utilizenodecoll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"utilizenodecoll_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38417/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3353243 INFO  
(OverseerStateUpdate-99419034788167687-127.0.0.1:37787_solr-n_0000000000) 
[n:127.0.0.1:37787_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"utilizenodecoll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"utilizenodecoll_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40574/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 3353504 INFO  (qtp1719663402-23467) [n:127.0.0.1:40574_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard2_replica_n6&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3353505 INFO  (qtp1719663402-23467) [n:127.0.0.1:40574_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 3353774 INFO  (qtp2140752914-23452) [n:127.0.0.1:44470_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard1_replica_n1&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3353792 INFO  (qtp1821075250-23483) [n:127.0.0.1:37787_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard1_replica_n2&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3353792 INFO  (qtp1821075250-23483) [n:127.0.0.1:37787_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 3353791 INFO  (qtp695893262-23464) [n:127.0.0.1:38417_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=utilizenodecoll_shard2_replica_n4&action=CREATE&numShards=2&collection=utilizenodecoll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3353792 INFO  (qtp695893262-23464) [n:127.0.0.1:38417_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 3353803 INFO  (qtp2140752914-23452) [n:127.0.0.1:44470_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 3353966 INFO  
(zkCallback-6610-thread-2-processing-n:127.0.0.1:38417_solr) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 3353966 INFO  
(zkCallback-6617-thread-1-processing-n:127.0.0.1:40574_solr) 
[n:127.0.0.1:40574_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/utilizenodecoll/state.json] for collection [utilizenodecoll] 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 3353966 INFO  
(zkCallback-6617-thread-2-processing-n:127.0.0.1:40574_solr) [n:127.0.0

[...truncated too long message...]

FO  (coreCloseExecutor-8452-thread-2) [n:127.0.0.1:39359_solr 
c:testMetricTrigger s:shard2 r:core_node4 
x:testMetricTrigger_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.testMetricTrigger.shard2.leader, 
tag=1155370841
   [junit4]   2> 3850460 INFO  (coreCloseExecutor-8454-thread-1) 
[n:127.0.0.1:38697_solr c:collection1 s:shard1 r:core_node12 
x:collection1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=672402598
   [junit4]   2> 3850461 INFO  (jetty-closer-7066-thread-4) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@66e43397{/solr,null,UNAVAILABLE}
   [junit4]   2> 3850461 INFO  (coreCloseExecutor-8454-thread-2) 
[n:127.0.0.1:38697_solr c:collection1 s:shard1 r:core_node14 
x:collection1_shard1_replica_n13] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1195924979
   [junit4]   2> 3850463 INFO  
(zkCallback-7171-thread-3-processing-n:127.0.0.1:38697_solr) 
[n:127.0.0.1:38697_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:38697_solr
   [junit4]   2> 3850463 INFO  (jetty-closer-7066-thread-4) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 3850465 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x161351a77170020, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3850465 INFO  (jetty-closer-7066-thread-5) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@3eb9c545{/solr,null,UNAVAILABLE}
   [junit4]   2> 3850467 INFO  (jetty-closer-7066-thread-5) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 3850467 ERROR 
(SUITE-TriggerIntegrationTest-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3850468 INFO  
(SUITE-TriggerIntegrationTest-seed#[39B3207A8764B2DF]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:40209 40209
   [junit4]   2> 3850548 INFO  (Thread-4595) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:40209 40209
   [junit4]   2> 3850553 WARN  (Thread-4595) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        19      /solr/clusterprops.json
   [junit4]   2>        19      /solr/aliases.json
   [junit4]   2>        18      /solr/security.json
   [junit4]   2>        8       /solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        155     /solr/collections/collection1/state.json
   [junit4]   2>        19      /solr/clusterstate.json
   [junit4]   2>        11      /solr/collections/testMetricTrigger/state.json
   [junit4]   2>        6       /solr/autoscaling.json
   [junit4]   2>        6       
/solr/overseer_elect/election/99419054562279456-127.0.0.1:38697_solr-n_0000000009
   [junit4]   2>        3       
/solr/collections/collection1/leader_elect/shard1/election/99419054562279450-core_node4-n_0000000000
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/99419054562279453-core_node8-n_0000000003
   [junit4]   2>        2       
/solr/overseer_elect/election/99419054562279447-127.0.0.1:45525_solr-n_0000000006
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        19      /solr/live_nodes
   [junit4]   2>        19      /solr/collections
   [junit4]   2>        6       /solr/overseer/queue-work
   [junit4]   2>        6       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        6       /solr/overseer/queue
   [junit4]   2>        6       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2>        2       /solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_39B3207A8764B2DF-001
   [junit4]   2> Jan 27, 2018 12:56:21 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene70, 
sim=RandomSimilarity(queryNorm=false): {}, locale=es-PE, timezone=Canada/Pacific
   [junit4]   2> NOTE: Linux 4.4.0-104-generic amd64/Oracle Corporation 
1.8.0_152 (64-bit)/cpus=4,threads=1,free=129478752,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [OverseerRolesTest, 
CachingDirectoryFactoryTest, DeleteShardTest, TestSort, 
TestDocBasedVersionConstraints, DistributedDebugComponentTest, 
TestNumericRangeQuery64, HttpPartitionTest, PeerSyncReplicationTest, 
SpatialHeatmapFacetsTest, ChaosMonkeyNothingIsSafeTest, OutputWriterTest, 
FullSolrCloudDistribCmdsTest, TestOrdValues, DistributedFacetPivotLargeTest, 
CollectionReloadTest, VersionInfoTest, TestExtendedDismaxParser, 
TestEmbeddedSolrServerSchemaAPI, XmlUpdateRequestHandlerTest, 
SolrGangliaReporterTest, JvmMetricsTest, SolrPluginUtilsTest, TestLegacyField, 
HLLUtilTest, TestSolrQueryParser, TestClusterProperties, EnumFieldTest, 
TestFreeTextSuggestions, DistributedTermsComponentTest, TestLockTree, 
DeleteLastCustomShardedReplicaTest, TestWordDelimiterFilterFactory, 
SpellCheckCollatorTest, TestSQLHandlerNonCloud, 
OverriddenZkACLAndCredentialsProvidersTest, TestNumericTerms32, 
TestUseDocValuesAsStored2, TestConfigSetImmutable, 
VMParamsZkACLAndCredentialsProvidersTest, TestQueryWrapperFilter, 
TestCloudPseudoReturnFields, TestAuthorizationFramework, TestRawTransformer, 
ResponseHeaderTest, TestCSVLoader, DistributedQueryElevationComponentTest, 
TestLeaderElectionWithEmptyReplica, TestTriggerIntegration, 
TimeRoutedAliasUpdateProcessorTest, DistributedFacetPivotSmallTest, 
TestPivotHelperCode, SharedFSAutoReplicaFailoverTest, MBeansHandlerTest, 
AssignBackwardCompatibilityTest, UninvertDocValuesMergePolicyTest, 
TestTestInjection, UpdateParamsTest, TestStandardQParsers, 
TestReRankQParserPlugin, IndexBasedSpellCheckerTest, 
CoreMergeIndexesAdminHandlerTest, TestGroupingSearch, 
ClassificationUpdateProcessorTest, TestChildDocTransformer, 
HighlighterConfigTest, SmileWriterTest, TestExactSharedStatsCache, 
QueryResultKeyTest, CollectionsAPIDistributedZkTest, SchemaApiFailureTest, 
NodeLostTriggerTest, MultiThreadedOCPTest, DocumentAnalysisRequestHandlerTest, 
ChaosMonkeySafeLeaderWithPullReplicasTest, TestMacroExpander, 
IgnoreCommitOptimizeUpdateProcessorFactoryTest, SolrShardReporterTest, 
TestSolr4Spatial2, TestSolrCloudSnapshots, TestCSVResponseWriter, 
TestManagedStopFilterFactory, SolrMetricManagerTest, TestIBSimilarityFactory, 
TestJavabinTupleStreamParser, TestRestManager, BinaryUpdateRequestHandlerTest, 
DirectUpdateHandlerTest, StressHdfsTest, CdcrBootstrapTest, 
SolrRequestParserTest, TestLegacyTerms, TestPseudoReturnFields, 
CloudExitableDirectoryReaderTest, SuggesterWFSTTest, 
CreateCollectionCleanupTest, LeaderFailureAfterFreshStartTest, 
TestDistribDocBasedVersion, BasicDistributedZkTest, TestScoreJoinQPNoScore, 
TestSearcherReuse, TestManagedSchemaAPI, HttpTriggerListenerTest, 
TestFieldResource, TestFastOutputStream, TestBinaryField, TestOmitPositions, 
TestComponentsName, SolrIndexConfigTest, TestExportWriter, HdfsNNFailoverTest, 
TestRequestForwarding, ZkStateWriterTest, TestRandomFaceting, CursorPagingTest, 
DistributedVersionInfoTest, AtomicUpdatesTest, TestDocumentBuilder, 
TestInitQParser, StatsReloadRaceTest, TestHashPartitioner, RulesTest, 
ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, 
SyncSliceTest, ShardRoutingTest, ZkCLITest, TestDistributedGrouping, 
ZkControllerTest, TestStressReorder, TestJoin, TestStressVersions, 
TestSolr4Spatial, SolrCmdDistributorTest, TestFiltering, SoftAutoCommitTest, 
TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestDocSet, 
MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, 
TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, 
TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, 
NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, 
SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, 
TestXIncludeConfig, EchoParamsTest, TestDFRSimilarityFactory, 
TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, 
TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, 
TimeZoneUtilsTest, ResourceLoaderTest, OpenExchangeRatesOrgProviderTest, 
PluginInfoTest, TestFastLRUCache, PreAnalyzedFieldTest, TestSystemIdResolver, 
PrimUtilsTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, 
DOMUtilTest, RAMDirectoryFactoryTest, ZkNodePropsTest, UUIDFieldTest, 
TestRTGBase, DistributedIntervalFacetingTest, TestTolerantSearch, 
TestEmbeddedSolrServerAdminHandler, ConnectionReuseTest, ActionThrottleTest, 
AddReplicaTest, CleanupOldIndexTest, CreateRoutedAliasTest, DeleteReplicaTest, 
DocValuesNotIndexedTest, LegacyCloudClusterPropTest, MoveReplicaTest, 
SaslZkACLProviderTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, 
TestConfigSetsAPI, TestPullReplica, TestStressLiveNodes, 
TestTolerantUpdateProcessorCloud, TestTolerantUpdateProcessorRandomCloud, 
TestUtilizeNode, TriLevelCompositeIdRoutingTest, AssignTest, 
HdfsCollectionsAPIDistributedZkTest, SimpleCollectionCreateDeleteTest, 
TestCollectionsAPIViaSolrCloudCluster, AutoAddReplicasIntegrationTest, 
TriggerIntegrationTest]
   [junit4] Completed [679/769 (4!)] on J0 in 199.84s, 14 tests, 2 failures <<< 
FAILURES!

[...truncated 48439 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to