Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/105/

11 tests failed.
FAILED:  org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomMedium

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([2D58666BA8CA1695]:0)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:10003_solr should have been deleted

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:10003_solr 
should have been deleted
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:9A9CB958C6BA1355]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertFalse(Assert.java:68)
        at 
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testNodeMarkersRegistration(TestTriggerIntegration.java:842)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testSearchRate

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:DF6E2FDD074978F5]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration.testSearchRate(TestTriggerIntegration.java:1178)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.cdcr.CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync

Error Message:
Could not load collection from ZK: source_collection

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: 
source_collection
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:908111BD64FF35FC]:0)
        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1108)
        at 
org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:647)
        at 
org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:137)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
        at 
org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:522)
        at 
org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.restartServer(BaseCdcrDistributedZkTest.java:563)
        at 
org.apache.solr.cloud.cdcr.CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync(CdcrReplicationHandlerTest.java:205)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /collections/source_collection/state.json
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:339)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:339)
        at 
org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1120)
        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1106)
        ... 49 more


FAILED:  org.apache.solr.core.TestLazyCores.testNoCommit

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:5D46908503A8BD1F]:0)
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:901)
        at org.apache.solr.core.TestLazyCores.check10(TestLazyCores.java:847)
        at 
org.apache.solr.core.TestLazyCores.testNoCommit(TestLazyCores.java:829)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: 
xpath=//result[@numFound='10']
        xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int 
name="QTime">0</int><lst name="params"><str 
name="q">*:*</str></lst></lst><result name="response" numFound="0" 
start="0"></result>
</response>

        request was:q=*:*
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:894)
        ... 41 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:     1) 
Thread[id=24574, name=searcherExecutor-4953-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)        
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
        at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=24574, name=searcherExecutor-4953-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([82263154C88FDEBA]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=24574, name=searcherExecutor-4953-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)        
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
        at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=24574, name=searcherExecutor-4953-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([82263154C88FDEBA]:0)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
expected:<8> but was:<10>

Stack Trace:
java.lang.AssertionError: expected:<8> but was:<10>
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:EFDA95A972C721BD]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:259)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.lucene.spatial3d.TestGeo3DPoint

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([2D58666BA8CA1695]:0)


FAILED:  org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:7B6BA2FBF4FA9330]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:
Expected numSlices=5 numReplicas=1 but found 
DocCollection(solrj_collection3//collections/solrj_collection3/state.json/30)={ 
  "pullReplicas":"0",   "replicationFactor":"1",   "shards":{     "shard1":{    
   "range":"80000000-b332ffff",       "state":"active",       
"replicas":{"core_node2":{           
"core":"solrj_collection3_shard1_replica_n1",           
"base_url":"http://127.0.0.1:44299";,           "node_name":"127.0.0.1:44299_",  
         "state":"down",           "type":"NRT"}}},     "shard2":{       
"range":"b3330000-e665ffff",       "state":"active",       
"replicas":{"core_node4":{           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node4/data/",
           "base_url":"http://127.0.0.1:44299";,           
"node_name":"127.0.0.1:44299_",           "type":"NRT",           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node4/data/tlog",
           "core":"solrj_collection3_shard2_replica_n3",           
"shared_storage":"true",           "state":"active",           
"leader":"true"}}},     "shard3":{       "range":"e6660000-1998ffff",       
"state":"active",       "replicas":{"core_node7":{           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node7/data/",
           "base_url":"http://127.0.0.1:36554";,           
"node_name":"127.0.0.1:36554_",           "type":"NRT",           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node7/data/tlog",
           "core":"solrj_collection3_shard3_replica_n5",           
"shared_storage":"true",           "state":"active",           
"leader":"true"}}},     "shard4":{       "range":"19990000-4ccbffff",       
"state":"active",       "replicas":{"core_node9":{           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node9/data/",
           "base_url":"http://127.0.0.1:44299";,           
"node_name":"127.0.0.1:44299_",           "type":"NRT",           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node9/data/tlog",
           "core":"solrj_collection3_shard4_replica_n6",           
"shared_storage":"true",           "state":"active",           
"leader":"true"}}},     "shard5":{       "range":"4ccc0000-7fffffff",       
"state":"active",       "replicas":{"core_node10":{           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node10/data/",
           "base_url":"http://127.0.0.1:36554";,           
"node_name":"127.0.0.1:36554_",           "type":"NRT",           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node10/data/tlog",
           "core":"solrj_collection3_shard5_replica_n8",           
"shared_storage":"true",           "state":"active",           
"leader":"true"}}}},   "router":{     "field":"myOwnField",     
"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"true",   
"nrtReplicas":"1",   "tlogReplicas":"0"} with /live_nodes: [127.0.0.1:33534_, 
127.0.0.1:35054_, 127.0.0.1:36554_, 127.0.0.1:39799_, 127.0.0.1:44299_]

Stack Trace:
java.lang.AssertionError: Expected numSlices=5 numReplicas=1 but found 
DocCollection(solrj_collection3//collections/solrj_collection3/state.json/30)={
  "pullReplicas":"0",
  "replicationFactor":"1",
  "shards":{
    "shard1":{
      "range":"80000000-b332ffff",
      "state":"active",
      "replicas":{"core_node2":{
          "core":"solrj_collection3_shard1_replica_n1",
          "base_url":"http://127.0.0.1:44299";,
          "node_name":"127.0.0.1:44299_",
          "state":"down",
          "type":"NRT"}}},
    "shard2":{
      "range":"b3330000-e665ffff",
      "state":"active",
      "replicas":{"core_node4":{
          
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node4/data/",
          "base_url":"http://127.0.0.1:44299";,
          "node_name":"127.0.0.1:44299_",
          "type":"NRT",
          
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node4/data/tlog",
          "core":"solrj_collection3_shard2_replica_n3",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}},
    "shard3":{
      "range":"e6660000-1998ffff",
      "state":"active",
      "replicas":{"core_node7":{
          
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node7/data/",
          "base_url":"http://127.0.0.1:36554";,
          "node_name":"127.0.0.1:36554_",
          "type":"NRT",
          
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node7/data/tlog",
          "core":"solrj_collection3_shard3_replica_n5",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}},
    "shard4":{
      "range":"19990000-4ccbffff",
      "state":"active",
      "replicas":{"core_node9":{
          
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node9/data/",
          "base_url":"http://127.0.0.1:44299";,
          "node_name":"127.0.0.1:44299_",
          "type":"NRT",
          
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node9/data/tlog",
          "core":"solrj_collection3_shard4_replica_n6",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}},
    "shard5":{
      "range":"4ccc0000-7fffffff",
      "state":"active",
      "replicas":{"core_node10":{
          
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node10/data/",
          "base_url":"http://127.0.0.1:36554";,
          "node_name":"127.0.0.1:36554_",
          "type":"NRT",
          
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node10/data/tlog",
          "core":"solrj_collection3_shard5_replica_n8",
          "shared_storage":"true",
          "state":"active",
          "leader":"true"}}}},
  "router":{
    "field":"myOwnField",
    "name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"true",
  "nrtReplicas":"1",
  "tlogReplicas":"0"} with /live_nodes: [127.0.0.1:33534_, 127.0.0.1:35054_, 
127.0.0.1:36554_, 127.0.0.1:39799_, 127.0.0.1:44299_]
        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:A720E8E6673B342]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.assertSliceAndReplicaCount(SharedFSAutoReplicaFailoverTest.java:414)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:256)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:144)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 10748 lines...]
   [junit4] Suite: org.apache.lucene.spatial3d.TestGeo3DPoint
   [junit4]   2> ??? 15, 2017 4:28:58 ? 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
   [junit4]   2> WARNING: Suite execution timed out: 
org.apache.lucene.spatial3d.TestGeo3DPoint
   [junit4]   2>    1) Thread[id=11, 
name=SUITE-TestGeo3DPoint-seed#[2D58666BA8CA1695], state=RUNNABLE, 
group=TGRP-TestGeo3DPoint]
   [junit4]   2>         at java.lang.Thread.getStackTrace(Thread.java:1559)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:696)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:693)
   [junit4]   2>         at java.security.AccessController.doPrivileged(Native 
Method)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:693)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:709)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:689)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:705)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:139)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:626)
   [junit4]   2>    2) Thread[id=12, 
name=TEST-TestGeo3DPoint.testRandomMedium-seed#[2D58666BA8CA1695], 
state=RUNNABLE, group=TGRP-TestGeo3DPoint]
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.Plane.recordBounds(Plane.java:1251)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.XYZBounds.addPlane(XYZBounds.java:161)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.GeoConvexPolygon.getBounds(GeoConvexPolygon.java:484)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.GeoBaseCompositeShape.getBounds(GeoBaseCompositeShape.java:131)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.verify(TestGeo3DPoint.java:846)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.doTestRandom(TestGeo3DPoint.java:548)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomMedium(TestGeo3DPoint.java:475)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    3) Thread[id=1, name=main, state=WAITING, group=main]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1252)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1326)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:636)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:493)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:251)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:368)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
   [junit4]   2>    4) Thread[id=9, name=JUnit4-serializer-daemon, 
state=TIMED_WAITING, group=main]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestGeo3DPoint 
-Dtests.method=testRandomMedium -Dtests.seed=2D58666BA8CA1695 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt
 -Dtests.locale=ar-EG -Dtests.timezone=America/Hermosillo -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR    379s J1 | TestGeo3DPoint.testRandomMedium <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because 
suite timeout was reached.
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2D58666BA8CA1695]:0)
   [junit4]   2> ??? 15, 2017 4:28:58 ? 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> ??? 15, 2017 4:29:18 ? 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.lucene.spatial3d.TestGeo3DPoint: 
   [junit4]   2>    1) Thread[id=12, 
name=TEST-TestGeo3DPoint.testRandomMedium-seed#[2D58666BA8CA1695], 
state=RUNNABLE, group=TGRP-TestGeo3DPoint]
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.Plane.findIntersectionBounds(Plane.java:1105)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.Plane.recordBounds(Plane.java:1214)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.XYZBounds.addIntersection(XYZBounds.java:262)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.GeoConvexPolygon.getBounds(GeoConvexPolygon.java:486)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.GeoBaseCompositeShape.getBounds(GeoBaseCompositeShape.java:131)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.verify(TestGeo3DPoint.java:846)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.doTestRandom(TestGeo3DPoint.java:548)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomMedium(TestGeo3DPoint.java:475)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> ??? 15, 2017 4:29:18 ? 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=12, 
name=TEST-TestGeo3DPoint.testRandomMedium-seed#[2D58666BA8CA1695], 
state=RUNNABLE, group=TGRP-TestGeo3DPoint]
   [junit4]   2> ??? 15, 2017 4:29:21 ? 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=12, 
name=TEST-TestGeo3DPoint.testRandomMedium-seed#[2D58666BA8CA1695], 
state=RUNNABLE, group=TGRP-TestGeo3DPoint]
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.Plane.recordBounds(Plane.java:1583)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.XYZBounds.addPlane(XYZBounds.java:161)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.GeoConvexPolygon.getBounds(GeoConvexPolygon.java:484)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.geom.GeoBaseCompositeShape.getBounds(GeoBaseCompositeShape.java:131)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.verify(TestGeo3DPoint.java:846)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.doTestRandom(TestGeo3DPoint.java:548)
   [junit4]   2>         at 
org.apache.lucene.spatial3d.TestGeo3DPoint.testRandomMedium(TestGeo3DPoint.java:475)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{id=PostingsFormat(name=Asserting)}, 
docValues:{id=DocValuesFormat(name=Lucene70), 
point=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=759, 
maxMBSortInHeap=6.682149951690519, sim=RandomSimilarity(queryNorm=false): {}, 
locale=ar-EG, timezone=America/Hermosillo
   [junit4]   2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 
1.8.0_152 (64-bit)/cpus=4,threads=2,free=167581752,total=398458880
   [junit4]   2> NOTE: All tests run in this JVM: [TestGeo3DPoint]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestGeo3DPoint 
-Dtests.seed=2D58666BA8CA1695 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/test-data/enwiki.random.lines.txt
 -Dtests.locale=ar-EG -Dtests.timezone=America/Hermosillo -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestGeo3DPoint (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2D58666BA8CA1695]:0)
   [junit4] Completed [15/16 (1!)] on J1 in 7225.44s, 12 tests, 2 errors <<< 
FAILURES!

[...truncated 2014 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestTriggerIntegration
   [junit4]   2> Creating dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestTriggerIntegration_82263154C88FDEBA-001/init-core-data-001
   [junit4]   2> 868281 WARN  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=8 numCloses=8
   [junit4]   2> 868281 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 868283 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 868283 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 868378 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=clusterstate.json
   [junit4]   2> 868378 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=clusterprops.json
   [junit4]   2> 868378 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868378 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868378 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=roles.json
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeLost
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868379 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeAdded
   [junit4]   2> 868431 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868431 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@4a1d8cf3,
 currentName=127.0.0.1:10000_solr
   [junit4]   2> 868431 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868431 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@4a1d8cf3,
 currentName=127.0.0.1:10000_solr
   [junit4]   2> 868431 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868432 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868432 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@4a1d8cf3,
 currentName=127.0.0.1:10001_solr
   [junit4]   2> 868432 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868432 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@4a1d8cf3,
 currentName=127.0.0.1:10001_solr
   [junit4]   2> 868432 INFO  
(SUITE-TestTriggerIntegration-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868476 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868476 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 868476 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868476 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868476 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 0
   [junit4]   2> 868477 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868477 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868477 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10001_solr, 
127.0.0.1:10000_solr]
   [junit4]   2> 868477 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 868477 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@1b009d9,
 currentName=.auto_add_replicas
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@1b009d9,
 currentName=.auto_add_replicas
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868479 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeLost
   [junit4]   2> 868484 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 868484 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868484 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeAdded
   [junit4]   2> 868484 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 868507 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868507 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868507 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@1b009d9,
 currentName=.auto_add_replicas
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeMarkersRegistration
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling.json
   [junit4]   2> 868520 DEBUG 
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868520 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@1b009d9,
 currentName=.auto_add_replicas
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=events
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@1b009d9,
 currentName=.auto_add_replicas
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeLost
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeLost
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeAdded
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868521 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=nodeAdded
   [junit4]   2> 868522 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and 
clearing object cache...
   [junit4]   2> 868522 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 868543 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@31028c04,
 currentName=.auto_add_replicas
   [junit4]   2> 868544 DEBUG (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@31028c04,
 currentName=.auto_add_replicas
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@31028c04,
 currentName=.auto_add_replicas
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=autoscaling
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@3f319405,
 currentName=triggerState
   [junit4]   2> 868544 INFO  (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@31028c04,
 currentName=.auto_add_replicas
   [junit4]   2> 868593 DEBUG (ScheduledTrigger-290-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 868630 WARN  (ScheduledTrigger-290-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger ran but was already closed
   [junit4]   2> 868630 DEBUG 
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 868631 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868631 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@4a1d8cf3,
 currentName=127.0.0.1:10002_solr
   [junit4]   2> 868631 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@20b657cb,
 currentName=live_nodes
   [junit4]   2> 868631 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node@4a1d8cf3,
 currentName=127.0.0.1:10002_solr
   [junit4]   2> 868631 INFO  
(TEST-TestTriggerIntegration.testNodeMarkersRegistration-seed#[82263154C88FDEBA])
 [    ] o.a.s.c.a.s.SimDistribStateManager  - 
parentNode=org.apache.solr.cloud.autoscali

[...truncated too long message...]

-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node4/data/",
   [junit4]    >           "base_url":"http://127.0.0.1:44299";,
   [junit4]    >           "node_name":"127.0.0.1:44299_",
   [junit4]    >           "type":"NRT",
   [junit4]    >           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node4/data/tlog",
   [junit4]    >           "core":"solrj_collection3_shard2_replica_n3",
   [junit4]    >           "shared_storage":"true",
   [junit4]    >           "state":"active",
   [junit4]    >           "leader":"true"}}},
   [junit4]    >     "shard3":{
   [junit4]    >       "range":"e6660000-1998ffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{"core_node7":{
   [junit4]    >           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node7/data/",
   [junit4]    >           "base_url":"http://127.0.0.1:36554";,
   [junit4]    >           "node_name":"127.0.0.1:36554_",
   [junit4]    >           "type":"NRT",
   [junit4]    >           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node7/data/tlog",
   [junit4]    >           "core":"solrj_collection3_shard3_replica_n5",
   [junit4]    >           "shared_storage":"true",
   [junit4]    >           "state":"active",
   [junit4]    >           "leader":"true"}}},
   [junit4]    >     "shard4":{
   [junit4]    >       "range":"19990000-4ccbffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{"core_node9":{
   [junit4]    >           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node9/data/",
   [junit4]    >           "base_url":"http://127.0.0.1:44299";,
   [junit4]    >           "node_name":"127.0.0.1:44299_",
   [junit4]    >           "type":"NRT",
   [junit4]    >           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node9/data/tlog",
   [junit4]    >           "core":"solrj_collection3_shard4_replica_n6",
   [junit4]    >           "shared_storage":"true",
   [junit4]    >           "state":"active",
   [junit4]    >           "leader":"true"}}},
   [junit4]    >     "shard5":{
   [junit4]    >       "range":"4ccc0000-7fffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{"core_node10":{
   [junit4]    >           
"dataDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node10/data/",
   [junit4]    >           "base_url":"http://127.0.0.1:36554";,
   [junit4]    >           "node_name":"127.0.0.1:36554_",
   [junit4]    >           "type":"NRT",
   [junit4]    >           
"ulogDir":"hdfs://lucene2-us-west.apache.org:32813/solr_hdfs_home/solrj_collection3/core_node10/data/tlog",
   [junit4]    >           "core":"solrj_collection3_shard5_replica_n8",
   [junit4]    >           "shared_storage":"true",
   [junit4]    >           "state":"active",
   [junit4]    >           "leader":"true"}}}},
   [junit4]    >   "router":{
   [junit4]    >     "field":"myOwnField",
   [junit4]    >     "name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"1",
   [junit4]    >   "autoAddReplicas":"true",
   [junit4]    >   "nrtReplicas":"1",
   [junit4]    >   "tlogReplicas":"0"} with /live_nodes: [127.0.0.1:33534_, 
127.0.0.1:35054_, 127.0.0.1:36554_, 127.0.0.1:39799_, 127.0.0.1:44299_]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([82263154C88FDEBA:A720E8E6673B342]:0)
   [junit4]    >        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.assertSliceAndReplicaCount(SharedFSAutoReplicaFailoverTest.java:414)
   [junit4]    >        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:256)
   [junit4]    >        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:144)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 5417752 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 5417808 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[82263154C88FDEBA]-worker) [    ] 
o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 5417910 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data3/,
 
[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data4/]]
  heartbeating to lucene2-us-west.apache.org/127.0.0.1:32813) [    ] 
o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager 
interrupted
   [junit4]   2> 5417910 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data3/,
 
[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data4/]]
  heartbeating to lucene2-us-west.apache.org/127.0.0.1:32813) [    ] 
o.a.h.h.s.d.DataNode Ending block pool service for: Block pool 
BP-2088124311-127.0.0.1-1513341517375 (Datanode Uuid 
072f7224-0230-4319-a8b1-1d7502ce29b1) service to 
lucene2-us-west.apache.org/127.0.0.1:32813
   [junit4]   2> 5417912 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[82263154C88FDEBA]-worker) [    ] 
o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 5417956 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[82263154C88FDEBA]-worker) [    ] 
o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 5418057 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data1/,
 
[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data2/]]
  heartbeating to lucene2-us-west.apache.org/127.0.0.1:32813) [    ] 
o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager 
interrupted
   [junit4]   2> 5418057 WARN  (DataNode: 
[[[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data1/,
 
[DISK]file:/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001/tempDir-001/hdfsBaseDir/data/data2/]]
  heartbeating to lucene2-us-west.apache.org/127.0.0.1:32813) [    ] 
o.a.h.h.s.d.DataNode Ending block pool service for: Block pool 
BP-2088124311-127.0.0.1-1513341517375 (Datanode Uuid 
9fa6156c-064c-49df-ac75-e1260c8370d0) service to 
lucene2-us-west.apache.org/127.0.0.1:32813
   [junit4]   2> 5418088 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[82263154C88FDEBA]-worker) [    ] 
o.m.log Stopped 
HttpServer2$selectchannelconnectorwithsafestar...@lucene2-us-west.apache.org:0
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_82263154C88FDEBA-001
   [junit4]   2> Dec 15, 2017 1:37:03 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 34 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: 
codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION,
 chunkSize=7, maxDocsPerChunk=988, blockSize=3), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION,
 chunkSize=7, blockSize=3)), sim=RandomSimilarity(queryNorm=true): {}, 
locale=mk-MK, timezone=America/Monterrey
   [junit4]   2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 
1.8.0_152 (64-bit)/cpus=4,threads=2,free=111666544,total=524812288
   [junit4]   2> NOTE: All tests run in this JVM: [TestNumericTokenStream, 
CollectionsAPIAsyncDistributedZkTest, TestBulkSchemaAPI, 
WordBreakSolrSpellCheckerTest, TestCloudDeleteByQuery, TestCloudSchemaless, 
TestStandardQParsers, DistributedExpandComponentTest, SSLMigrationTest, 
TestSystemIdResolver, SuggestComponentContextFilterQueryTest, RecoveryZkTest, 
StressHdfsTest, DistributedFacetPivotLongTailTest, DeleteNodeTest, 
SolrGraphiteReporterTest, TestMiniSolrCloudClusterSSL, TestDistributedGrouping, 
DistribJoinFromCollectionTest, XsltUpdateRequestHandlerTest, 
DisMaxRequestHandlerTest, TestTolerantSearch, SolrSlf4jReporterTest, 
BooleanFieldTest, HighlighterTest, TestReqParamsAPI, 
TestManagedSynonymFilterFactory, AutoscalingHistoryHandlerTest, 
HttpTriggerListenerTest, TestUnifiedSolrHighlighter, TestGroupingSearch, 
SharedFSAutoReplicaFailoverTest]
   [junit4] Completed [669/763 (6!)] on J2 in 3516.11s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 47677 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to