[JENKINS] Lucene-Solr-NightlyTests-master - Build # 1232 - Still Unstable

[Apache Jenkins Server]

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1232/

5 tests failed.
FAILED:  
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchBoundaries

Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1

Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete 
@source_collection:shard1
        at 
__randomizedtesting.SeedInfo.seed([CB2E38BC6F8B6B3E:E901E1E9162FAAD9]:0)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testBatchBoundaries(CdcrReplicationDistributedZkTest.java:557)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange

Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard2

Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete 
@source_collection:shard2
        at 
__randomizedtesting.SeedInfo.seed([CB2E38BC6F8B6B3E:19DE745F3124CD0C]:0)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange(CdcrReplicationDistributedZkTest.java:306)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
ObjectTracker found 5 object(s) that were not released!!! [SolrCore, 
MDCAwareThreadPoolExecutor, MockDirectoryWrapper, MockDirectoryWrapper, 
MockDirectoryWrapper] 
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:998)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)  at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)  at 
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)  at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at java.lang.Thread.run(Thread.java:745)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:848)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)  at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)  at 
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)  at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at java.lang.Thread.run(Thread.java:745)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
  at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
  at 
org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:195)
  at 
org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)  
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:902)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)  at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)  at 
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)  at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at java.lang.Thread.run(Thread.java:745)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
  at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
  at 
org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:195)
  at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:348)  at 
org.apache.solr.core.SolrCore.initIndex(SolrCore.java:691)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:908)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)  at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)  at 
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)  at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at java.lang.Thread.run(Thread.java:745)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
  at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
  at 
org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:195)
  at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:97)  at 
org.apache.solr.core.SolrCore.initIndex(SolrCore.java:723)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:908)  at 
org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)  at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)  at 
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)  at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
  at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
  at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at java.lang.Thread.run(Thread.java:745)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 5 object(s) that were not 
released!!! [SolrCore, MDCAwareThreadPoolExecutor, MockDirectoryWrapper, 
MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:998)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)
        at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)
        at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:848)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)
        at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)
        at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
        at 
org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:195)
        at 
org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:902)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)
        at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)
        at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
        at 
org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:195)
        at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:348)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:691)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:908)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)
        at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)
        at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
        at 
org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:195)
        at 
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:97)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:723)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:908)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:825)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:928)
        at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1295)
        at 
org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:211)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


        at __randomizedtesting.SeedInfo.seed([CB2E38BC6F8B6B3E]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:289)
        at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery:     
1) Thread[id=7714, name=searcherExecutor-3862-thread-1, state=WAITING, 
group=TGRP-TestCoreDiscovery]         at sun.misc.Unsafe.park(Native Method)    
     at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)       
  at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.core.TestCoreDiscovery: 
   1) Thread[id=7714, name=searcherExecutor-3862-thread-1, state=WAITING, 
group=TGRP-TestCoreDiscovery]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([CB2E38BC6F8B6B3E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=7714, name=searcherExecutor-3862-thread-1, state=WAITING, 
group=TGRP-TestCoreDiscovery]         at sun.misc.Unsafe.park(Native Method)    
     at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)       
  at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=7714, name=searcherExecutor-3862-thread-1, state=WAITING, 
group=TGRP-TestCoreDiscovery]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([CB2E38BC6F8B6B3E]:0)




Build Log:
[...truncated 11936 lines...]
   [junit4] Suite: org.apache.solr.core.TestCoreDiscovery
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/init-core-data-001
   [junit4]   2> 1288452 INFO  
(SUITE-TestCoreDiscovery-seed#[CB2E38BC6F8B6B3E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 1288453 INFO  
(SUITE-TestCoreDiscovery-seed#[CB2E38BC6F8B6B3E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1288453 INFO  
(SUITE-TestCoreDiscovery-seed#[CB2E38BC6F8B6B3E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1288453 INFO  
(SUITE-TestCoreDiscovery-seed#[CB2E38BC6F8B6B3E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1288454 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testTooManyTransientCores
   [junit4]   2> 1288478 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/solr.xml
   [junit4]   2> 1288497 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
] o.a.s.c.SolrCores Allocating transient cache for 2 transient cores
   [junit4]   2> 1288532 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
] o.a.s.c.CorePropertiesLocator Found 7 core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001
   [junit4]   2> 1288532 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
] o.a.s.c.CorePropertiesLocator Cores are: [coreT1, coreLOS, coreT4, coreT3, 
coreT2, coreT6, coreT5]
   [junit4]   2> 1288570 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288577 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288582 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.s.IndexSchema [coreLOS] Schema name=tiny
   [junit4]   2> 1288585 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288591 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.s.IndexSchema [coreT4] Schema name=tiny
   [junit4]   2> 1288591 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288595 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.s.IndexSchema [coreT1] Schema name=tiny
   [junit4]   2> 1288595 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.c.CoreContainer Creating SolrCore 'coreLOS' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreLOS
   [junit4]   2> 1288595 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.c.SolrCore [[coreLOS] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreLOS],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreLOS/coreLOS/]
   [junit4]   2> 1288596 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288596 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.756156040929452]
   [junit4]   2> 1288596 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288597 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.c.CoreContainer Creating SolrCore 'coreT4' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT4
   [junit4]   2> 1288597 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.c.SolrCore [[coreT4] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT4],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT4/coreT4/]
   [junit4]   2> 1288597 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.c.CoreContainer Creating SolrCore 'coreT1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1
   [junit4]   2> 1288597 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.c.SolrCore [[coreT1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1/coreT1/]
   [junit4]   2> 1288597 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.756156040929452]
   [junit4]   2> 1288621 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.756156040929452]
   [junit4]   2> 1288636 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1288636 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1288637 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.5654296875, noCFSRatio=1.0]
   [junit4]   2> 1288637 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@701d95c5[coreLOS] main]
   [junit4]   2> 1288637 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreLOS/conf
   [junit4]   2> 1288637 INFO  (coreLoadExecutor-3821-thread-2) [    x:coreLOS] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1288639 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1288639 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1288639 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.5654296875, noCFSRatio=1.0]
   [junit4]   2> 1288640 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@44676b26[coreT4] main]
   [junit4]   2> 1288640 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT4/conf
   [junit4]   2> 1288640 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1288640 INFO  (coreLoadExecutor-3821-thread-3) [    x:coreT4] 
o.a.s.c.SolrCores Opening transient core coreT4
   [junit4]   2> 1288645 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288646 INFO  
(searcherExecutor-3822-thread-1-processing-x:coreLOS) [    x:coreLOS] 
o.a.s.c.SolrCore [coreLOS] Registered new searcher Searcher@701d95c5[coreLOS] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1288647 INFO  
(searcherExecutor-3823-thread-1-processing-x:coreT4) [    x:coreT4] 
o.a.s.c.SolrCore [coreT4] Registered new searcher Searcher@44676b26[coreT4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1288651 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288681 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.s.IndexSchema [coreT3] Schema name=tiny
   [junit4]   2> 1288683 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288684 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'coreT3' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT3
   [junit4]   2> 1288686 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.s.IndexSchema [coreT2] Schema name=tiny
   [junit4]   2> 1288688 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288689 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'coreT2' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT2
   [junit4]   2> 1288689 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrCore [[coreT2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT2/coreT2/]
   [junit4]   2> 1288690 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=45, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=86.9228515625, 
floorSegmentMB=0.4892578125, forceMergeDeletesPctAllowed=15.467875990094617, 
segmentsPerTier=32.0, maxCFSSegmentSizeMB=0.5322265625, 
noCFSRatio=0.3129011541670742
   [junit4]   2> 1288693 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1288693 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1288693 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.5654296875, noCFSRatio=1.0]
   [junit4]   2> 1288693 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@335c50a1[coreT1] main]
   [junit4]   2> 1288693 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1/conf
   [junit4]   2> 1288693 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1288694 INFO  (coreLoadExecutor-3821-thread-1) [    x:coreT1] 
o.a.s.c.SolrCores Opening transient core coreT1
   [junit4]   2> 1288700 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288706 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.s.IndexSchema [coreT6] Schema name=tiny
   [junit4]   2> 1288707 INFO  
(searcherExecutor-3824-thread-1-processing-x:coreT1) [    x:coreT1] 
o.a.s.c.SolrCore [coreT1] Registered new searcher Searcher@335c50a1[coreT1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1288708 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288709 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'coreT6' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT6
   [junit4]   2> 1288710 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.c.SolrCore [[coreT6] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT6],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT6/coreT6/]
   [junit4]   2> 1288710 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=45, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=86.9228515625, 
floorSegmentMB=0.4892578125, forceMergeDeletesPctAllowed=15.467875990094617, 
segmentsPerTier=32.0, maxCFSSegmentSizeMB=0.5322265625, 
noCFSRatio=0.3129011541670742
   [junit4]   2> 1288710 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.c.SolrCore [[coreT3] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT3],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT3/coreT3/]
   [junit4]   2> 1288711 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=45, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=86.9228515625, 
floorSegmentMB=0.4892578125, forceMergeDeletesPctAllowed=15.467875990094617, 
segmentsPerTier=32.0, maxCFSSegmentSizeMB=0.5322265625, 
noCFSRatio=0.3129011541670742
   [junit4]   2> 1288895 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1288895 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1288895 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=50, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=52.7998046875, 
floorSegmentMB=0.650390625, forceMergeDeletesPctAllowed=25.131369586392776, 
segmentsPerTier=40.0, maxCFSSegmentSizeMB=0.5146484375, noCFSRatio=1.0
   [junit4]   2> 1288899 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@2647bd97[coreT2] main]
   [junit4]   2> 1288902 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT2/conf
   [junit4]   2> 1288902 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1288903 INFO  (searcherExecutor-3832-thread-1) [    ] 
o.a.s.c.SolrCore [coreT2] Registered new searcher Searcher@2647bd97[coreT2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1288907 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrCores Opening transient core coreT2
   [junit4]   2> 1288907 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrCores Closing transient core [coreT4]
   [junit4]   2> 1288907 INFO  (Thread-1648) [    ] o.a.s.c.SolrCore [coreT4]  
CLOSING SolrCore org.apache.solr.core.SolrCore@435fb2ad
   [junit4]   2> 1288913 INFO  (Thread-1648) [    ] o.a.s.m.SolrMetricManager 
Closing metric reporters for: solr.core.coreT4
   [junit4]   2> 1288917 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1288917 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1288917 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=50, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=52.7998046875, 
floorSegmentMB=0.650390625, forceMergeDeletesPctAllowed=25.131369586392776, 
segmentsPerTier=40.0, maxCFSSegmentSizeMB=0.5146484375, noCFSRatio=1.0
   [junit4]   2> 1288918 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@b32dedb[coreT3] main]
   [junit4]   2> 1288918 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT3/conf
   [junit4]   2> 1288918 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1288919 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.c.SolrCores Opening transient core coreT3
   [junit4]   2> 1288919 INFO  (coreLoadExecutor-3821-thread-2) [    ] 
o.a.s.c.SolrCores Closing transient core [coreT1]
   [junit4]   2> 1288919 INFO  (Thread-1648) [    ] o.a.s.c.SolrCore [coreT1]  
CLOSING SolrCore org.apache.solr.core.SolrCore@343fddfc
   [junit4]   2> 1288920 INFO  (Thread-1648) [    ] o.a.s.m.SolrMetricManager 
Closing metric reporters for: solr.core.coreT1
   [junit4]   2> 1288922 INFO  (searcherExecutor-3831-thread-1) [    ] 
o.a.s.c.SolrCore [coreT3] Registered new searcher Searcher@b32dedb[coreT3] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1288929 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1288929 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1288929 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=50, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=52.7998046875, 
floorSegmentMB=0.650390625, forceMergeDeletesPctAllowed=25.131369586392776, 
segmentsPerTier=40.0, maxCFSSegmentSizeMB=0.5146484375, noCFSRatio=1.0
   [junit4]   2> 1288930 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@198fcdae[coreT6] main]
   [junit4]   2> 1288930 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT6/conf
   [junit4]   2> 1288930 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1288931 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.c.SolrCores Opening transient core coreT6
   [junit4]   2> 1288931 INFO  (coreLoadExecutor-3821-thread-1) [    ] 
o.a.s.c.SolrCores Closing transient core [coreT2]
   [junit4]   2> 1288931 INFO  (Thread-1648) [    ] o.a.s.c.SolrCore [coreT2]  
CLOSING SolrCore org.apache.solr.core.SolrCore@4ed3392b
   [junit4]   2> 1288963 INFO  (searcherExecutor-3836-thread-1) [    ] 
o.a.s.c.SolrCore [coreT6] Registered new searcher Searcher@198fcdae[coreT6] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1288963 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1288966 INFO  (Thread-1648) [    ] o.a.s.m.SolrMetricManager 
Closing metric reporters for: solr.core.coreT2
   [junit4]   2> 1288971 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.s.IndexSchema [coreT5] Schema name=tiny
   [junit4]   2> 1288978 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1288979 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'coreT5' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT5
   [junit4]   2> 1288980 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrCore [[coreT5] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT5],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT5/coreT5/]
   [junit4]   2> 1288981 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=9, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1289021 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1289021 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1289021 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@67b9cf64
   [junit4]   2> 1289021 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@250802e6[coreT5] main]
   [junit4]   2> 1289022 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT5/conf
   [junit4]   2> 1289022 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1289022 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrCores Opening transient core coreT5
   [junit4]   2> 1289022 INFO  (coreLoadExecutor-3821-thread-3) [    ] 
o.a.s.c.SolrCores Closing transient core [coreT3]
   [junit4]   2> 1289022 INFO  (Thread-1648) [    ] o.a.s.c.SolrCore [coreT3]  
CLOSING SolrCore org.apache.solr.core.SolrCore@353e25bd
   [junit4]   2> 1289025 INFO  (Thread-1648) [    ] o.a.s.m.SolrMetricManager 
Closing metric reporters for: solr.core.coreT3
   [junit4]   2> 1289026 INFO  (searcherExecutor-3846-thread-1) [    ] 
o.a.s.c.SolrCore [coreT5] Registered new searcher Searcher@250802e6[coreT5] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1289032 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1289060 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.s.IndexSchema [coreT1] Schema name=tiny
   [junit4]   2> 1289062 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 1289064 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.c.CoreContainer Creating SolrCore 'coreT1' using configuration 
from instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1
   [junit4]   2> 1289065 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.c.SolrCore [[coreT1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_CB2E38BC6F8B6B3E-001/tempDir-001/coreT1/coreT1/]
   [junit4]   2> 1289066 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1289093 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1289093 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1289093 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 1289094 INFO  
(TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[CB2E38BC6F8B6B3E]) [    
x:coreT1] o.

[...truncated too long message...]

 
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@46e9eec0{/,null,UNAVAILABLE}
   [junit4]   2> 2210472 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.c.ChaosMonkey monkey: stop shard! 52278
   [junit4]   2> 2210472 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1398406902
   [junit4]   2> 2210474 INFO  (coreCloseExecutor-2965-thread-1) 
[n:127.0.0.1:52278_ c:target_collection s:shard1 r:core_node4 
x:target_collection_shard1_replica1] o.a.s.c.SolrCore 
[target_collection_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@7c44a164
   [junit4]   2> 2210474 INFO  (coreCloseExecutor-2965-thread-1) 
[n:127.0.0.1:52278_ c:target_collection s:shard1 r:core_node4 
x:target_collection_shard1_replica1] o.a.s.h.CdcrRequestHandler Solr core is 
being closed - shutting down CDCR handler @ target_collection:shard1
   [junit4]   2> 2210509 INFO  (coreCloseExecutor-2965-thread-1) 
[n:127.0.0.1:52278_ c:target_collection s:shard1 r:core_node4 
x:target_collection_shard1_replica1] o.a.s.m.SolrMetricManager Closing metric 
reporters for: solr.core.target_collection.shard1.replica1
   [junit4]   2> 2210510 INFO  
(zkCallback-2503-thread-3-processing-n:127.0.0.1:47473_) [n:127.0.0.1:47473_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 2210510 WARN  
(zkCallback-2585-thread-2-processing-n:127.0.0.1:52278_) [n:127.0.0.1:52278_    
] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to 
ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2210511 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2210512 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@460333fe{SSL,[ssl, 
http/1.1]}{127.0.0.1:52278}
   [junit4]   2> 2210512 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@67db022f{/,null,UNAVAILABLE}
   [junit4]   2> 2210512 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.c.ChaosMonkey monkey: stop shard! 47473
   [junit4]   2> 2210513 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1863218733
   [junit4]   2> 2210515 INFO  (coreCloseExecutor-2967-thread-1) 
[n:127.0.0.1:47473_ c:target_collection s:shard2 r:core_node2 
x:target_collection_shard2_replica2] o.a.s.c.SolrCore 
[target_collection_shard2_replica2]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5e84a564
   [junit4]   2> 2210515 INFO  (coreCloseExecutor-2967-thread-1) 
[n:127.0.0.1:47473_ c:target_collection s:shard2 r:core_node2 
x:target_collection_shard2_replica2] o.a.s.h.CdcrRequestHandler Solr core is 
being closed - shutting down CDCR handler @ target_collection:shard2
   [junit4]   2> 2210517 INFO  
(zkCallback-2503-thread-3-processing-n:127.0.0.1:47473_) [n:127.0.0.1:47473_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/target_collection/state.json] for collection 
[target_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2210530 INFO  (coreCloseExecutor-2967-thread-1) 
[n:127.0.0.1:47473_ c:target_collection s:shard2 r:core_node2 
x:target_collection_shard2_replica2] o.a.s.m.SolrMetricManager Closing metric 
reporters for: solr.core.target_collection.shard2.replica2
   [junit4]   2> 2210532 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.c.Overseer Overseer 
(id=97424491556569121-127.0.0.1:47473_-n_0000000007) closing
   [junit4]   2> 2210532 INFO  
(OverseerStateUpdate-97424491556569121-127.0.0.1:47473_-n_0000000007) 
[n:127.0.0.1:47473_    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:47473_
   [junit4]   2> 2210534 WARN  
(zkCallback-2503-thread-3-processing-n:127.0.0.1:47473_) [n:127.0.0.1:47473_    
] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to 
ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2210534 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 2210535 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@138793ab{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2210538 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@28001934{/,null,UNAVAILABLE}
   [junit4]   2> 2210538 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteCreateSourceCollection
   [junit4]   2> 2210539 INFO  
(TEST-CdcrReplicationDistributedZkTest.testDeleteCreateSourceCollection-seed#[CB2E38BC6F8B6B3E])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34435 34435
   [junit4]   2> 2210636 INFO  (Thread-1579) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:34435 34435
   [junit4]   2> 2210637 WARN  (Thread-1579) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        48      /solr/aliases.json
   [junit4]   2>        26      /solr/configs/conf1
   [junit4]   2>        10      /solr/security.json
   [junit4]   2>        8       /solr/collections/tmp_collection/state.json
   [junit4]   2>        3       
/solr/collections/source_collection/leaders/shard1/leader
   [junit4]   2>        3       
/solr/collections/target_collection/leaders/shard1/leader
   [junit4]   2>        2       
/solr/collections/source_collection/leaders/shard2/leader
   [junit4]   2>        2       
/solr/collections/tmp_collection/leaders/shard2/leader
   [junit4]   2>        2       
/solr/collections/target_collection/leaders/shard2/leader
   [junit4]   2>        2       
/solr/collections/tmp_collection/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        48      /solr/clusterprops.json
   [junit4]   2>        48      /solr/clusterstate.json
   [junit4]   2>        10      
/solr/collections/target_collection/cdcr/state/buffer
   [junit4]   2>        10      
/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2>        10      
/solr/collections/source_collection/cdcr/state/process
   [junit4]   2>        10      
/solr/collections/target_collection/cdcr/state/process
   [junit4]   2>        9       /solr/collections/source_collection/state.json
   [junit4]   2>        9       /solr/collections/target_collection/state.json
   [junit4]   2>        8       
/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2>        8       
/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2>        2       
/solr/overseer_elect/election/97424491556569121-127.0.0.1:47473_-n_0000000007
   [junit4]   2>        2       
/solr/overseer_elect/election/97424491556569115-127.0.0.1:48233_-n_0000000005
   [junit4]   2>        2       
/solr/overseer_elect/election/97424491556569096-127.0.0.1:35381_-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        99      /solr/overseer/queue
   [junit4]   2>        62      /solr/overseer/collection-queue-work
   [junit4]   2>        48      /solr/collections
   [junit4]   2>        46      /solr/live_nodes
   [junit4]   2>        22      /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 2210638 INFO  
(SUITE-CdcrReplicationDistributedZkTest-seed#[CB2E38BC6F8B6B3E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_CB2E38BC6F8B6B3E-001
   [junit4]   2> Feb 08, 2017 6:50:44 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{id=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Lucene70), 
id=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1581, 
maxMBSortInHeap=5.950283359822853, sim=RandomSimilarity(queryNorm=false): {}, 
locale=es-US, timezone=Europe/Samara
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_102 (64-bit)/cpus=4,threads=1,free=171431296,total=525860864
   [junit4]   2> NOTE: All tests run in this JVM: [SolrIndexSplitterTest, 
SpatialFilterTest, TestManagedSchemaThreadSafety, TestSearchPerf, 
MetricsHandlerTest, TestSurroundQueryParser, SampleTest, TestFiltering, 
ActionThrottleTest, ResponseHeaderTest, BasicFunctionalityTest, 
OpenExchangeRatesOrgProviderTest, TestFieldCollectionResource, 
TestPerFieldSimilarity, HdfsRestartWhileUpdatingTest, TestHashPartitioner, 
TestExportWriter, TestPartialUpdateDeduplication, SortByFunctionTest, 
TestJavabinTupleStreamParser, DistributedVersionInfoTest, 
TestConfigSetProperties, BigEndianAscendingWordSerializerTest, 
TestObjectReleaseTracker, DistributedTermsComponentTest, TestDistribIDF, 
TestCustomStream, CoreAdminRequestStatusTest, TestManagedResource, 
CdcrReplicationDistributedZkTest]
   [junit4] Completed [608/693 (2!)] on J1 in 1713.05s, 11 tests, 2 errors <<< 
FAILURES!

[...truncated 62656 lines...]



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org