Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-7.x/193/

5 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ZkControllerTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [Overseer] 
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.Overseer  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.cloud.Overseer.start(Overseer.java:545)  at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:850)
  at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) 
 at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)  
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)  at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:393)  at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2069)
  at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331)
  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [Overseer]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.Overseer
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.Overseer.start(Overseer.java:545)
        at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:850)
        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:393)
        at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2069)
        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331)
        at java.lang.Thread.run(Thread.java:748)


        at __randomizedtesting.SeedInfo.seed([5B9A4CE3EE626C9E]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:303)
        at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ZkControllerTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ZkControllerTest:     
1) Thread[id=21843, 
name=OverseerAutoScalingTriggerThread-73581053365780482-127.0.0.1:8983_solr-n_0000000001,
 state=RUNNABLE, group=Overseer autoscaling triggers]         at 
org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.write(TestRuleLimitSysouts.java:128)
         at java.io.PrintStream.write(PrintStream.java:480)         at 
org.apache.logging.log4j.core.util.CloseShieldOutputStream.write(CloseShieldOutputStream.java:53)
         at 
org.apache.logging.log4j.core.appender.OutputStreamManager.writeToDestination(OutputStreamManager.java:263)
         at 
org.apache.logging.log4j.core.appender.OutputStreamManager.flushBuffer(OutputStreamManager.java:295)
         at 
org.apache.logging.log4j.core.appender.OutputStreamManager.flush(OutputStreamManager.java:304)
         at 
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.directEncodeEvent(AbstractOutputStreamAppender.java:179)
         at 
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.tryAppend(AbstractOutputStreamAppender.java:170)
         at 
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:161)
         at 
org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:156)
         at 
org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:129)
         at 
org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:120)
         at 
org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:84)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:448)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:433)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)    
     at 
org.apache.logging.log4j.core.config.LoggerConfig.logParent(LoggerConfig.java:439)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:434)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)    
     at 
org.apache.logging.log4j.core.config.LoggerConfig.logParent(LoggerConfig.java:439)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:434)
         at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)    
     at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:403)    
     at 
org.apache.logging.log4j.core.config.DefaultReliabilityStrategy.log(DefaultReliabilityStrategy.java:49)
         at org.apache.logging.log4j.core.Logger.logMessage(Logger.java:146)    
     at 
org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2170)
         at 
org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2125)
         at 
org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2108)
         at 
org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2002)
         at 
org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1974)
         at org.apache.logging.slf4j.Log4jLogger.error(Log4jLogger.java:319)    
     at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:146)
         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.ZkControllerTest: 
   1) Thread[id=21843, 
name=OverseerAutoScalingTriggerThread-73581053365780482-127.0.0.1:8983_solr-n_0000000001,
 state=RUNNABLE, group=Overseer autoscaling triggers]
        at 
org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.write(TestRuleLimitSysouts.java:128)
        at java.io.PrintStream.write(PrintStream.java:480)
        at 
org.apache.logging.log4j.core.util.CloseShieldOutputStream.write(CloseShieldOutputStream.java:53)
        at 
org.apache.logging.log4j.core.appender.OutputStreamManager.writeToDestination(OutputStreamManager.java:263)
        at 
org.apache.logging.log4j.core.appender.OutputStreamManager.flushBuffer(OutputStreamManager.java:295)
        at 
org.apache.logging.log4j.core.appender.OutputStreamManager.flush(OutputStreamManager.java:304)
        at 
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.directEncodeEvent(AbstractOutputStreamAppender.java:179)
        at 
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.tryAppend(AbstractOutputStreamAppender.java:170)
        at 
org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:161)
        at 
org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:156)
        at 
org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:129)
        at 
org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:120)
        at 
org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:84)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:448)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:433)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.logParent(LoggerConfig.java:439)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:434)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.logParent(LoggerConfig.java:439)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:434)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)
        at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:403)
        at 
org.apache.logging.log4j.core.config.DefaultReliabilityStrategy.log(DefaultReliabilityStrategy.java:49)
        at org.apache.logging.log4j.core.Logger.logMessage(Logger.java:146)
        at 
org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2170)
        at 
org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2125)
        at 
org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2108)
        at 
org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2002)
        at 
org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1974)
        at org.apache.logging.slf4j.Log4jLogger.error(Log4jLogger.java:319)
        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:146)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([5B9A4CE3EE626C9E]:0)


FAILED:  org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:47928: ADDREPLICA failed to create replica

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:47928: ADDREPLICA failed to create replica
        at 
__randomizedtesting.SeedInfo.seed([5B9A4CE3EE626C9E:D3CE7339409E0166]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1106)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:886)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:819)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.BasicDistributedZkTest.testANewCollectionInOneInstanceWithManualShardAssignement(BasicDistributedZkTest.java:802)
        at 
org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:375)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest

Error Message:
3 threads leaked from SUITE scope at 
org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest:     1) Thread[id=32424, 
name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-HdfsBasicDistributedZkTest]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=32440, 
name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-HdfsBasicDistributedZkTest]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=32431, 
name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-HdfsBasicDistributedZkTest]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE 
scope at org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest: 
   1) Thread[id=32424, name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-HdfsBasicDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=32440, name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-HdfsBasicDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=32431, name=Connection evictor, state=TIMED_WAITING, 
group=TGRP-HdfsBasicDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([5B9A4CE3EE626C9E]:0)


FAILED:  org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
        at 
__randomizedtesting.SeedInfo.seed([5B9A4CE3EE626C9E:68286427E3D5B629]:0)
        at 
org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectField.<init>(DirectPostingsFormat.java:458)
        at 
org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectFields.<init>(DirectPostingsFormat.java:129)
        at 
org.apache.lucene.codecs.memory.DirectPostingsFormat.fieldsProducer(DirectPostingsFormat.java:113)
        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:292)
        at 
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:372)
        at 
org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:113)
        at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:78)
        at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:702)
        at org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:300)
        at 
org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:865)
        at 
org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit(TestDocTermOrds.java:188)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)




Build Log:
[...truncated 13883 lines...]
   [junit4] Suite: org.apache.solr.cloud.ZkControllerTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.ZkControllerTest_5B9A4CE3EE626C9E-001/init-core-data-001
   [junit4]   2> 2164446 WARN  
(SUITE-ZkControllerTest-seed#[5B9A4CE3EE626C9E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 2164449 INFO  
(SUITE-ZkControllerTest-seed#[5B9A4CE3EE626C9E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2164451 INFO  
(SUITE-ZkControllerTest-seed#[5B9A4CE3EE626C9E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 2164451 INFO  
(SUITE-ZkControllerTest-seed#[5B9A4CE3EE626C9E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2164490 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testGetHostName
   [junit4]   2> 2164490 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2164499 INFO  (Thread-10209) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2164499 INFO  (Thread-10209) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2164614 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:36183
   [junit4]   2> 2164705 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Exception causing close of session 0x0: ZooKeeperServer 
not running
   [junit4]   2> 2164720 ERROR (Thread-10209) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2166070 INFO  (zkConnectionManagerCallback-3364-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2166099 INFO  (zkConnectionManagerCallback-3366-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2166132 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@33da5775, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 2166159 INFO  (zkConnectionManagerCallback-3370-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2166326 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2166326 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:8983_solr
   [junit4]   2> 2166327 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=73581053092560898-127.0.0.1:8983_solr-n_0000000000) starting
   [junit4]   2> 2166426 INFO  (zkConnectionManagerCallback-3377-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2166428 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:36183/solr ready
   [junit4]   2> 2166450 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2166451 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=73581053092560898-127.0.0.1:8983_solr-n_0000000000) closing
   [junit4]   2> 2166452 INFO  
(OverseerStateUpdate-73581053092560898-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2166470 INFO  
(OverseerStateUpdate-73581053092560898-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:8983_solr
   [junit4]   2> 2166542 WARN  (OverseerExitThread) [    ] o.a.s.c.Overseer I'm 
exiting, but I'm still the leader
   [junit4]   2> 2166658 WARN  
(OverseerAutoScalingTriggerThread-73581053092560898-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed, 
exiting.
   [junit4]   2> 2166659 INFO  (zkCallback-3376-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2166692 INFO  (OverseerExitThread) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:8983_solr
   [junit4]   2> 2166694 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer Shutting down CoreContainer 
instance=765938241
   [junit4]   2> 2166694 ERROR 
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.SolrCores No transient handler has been 
defined. Check solr.xml to see if an attempt to provide a custom 
TransientSolrCoreCacheFactory was done incorrectly since the default should 
have been used otherwise.
   [junit4]   2> 2166694 ERROR 
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not 
registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN 
server state changes
   [junit4]   2> 2166699 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36183 
36183
   [junit4]   2> 2166835 INFO  (Thread-10209) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:36183 36183
   [junit4]   2> 2166842 WARN  (Thread-10209) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2>        2       /solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 2166843 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending testGetHostName
   [junit4]   2> 2166927 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Starting 
testNodeNameUrlConversion
   [junit4]   2> 2166928 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2166935 INFO  (Thread-10210) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2166935 INFO  (Thread-10210) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2166952 ERROR (Thread-10210) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2167035 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer start zk server on port:52877
   [junit4]   2> 2167167 INFO  (zkConnectionManagerCallback-3379-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2167267 INFO  (zkConnectionManagerCallback-3381-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2167311 INFO  (zkConnectionManagerCallback-3383-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2167664 ERROR (zkCallback-3382-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Error reading cluster properties from zookeeper
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /clusterprops.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:130) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:54) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1215) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:340)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:340) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.loadClusterProperties(ZkStateReader.java:937)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.lambda$new$4(ZkStateReader.java:929) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:269)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_152]
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_152]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_152]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_152]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]
   [junit4]   2> 2167664 ERROR 
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not 
registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN 
server state changes
   [junit4]   2> 2167667 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52877 
52877
   [junit4]   2> 2167798 INFO  (Thread-10210) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:52877 52877
   [junit4]   2> 2167802 WARN  (Thread-10210) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 2167803 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending 
testNodeNameUrlConversion
   [junit4]   2> 2167873 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Starting testReadConfigName
   [junit4]   2> 2167874 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2167874 INFO  (Thread-10211) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2167874 INFO  (Thread-10211) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2167875 ERROR (Thread-10211) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2167974 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer start zk server on port:37651
   [junit4]   2> 2168063 INFO  (zkConnectionManagerCallback-3389-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168202 WARN  (OverseerExitThread) [    ] o.a.s.c.Overseer 
Unable to rejoinElection 
   [junit4]   2> org.apache.solr.common.SolrException: Unable to rejoin election
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2072)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331)
 ~[java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]
   [junit4]   2> Caused by: 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer_elect
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:130) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:54) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1105) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$exists$2(SolrZkClient.java:304)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:304) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:438) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:425) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:839)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:393) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2069)
 ~[java/:?]
   [junit4]   2>        ... 2 more
   [junit4]   2> 2168207 INFO  (zkConnectionManagerCallback-3391-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168220 INFO  (zkConnectionManagerCallback-3393-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168232 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@33da5775, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 2168235 INFO  (zkConnectionManagerCallback-3397-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168388 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2168389 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:8983_solr
   [junit4]   2> 2168390 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=73581053312434179-127.0.0.1:8983_solr-n_0000000000) starting
   [junit4]   2> 2168399 INFO  (zkConnectionManagerCallback-3404-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168402 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:37651/solr ready
   [junit4]   2> 2168413 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2168415 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=73581053312434179-127.0.0.1:8983_solr-n_0000000000) closing
   [junit4]   2> 2168416 INFO  
(OverseerStateUpdate-73581053312434179-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:8983_solr
   [junit4]   2> 2168422 INFO  (zkCallback-3396-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2168422 WARN  
(OverseerAutoScalingTriggerThread-73581053312434179-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at java.lang.Object.wait(Native Method) ~[?:1.8.0_152]
   [junit4]   2>        at java.lang.Object.wait(Object.java:502) ~[?:1.8.0_152]
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1409) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1328) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:352)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:352) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.ZkDistribStateManager.setData(ZkDistribStateManager.java:146)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:136)
 [java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]
   [junit4]   2> 2168425 INFO  (zkCallback-3403-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2168440 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105699400e30004, likely client has closed socket
   [junit4]   2> 2168440 WARN  (OverseerExitThread) [    ] o.a.s.c.Overseer I'm 
exiting, but I'm still the leader
   [junit4]   2> 2168442 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105699400e30003, likely client has closed socket
   [junit4]   2> 2168442 WARN  (zkCallback-3396-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2168442 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer Shutting down CoreContainer 
instance=623953033
   [junit4]   2> 2168442 ERROR 
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.SolrCores No transient handler has been 
defined. Check solr.xml to see if an attempt to provide a custom 
TransientSolrCoreCacheFactory was done incorrectly since the default should 
have been used otherwise.
   [junit4]   2> 2168442 ERROR 
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not 
registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN 
server state changes
   [junit4]   2> 2168445 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37651 
37651
   [junit4]   2> 2168585 INFO  (Thread-10211) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:37651 37651
   [junit4]   2> 2168588 WARN  (Thread-10211) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2>        2       /solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 2168593 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending testReadConfigName
   [junit4]   2> 2168669 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Starting 
testPublishAndWaitForDownStates
   [junit4]   2> 2168678 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2168685 INFO  (Thread-10212) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2168688 INFO  (Thread-10212) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2168708 ERROR (Thread-10212) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2168789 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer start zk server on port:57361
   [junit4]   2> 2168825 INFO  (zkConnectionManagerCallback-3406-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168840 INFO  (zkConnectionManagerCallback-3408-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168856 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@33da5775, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 2168860 DEBUG 
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Added new OnReconnect listener 
org.apache.solr.cloud.ZkController$$Lambda$212/747992159@56ba571c
   [junit4]   2> 2168872 INFO  (zkConnectionManagerCallback-3412-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168975 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 2168975 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 2168975 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 2168976 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 2168976 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 2168976 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/security.json
   [junit4]   2> 2168979 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2168979 DEBUG 
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/73581053365780482-127.0.0.1:8983_solr-n_0000000000
   [junit4]   2> 2168980 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:8983_solr
   [junit4]   2> 2168980 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=73581053365780482-127.0.0.1:8983_solr-n_0000000000) starting
   [junit4]   2> 2168988 INFO  (zkConnectionManagerCallback-3419-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2168989 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/clusterprops.json
   [junit4]   2> 2168989 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 2168989 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/clusterstate.json
   [junit4]   2> 2168990 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 2168990 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: create/delete: /solr/aliases.json
   [junit4]   2> 2168990 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:57361/solr ready
   [junit4]   2> 2168992 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 2168993 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2168993 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2168993 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2168993 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2168993 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2168993 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2168994 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/collection-queue-work
   [junit4]   2> 2169003 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2169004 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 2169004 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/live_nodes
   [junit4]   2> 2169006 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/autoscaling.json
   [junit4]   2> 2169016 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue-work
   [junit4]   2> 2169017 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 2169017 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 2169017 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/collections
   [junit4]   2> 2169018 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 2169020 INFO  
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 2169020 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 2169021 DEBUG 
(TEST-ZkControllerTest.testPublishAndWaitForDownStates-seed#[5B9A4CE3EE626C9E]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:8983_solr as DOWN
   [junit4]   2> 2169044 INFO  (zkCallback-3418-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2169054 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/live_nodes
   [junit4]   2> 2169054 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 2169054 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 2169056 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: 
testPublishAndWaitForDownStates
   [junit4]   2> 2169056 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/testPublishAndWaitForDownStates/state.json
   [junit4]   2> 2169057 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 2169057 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/collections
   [junit4]   2> 2169057 INFO  
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testPublishAndWaitForDownStates",
   [junit4]   2>   "node_name":"non_existent_host1",
   [junit4]   2>   "collection":"testPublishAndWaitForDownStates",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "operation":"addreplica"} 
   [junit4]   2> 2169058 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 2169059 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{}}
   [junit4]   2> 2169059 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node21":{
   [junit4]   2>       "core":"testPublishAndWaitForDownStates",
   [junit4]   2>       "base_url":null,
   [junit4]   2>       "state":"active",
   [junit4]   2>       "node_name":"non_existent_host1",
   [junit4]   2>       "type":null}}}
   [junit4]   2> 2169059 INFO  
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testPublishAndWaitForDownStates",
   [junit4]   2>   "node_name":"non_existent_host2",
   [junit4]   2>   "collection":"testPublishAndWaitForDownStates",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "operation":"addreplica"} 
   [junit4]   2> 2169061 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.SliceMutator Old Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{"core_node21":{
   [junit4]   2>       "core":"testPublishAndWaitForDownStates",
   [junit4]   2>       "base_url":null,
   [junit4]   2>       "state":"active",
   [junit4]   2>       "node_name":"non_existent_host1",
   [junit4]   2>       "type":null}}}
   [junit4]   2> 2169061 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.SliceMutator New Slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node21":{
   [junit4]   2>       "core":"testPublishAndWaitForDownStates",
   [junit4]   2>       "base_url":null,
   [junit4]   2>       "state":"active",
   [junit4]   2>       "node_name":"non_existent_host1",
   [junit4]   2>       "type":null},
   [junit4]   2>     "core_node22":{
   [junit4]   2>       "core":"testPublishAndWaitForDownStates",
   [junit4]   2>       "base_url":null,
   [junit4]   2>       "state":"down",
   [junit4]   2>       "node_name":"non_existent_host2",
   [junit4]   2>       "type":null}}}
   [junit4]   2> 2169161 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:8983_solr
   [junit4]   2> 2169162 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 2169162 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 2169164 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/testPublishAndWaitForDownStates/state.json
   [junit4]   2> 2169263 DEBUG 
(OverseerStateUpdate-73581053365780482-127.0.0.1:8983_solr-n_0000000000) [    ] 
o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/testPublishAndWaitForDownStates/state.json version: 0
   [junit4]   2> 2169263 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: data: /solr/collections/testPublishAndWaitForDownStates/state.json
   [junit4]   2> 2169264 INFO  (zkCallback-3411-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/testPublishAndWaitForDownStates/state.json] for collection 
[testPublishAndWaitForDownStates] has occurred - updating... (live nodes size: 
[1])
   [junit4]   2> 2169264 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: data: /solr/collections/testPublishAndWaitForDownStates/state.json
   [junit4]   2> 2169264 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
fired: children: /solr/overseer/queue
   [junit4]   2> 2169265 DEBUG (SyncThread:0) [    ] o.a.s.c.ZkTestServer Watch 
added: children: /solr/overseer/queue
   [junit4]   2> 2169941 WARN  (OverseerExitThread) [    ] o.a.s.c.Overseer 
Unable to rejoinElection 
   [junit4]   2> org.apache.solr.common.SolrException: Unable to rejoin election
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2072)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331)
 ~[java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]
   [junit4]   2> Caused by: 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer_elect/election
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:130) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:54) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1535) 
~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:328)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:393) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2069)
 ~[java/:?]
   [junit4]   2>        ... 2 more
   [junit4]   2> 2170994 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2170995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2170995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2170995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2170995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2170995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2170995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2172995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2172995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2172995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2172995 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2172996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2172996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2172996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2174996 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2176997 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2176998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2176998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2176998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2176998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2176998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2176998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2178998 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2178999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2178999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2178999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2178999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2178999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2178999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2180999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2180999 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2181000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2181000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2181000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2181000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2181000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2183000 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2185001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2187001 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2187002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2187002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2187002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2187002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2187002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2187002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2189002 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2189003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2189003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2189003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2189003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2189003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2189003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2191003 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2193005 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2193006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2193006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2193006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2193006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2193006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2193006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2195006 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2195007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2195007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2195007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2195007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2195007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2195007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2197007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2197007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2197007 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2197008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2197008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2197008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2197008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2199008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2201008 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2201009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2201009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2201009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2201009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2201009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2201009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2203009 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2203010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2203010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2203010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2203010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2203010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2203010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2205010 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2205011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2205011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2205011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2205011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2205011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2205011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2207011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2207011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2207011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2207011 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2207012 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2207012 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2207012 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2209012 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2209013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2209013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2209013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2209013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2209013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2209013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2211013 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2211014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2211014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2211014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2211014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2211014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2211014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2213014 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 2215015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskQueue Peeking for top 100 elements. ExcludeSet: []
   [junit4]   2> 2217015 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 2217016 DEBUG 
(OverseerCollectionConfigSetProcessor-73581053365780482-127.0.0.1:8983_solr-n_

[...truncated too long message...]

SegmentReader.<init>(SegmentReader.java:78)
   [junit4]    >        at 
org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:702)
   [junit4]    >        at 
org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:300)
   [junit4]    >        at 
org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:865)
   [junit4]    >        at 
org.apache.solr.uninverting.TestDocTermOrds.testTriggerUnInvertLimit(TestDocTermOrds.java:188)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{field=PostingsFormat(name=Direct), foo=PostingsFormat(name=Direct), 
id=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=554, 
maxMBSortInHeap=7.066167841094184, sim=RandomSimilarity(queryNorm=true): 
{field=DFR I(ne)LZ(0.3)}, locale=en-CA, timezone=Mexico/BajaSur
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 
1.8.0_152 (64-bit)/cpus=4,threads=1,free=327265640,total=477626368
   [junit4]   2> NOTE: All tests run in this JVM: [InfoHandlerTest, 
TestDistribDocBasedVersion, ClassificationUpdateProcessorIntegrationTest, 
MetricTriggerIntegrationTest, TestCSVResponseWriter, 
AutoAddReplicasPlanActionTest, SimpleFacetsTest, TestReplicationHandlerBackup, 
TestIndexSearcher, PreAnalyzedUpdateProcessorTest, HdfsRecoverLeaseTest, 
TestCollectionsAPIViaSolrCloudCluster, TestHdfsUpdateLog, 
TestLeaderInitiatedRecoveryThread, TestRuleBasedAuthorizationPlugin, TestSort, 
SynonymTokenizerTest, SolrMetricReporterTest, ConfigSetsAPITest, 
TestSolrCloudSnapshots, ExitableDirectoryReaderTest, TestFilteredDocIdSet, 
PluginInfoTest, TestLRUStatsCache, TestXmlQParser, TestAddFieldRealTimeGet, 
UpdateParamsTest, TestConfigReload, MetricsConfigTest, TestSegmentSorting, 
CreateRoutedAliasTest, TestNestedDocsSort, TestStressLiveNodes, 
TestSchemaResource, TestRebalanceLeaders, ImplicitSnitchTest, 
TestSimpleTextCodec, SecurityConfHandlerTest, 
DistributedFacetPivotLongTailTest, MissingSegmentRecoveryTest, 
TestApiFramework, MetricUtilsTest, NodeAddedTriggerTest, 
DefaultValueUpdateProcessorTest, TestNRTOpen, NodeMarkersRegistrationTest, 
DistributedExpandComponentTest, TestMissingGroups, TestHashPartitioner, 
HighlighterConfigTest, ChaosMonkeyNothingIsSafeTest, TestLegacyFieldReuse, 
TestFieldTypeCollectionResource, SolrRequestParserTest, 
TestSubQueryTransformer, TestSkipOverseerOperations, TestIBSimilarityFactory, 
TestCoreAdminApis, TestDocSet, FieldAnalysisRequestHandlerTest, 
BooleanFieldTest, SolrCoreCheckLockOnStartupTest, FullSolrCloudDistribCmdsTest, 
TestOverriddenPrefixQueryForCustomFieldType, TestPullReplicaErrorHandling, 
TestClassicSimilarityFactory, AliasIntegrationTest, TestWriterPerf, 
V2StandaloneTest, PKIAuthenticationIntegrationTest, TestQuerySenderNoQuery, 
HdfsSyncSliceTest, TestOmitPositions, TestFieldCache, CdcrBidirectionalTest, 
TestClusterStateProvider, OverseerModifyCollectionTest, SolrIndexSplitterTest, 
TestManagedResource, EchoParamsTest, TestConfigSetProperties, 
TestIndexingPerformance, TestBackupRepositoryFactory, 
TestCloudPseudoReturnFields, HdfsUnloadDistributedZkTest, 
UUIDUpdateProcessorFallbackTest, TestFileDictionaryLookup, 
TestManagedSynonymFilterFactory, TestSolrCLIRunExample, DebugComponentTest, 
RequestHandlersTest, ZkShardTermsTest, IndexBasedSpellCheckerTest, 
DeleteNodeTest, TestPHPSerializedResponseWriter, TestHalfAndHalfDocValues, 
TestGeoJSONResponseWriter, TestUseDocValuesAsStored2, 
TestTrackingShardHandlerFactory, TestIntervalFaceting, TestJoin, 
TestDistribIDF, WrapperMergePolicyFactoryTest, CdcrUpdateLogTest, 
DocumentAnalysisRequestHandlerTest, TestExclusionRuleCollectionAccess, 
BinaryUpdateRequestHandlerTest, TestEmbeddedSolrServerConstructors, 
TestMaxTokenLenTokenizer, CleanupOldIndexTest, 
OpenExchangeRatesOrgProviderTest, BlockCacheTest, TestLuceneMatchVersion, 
TestReplicaProperties, TestClusterProperties, TestLegacyFieldCache, 
TestExpandComponent, ConcurrentDeleteAndCreateCollectionTest, 
HdfsChaosMonkeyNothingIsSafeTest, OutputWriterTest, TestNamedUpdateProcessors, 
TriLevelCompositeIdRoutingTest, TestOnReconnectListenerSupport, 
TestBinaryResponseWriter, RegexBytesRefFilterTest, SpellingQueryConverterTest, 
TestManagedSchemaThreadSafety, ZkNodePropsTest, TestMinMaxOnMultiValuedField, 
CdcrReplicationHandlerTest, TestFieldCacheSortRandom, BasicDistributedZkTest, 
ChaosMonkeySafeLeaderTest, SyncSliceTest, OpenCloseCoreStressTest, 
OverseerTest, ShardRoutingTest, ShardRoutingCustomTest, 
TestDistributedGrouping, TestRecovery, TestStressReorder, TestStressVersions, 
DistributedTermsComponentTest, StatsComponentTest, SolrCmdDistributorTest, 
TestFiltering, DirectUpdateHandlerTest, TestBadConfig, HighlighterTest, 
DistributedQueryElevationComponentTest, SimplePostToolTest, TestCoreDiscovery, 
AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, SpellCheckCollatorTest, 
SuggesterFSTTest, SuggesterTest, TestStressLucene, TestTrie, SuggesterWFSTTest, 
TestCSVLoader, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, 
TestUpdate, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, 
QueryEqualityTest, SortByFunctionTest, TestRemoteStreaming, 
DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, 
XsltUpdateRequestHandlerTest, CacheHeaderTest, TestSurroundQueryParser, 
LukeRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, 
TestQueryTypes, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, 
TermsComponentTest, XmlUpdateRequestHandlerTest, RequiredFieldsTest, 
TestSolrQueryParser, FastVectorHighlighterTest, LoggingHandlerTest, 
SolrPluginUtilsTest, IndexSchemaTest, TestCollationField, 
UpdateRequestProcessorFactoryTest, MBeansHandlerTest, TestAnalyzedSuggestions, 
UniqFieldsUpdateProcessorFactoryTest, TestComponentsName, TestSolrIndexConfig, 
ResponseLogComponentTest, SolrIndexConfigTest, TestMergePolicyConfig, 
MultiTermTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, 
TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, 
ExternalFileFieldSortTest, TestPostingsSolrHighlighter, 
NotRequiredUniqueKeyTest, SpellPossibilityIteratorTest, TestCharFilters, 
TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, 
TestLMJelinekMercerSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, 
TestFastOutputStream, TestFastLRUCache, PrimUtilsTest, 
TestSuggestSpellingConverter, ClusterStateTest, TestUtils, SliceStateTest, 
TestRTGBase, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, 
TestDistributedMissingSort, TestEmbeddedSolrServerAdminHandler, 
TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, 
ChaosMonkeyNothingIsSafeWithPullReplicasTest, HttpPartitionTest, 
LIROnShardRestartTest, RemoteQueryErrorTest, SharedFSAutoReplicaFailoverTest, 
SolrCLIZkUtilsTest, SolrXmlInZkTest, TestAuthenticationFramework, 
TestCloudConsistency, TestCloudInspectUtil, TestCloudSearcherWarming, 
TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, 
TestMiniSolrCloudClusterSSL, TestSSLRandomization, 
TestSizeLimitedDistributedMap, TestSolrCloudWithSecureImpersonation, 
TestTolerantUpdateProcessorCloud, TestTolerantUpdateProcessorRandomCloud, 
TestUtilizeNode, VMParamsZkACLAndCredentialsProvidersTest, ZkFailoverTest, 
CustomCollectionTest, TestHdfsCloudBackupRestore, 
AutoAddReplicasIntegrationTest, ExecutePlanActionTest, SystemLogListenerTest, 
TriggerSetPropertiesIntegrationTest, CdcrReplicationDistributedZkTest, 
CdcrVersionReplicationTest, HDFSCollectionsAPITest, RuleEngineTest, RulesTest, 
ConfigureRecoveryStrategyTest, CoreSorterTest, TestCorePropertiesReload, 
TestCustomStream, ResponseBuilderTest, SearchHandlerTest, 
TestHdfsBackupRestoreCore, TestSolrConfigHandlerConcurrent, 
TestSystemCollAutoCreate, DistributedFacetPivotWhiteBoxTest, 
ReplicaListTransformerTest, ShufflingReplicaListTransformerTest, 
SpatialHeatmapFacetsTest, SolrSlf4jReporterTest, TestGraphMLResponseWriter, 
TestRawTransformer, TestDynamicFieldCollectionResource, TestFieldTypeResource, 
TestSerializedLuceneMatchVersion, CurrencyFieldTypeTest, DateRangeFieldTest, 
EnumFieldTest, ManagedSchemaRoundRobinCloudTest, TestCollationFieldDocValues, 
TestManagedSchemaAPI, TestPointFields, AnalyticsQueryTest, 
CurrencyRangeFacetCloudTest, RankQueryTest, TestComplexPhraseQParserPlugin, 
TestCustomSort, TestHashQParserPlugin, TestNoOpRegenerator, 
TestPayloadScoreQParserPlugin, TestReRankQParserPlugin, TestSearcherReuse, 
TestSmileRequest, TestSolr4Spatial2, TestSolrCoreParser, 
TestSolrFieldCacheBean, TestStandardQParsers, TestStressUserVersions, 
TestXmlQParserPlugin, TestJsonFacetRefinement, TestJsonFacets, 
BlockJoinFacetSimpleTest, TestCloudNestedDocsSort, TestJsonRequest, 
TestExactStatsCache, TestPKIAuthenticationPlugin, TestDelegationWithHadoopAuth, 
TestZkAclsWithHadoopAuth, HttpSolrCallGetCoreTest, BlockDirectoryTest, 
TestDocTermOrds]
   [junit4] Completed [793/794 (3!)] on J0 in 179.32s, 10 tests, 1 error <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J0: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/solr/build/solr-core/test/temp/junit4-J0-20180406_052114_6868429182722461103422.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/heapdumps/java_pid29767.hprof
 ...
   [junit4] Heap dump file created [474638649 bytes in 1.669 secs]
   [junit4] <<< JVM J0: EOF ----

[...truncated 9288 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:651:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-7.x/checkout/build.xml:585:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid29767.hprof

Total time: 249 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to