[JENKINS-EA] Lucene-Solr-6.6-Windows (64bit/jdk-9-ea+181) - Build # 20 - Failure!

Policeman Jenkins Server Sat, 19 Aug 2017 09:54:21 -0700

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.6-Windows/20/
Java: 64bit/jdk-9-ea+181 -XX:-UseCompressedOops -XX:+UseParallelGC 
--illegal-access=deny


6 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithDelegationTokens

Error Message:
Error starting up MiniSolrCloudCluster

Stack Trace:
java.lang.Exception: Error starting up MiniSolrCloudCluster
        at __randomizedtesting.SeedInfo.seed([8836E8E0023354F0]:0)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.checkForExceptions(MiniSolrCloudCluster.java:575)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:255)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:199)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:126)
        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.startup(TestSolrCloudWithDelegationTokens.java:70)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)
        Suppressed: java.lang.ExceptionInInitializerError
                at 
org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
                at 
org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:1437)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenManager.<init>(DelegationTokenManager.java:115)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.initTokenManager(DelegationTokenAuthenticationHandler.java:148)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.init(DelegationTokenAuthenticationHandler.java:118)
                at 
org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler.init(HttpParamDelegationTokenPlugin.java:185)
                at 
org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeAuthHandler(AuthenticationFilter.java:238)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.initializeAuthHandler(DelegationTokenAuthenticationFilter.java:209)
                at 
org.apache.solr.security.DelegationTokenKerberosFilter.initializeAuthHandler(DelegationTokenKerberosFilter.java:148)
                at 
org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:227)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:175)
                at 
org.apache.solr.security.DelegationTokenKerberosFilter.init(DelegationTokenKerberosFilter.java:77)
                at 
org.apache.solr.security.HttpParamDelegationTokenPlugin.init(HttpParamDelegationTokenPlugin.java:142)
                at 
org.apache.solr.core.CoreContainer.initializeAuthenticationPlugin(CoreContainer.java:346)
                at 
org.apache.solr.core.CoreContainer.reloadSecurityProperties(CoreContainer.java:627)
                at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:491)
                at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
                at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
                at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
                at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
                at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
                at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
                at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
                at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
                at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
                at 
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
                at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
                at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
                at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
                ... 1 more
        Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3, 
length 1
                at 
java.base/java.lang.String.checkBoundsBeginEnd(String.java:3116)
                at java.base/java.lang.String.substring(String.java:1885)
                at org.apache.hadoop.util.Shell.<clinit>(Shell.java:51)
                ... 37 more
        Suppressed: java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.util.StringUtils
                at 
org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:1437)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenManager.<init>(DelegationTokenManager.java:115)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.initTokenManager(DelegationTokenAuthenticationHandler.java:148)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.init(DelegationTokenAuthenticationHandler.java:118)
                at 
org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler.init(HttpParamDelegationTokenPlugin.java:185)
                at 
org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeAuthHandler(AuthenticationFilter.java:238)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.initializeAuthHandler(DelegationTokenAuthenticationFilter.java:209)
                at 
org.apache.solr.security.DelegationTokenKerberosFilter.initializeAuthHandler(DelegationTokenKerberosFilter.java:148)
                at 
org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:227)
                at 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:175)
                at 
org.apache.solr.security.DelegationTokenKerberosFilter.init(DelegationTokenKerberosFilter.java:77)
                at 
org.apache.solr.security.HttpParamDelegationTokenPlugin.init(HttpParamDelegationTokenPlugin.java:142)
                at 
org.apache.solr.core.CoreContainer.initializeAuthenticationPlugin(CoreContainer.java:346)
                at 
org.apache.solr.core.CoreContainer.reloadSecurityProperties(CoreContainer.java:627)
                at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:491)
                at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
                at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
                at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
                at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
                at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
                at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
                at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
                at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
                at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
                at 
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
                at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
                at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
                at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
                ... 1 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithDelegationTokens

Error Message:


Stack Trace:
java.lang.NullPointerException
        at __randomizedtesting.SeedInfo.seed([8836E8E0023354F0]:0)
        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.shutdown(TestSolrCloudWithDelegationTokens.java:87)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithDelegationTokens

Error Message:
ObjectTracker found 5 object(s) that were not released!!! [Overseer, 
SolrZkClient, ZkController, ZkController, SolrZkClient] 
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.Overseer  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.cloud.Overseer.start(Overseer.java:526)  at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:754)
  at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) 
 at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)  
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)  at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216)  at 
org.apache.solr.cloud.ZkController.init(ZkController.java:688)  at 
org.apache.solr.cloud.ZkController.<init>(ZkController.java:423)  at 
org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)  at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
  at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)  
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  
at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
  at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
  at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
  at java.base/java.lang.Thread.run(Thread.java:844)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.common.cloud.SolrZkClient  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)  
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at 
org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)  at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
  at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)  
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  
at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
  at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
  at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
  at java.base/java.lang.Thread.run(Thread.java:844)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.ZkController  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at 
org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)  at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
  at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)  
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  
at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
  at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
  at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
  at java.base/java.lang.Thread.run(Thread.java:844)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.ZkController  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at 
org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)  at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
  at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)  
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  
at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
  at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
  at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
  at java.base/java.lang.Thread.run(Thread.java:844)  
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.common.cloud.SolrZkClient  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)  
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at 
org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)  at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
  at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)  
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  
at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
  at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
  at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
  at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
  at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
  at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
  at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
  at java.base/java.lang.Thread.run(Thread.java:844)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 5 object(s) that were not 
released!!! [Overseer, SolrZkClient, ZkController, ZkController, SolrZkClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.Overseer
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.Overseer.start(Overseer.java:526)
        at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:754)
        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216)
        at org.apache.solr.cloud.ZkController.init(ZkController.java:688)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:423)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)
        at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
        at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
        at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base/java.lang.Thread.run(Thread.java:844)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.common.cloud.SolrZkClient
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at 
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)
        at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
        at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
        at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base/java.lang.Thread.run(Thread.java:844)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.ZkController
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)
        at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
        at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
        at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base/java.lang.Thread.run(Thread.java:844)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.ZkController
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)
        at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
        at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
        at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base/java.lang.Thread.run(Thread.java:844)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.common.cloud.SolrZkClient
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at 
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:485)
        at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:244)
        at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:173)
        at 
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:388)
        at 
org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:251)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base/java.lang.Thread.run(Thread.java:844)


        at __randomizedtesting.SeedInfo.seed([8836E8E0023354F0]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:302)
        at jdk.internal.reflect.GeneratedMethodAccessor25.invoke(Unknown Source)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithDelegationTokens

Error Message:
56 threads leaked from SUITE scope at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens:     1) 
Thread[id=19355, 
name=org.eclipse.jetty.server.session.HashSessionManager@4f11ba0aTimer, 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    2) 
Thread[id=19394, name=Curator-Framework-0, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.DelayQueue.take(DelayQueue.java:229)         
at java.base@9/java.util.concurrent.DelayQueue.take(DelayQueue.java:77)         
at 
app//org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:780)
         at 
app//org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:62)
         at 
app//org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:257)
         at 
java.base@9/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    3) 
Thread[id=19358, name=qtp470378825-19358, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    4) 
Thread[id=19399, name=zkCallback-3065-thread-4, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    5) 
Thread[id=19386, 
name=OverseerHdfsCoreFailoverThread-98511157163065349-127.0.0.1:55731_solr-n_0000000000,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.base@9/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    6) 
Thread[id=19369, name=solr-idle-connections-evictor, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    7) 
Thread[id=19409, name=zkCallback-3066-thread-8, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    8) 
Thread[id=19336, name=qtp470378825-19336, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)    9) 
Thread[id=19338, name=qtp470378825-19338, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   10) 
Thread[id=19380, name=jetty-launcher-3054-thread-1-SendThread(127.0.0.1:55724), 
state=RUNNABLE, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)     
    at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
         at 
java.base@9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)       
  at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         
at 
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)   11) 
Thread[id=19356, name=qtp1581418815-19356, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   12) 
Thread[id=19345, name=qtp1581418815-19345, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   13) 
Thread[id=19352, 
name=qtp1581418815-19352-acceptor-0@7a1b61e2-ServerConnector@1991bb9a{HTTP/1.1,[http/1.1]}{127.0.0.1:55731},
 state=RUNNABLE, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         
at 
java.base@9/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)
         at 
java.base@9/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)
         at 
app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)  
       at 
app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   14) 
Thread[id=19401, name=zkCallback-3065-thread-6, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   15) 
Thread[id=19413, name=Curator-Framework-0-EventThread, state=WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)   
      at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
         at 
java.base@9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
         at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   16) 
Thread[id=19381, name=jetty-launcher-3054-thread-1-EventThread, state=WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)   
      at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
         at 
java.base@9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
         at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   17) 
Thread[id=19410, name=Curator-Framework-0-SendThread(127.0.0.1:55724), 
state=RUNNABLE, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)     
    at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
         at 
java.base@9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)       
  at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         
at 
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)   18) 
Thread[id=19342, 
name=qtp470378825-19342-acceptor-0@f9178e9-ServerConnector@3ae7368{HTTP/1.1,[http/1.1]}{127.0.0.1:55728},
 state=RUNNABLE, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         
at 
java.base@9/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)
         at 
java.base@9/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)
         at 
app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)  
       at 
app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   19) 
Thread[id=19354, name=Scheduler-5466217, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   20) 
Thread[id=19402, name=zkCallback-3065-thread-7, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   21) 
Thread[id=19349, 
name=org.eclipse.jetty.server.session.HashSessionManager@59554e5Timer, 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   22) 
Thread[id=19383, name=zkCallback-3065-thread-1, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   23) 
Thread[id=19393, name=Curator-Framework-0, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.DelayQueue.take(DelayQueue.java:229)         
at java.base@9/java.util.concurrent.DelayQueue.take(DelayQueue.java:77)         
at 
app//org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:780)
         at 
app//org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:62)
         at 
app//org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:257)
         at 
java.base@9/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   24) 
Thread[id=19378, name=jetty-launcher-3054-thread-2-SendThread(127.0.0.1:55724), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)   25) 
Thread[id=19400, name=zkCallback-3065-thread-5, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   26) 
Thread[id=19337, name=qtp470378825-19337, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   27) 
Thread[id=19364, name=qtp470378825-19364, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   28) 
Thread[id=19365, name=qtp1581418815-19365, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   29) 
Thread[id=19385, 
name=OverseerCollectionConfigSetProcessor-98511157163065349-127.0.0.1:55731_solr-n_0000000000,
 state=TIMED_WAITING, group=Overseer collection creation process.]         at 
java.base@9/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
         at 
app//org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
         at 
app//org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)   
      at 
app//org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:387)
         at 
app//org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:193)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   30) 
Thread[id=19404, name=zkCallback-3066-thread-3, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   31) 
Thread[id=19344, name=Scheduler-227657479, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   32) 
Thread[id=19347, name=qtp1581418815-19347, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   33) 
Thread[id=19357, name=qtp1581418815-19357, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   34) 
Thread[id=19373, name=solr-idle-connections-evictor, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   35) 
Thread[id=19412, name=Curator-Framework-0-SendThread(127.0.0.1:55724), 
state=RUNNABLE, group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)     
    at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
         at 
java.base@9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)       
  at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         
at 
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)   36) 
Thread[id=19359, name=qtp470378825-19359, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   37) 
Thread[id=19370, name=solr-idle-connections-evictor, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/java.lang.Thread.sleep(Native Method)         at 
app//org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   38) 
Thread[id=19407, name=zkCallback-3066-thread-6, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   39) 
Thread[id=19396, name=pool-6-thread-1, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   40) 
Thread[id=19343, name=qtp470378825-19343, state=RUNNABLE, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)     
    at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
         at 
java.base@9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)       
  at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         
at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
         at 
app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
         at 
app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
         at 
app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
         at 
app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         
at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   41) 
Thread[id=19346, name=qtp1581418815-19346, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   42) 
Thread[id=19403, name=zkCallback-3066-thread-2, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   43) 
Thread[id=19379, name=jetty-launcher-3054-thread-2-EventThread, state=WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)   
      at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
         at 
java.base@9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
         at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   44) 
Thread[id=19388, name=Curator-ConnectionStateManager-0, state=WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)   
      at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
         at 
java.base@9/java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:417)
         at 
app//org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
         at 
app//org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
         at 
app//org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
         at 
java.base@9/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   45) 
Thread[id=19395, name=pool-5-thread-1, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)
         at 
java.base@9/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   46) 
Thread[id=19398, name=zkCallback-3065-thread-3, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   47) 
Thread[id=19411, name=Curator-Framework-0-EventThread, state=WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)   
      at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
         at 
java.base@9/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
         at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   48) 
Thread[id=19408, name=zkCallback-3066-thread-7, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   49) 
Thread[id=19382, name=zkCallback-3066-thread-1, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   50) 
Thread[id=19405, name=zkCallback-3066-thread-4, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   51) 
Thread[id=19387, name=Curator-ConnectionStateManager-0, state=WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)   
      at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
         at 
java.base@9/java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:417)
         at 
app//org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
         at 
app//org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
         at 
app//org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
         at 
java.base@9/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   52) 
Thread[id=19406, name=zkCallback-3066-thread-5, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   53) 
Thread[id=19397, name=zkCallback-3065-thread-2, state=TIMED_WAITING, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
         at 
java.base@9/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
         at 
java.base@9/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
         at 
java.base@9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
         at java.base@9/java.lang.Thread.run(Thread.java:844)   54) 
Thread[id=19384, 
name=OverseerStateUpdate-98511157163065349-127.0.0.1:55731_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]         at 
java.base@9/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@9/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
         at 
java.base@9/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
         at 
app//org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:165)     
    at 
app//org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:139)     
    at 
app//org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:183)  
       at java.base@9/java.lang.Thread.run(Thread.java:844)   55) 
Thread[id=19353, name=qtp1581418815-19353, state=RUNNABLE, 
group=TGRP-TestSolrCloudWithDelegationTokens]         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)     
    at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
         at 
java.base@9/sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
         at 
java.base@9/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)       
  at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         
at java.base@9/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
         at 
app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
         at app//org.eclipse.jetty.ut

[...truncated too long message...]

e org.apache.solr.core.SolrCore@458b7850
   [junit4]   2> 137120 INFO  (coreCloseExecutor-342-thread-3) [    ] 
o.a.s.c.SolrCore [testcollection_shard2_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@531a8dcc
   [junit4]   2> 137120 INFO  (coreCloseExecutor-342-thread-2) [    ] 
o.a.s.c.SolrCore [currentstate_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@492578bd
   [junit4]   2> 137120 INFO  (coreCloseExecutor-342-thread-1) [    ] 
o.a.s.c.SolrCore [falsepredicate_shard4_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@4c0c57a2
   [junit4]   2> 137122 INFO  (coreCloseExecutor-344-thread-1) [    ] 
o.a.s.c.SolrCore [falsepredicate_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@7cbfd1ae
   [junit4]   2> 137122 INFO  (coreCloseExecutor-344-thread-2) [    ] 
o.a.s.c.SolrCore [testcollection_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5b65b526
   [junit4]   2> 137122 INFO  (coreCloseExecutor-343-thread-1) [    ] 
o.a.s.c.SolrCore [falsepredicate_shard3_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5ef8bbef
   [junit4]   2> 137122 INFO  (coreCloseExecutor-343-thread-2) [    ] 
o.a.s.c.SolrCore [testcollection_shard4_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@4cd3daca
   [junit4]   2> 137126 INFO  (coreCloseExecutor-342-thread-4) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.delayed.shard1.replica1
   [junit4]   2> 137126 INFO  (coreCloseExecutor-342-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.currentstate.shard1.replica1
   [junit4]   2> 137126 INFO  (coreCloseExecutor-341-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.stateformat1.shard1.replica1
   [junit4]   2> 137126 INFO  (coreCloseExecutor-342-thread-3) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.testcollection.shard2.replica1
   [junit4]   2> 137126 INFO  (coreCloseExecutor-342-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.falsepredicate.shard4.replica1
   [junit4]   2> 137128 INFO  (coreCloseExecutor-343-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.testcollection.shard4.replica1
   [junit4]   2> 137129 INFO  (coreCloseExecutor-342-thread-5) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.waitforstate.shard1.replica1
   [junit4]   2> 137129 INFO  (coreCloseExecutor-344-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.falsepredicate.shard1.replica1
   [junit4]   2> 137129 INFO  (coreCloseExecutor-344-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.testcollection.shard1.replica1
   [junit4]   2> 137129 INFO  (coreCloseExecutor-343-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for: 
solr.core.falsepredicate.shard3.replica1
   [junit4]   2> 137133 INFO  (zkCallback-113-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 137133 INFO  (zkCallback-134-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 137133 INFO  (zkCallback-128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 137135 WARN  (zkCallback-128-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 137135 INFO  (zkCallback-134-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 137135 INFO  (zkCallback-113-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 137137 INFO  (jetty-closer-93-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@117e68b7{/solr,null,UNAVAILABLE}
   [junit4]   2> 137138 INFO  (jetty-closer-93-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=98511170756018188-127.0.0.1:59255_solr-n_0000000001) closing
   [junit4]   2> 137138 INFO  
(OverseerStateUpdate-98511170756018188-127.0.0.1:59255_solr-n_0000000001) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:59255_solr
   [junit4]   2> 137138 WARN  (zkCallback-134-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 137142 INFO  (zkCallback-113-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 137143 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x15dfb634b52000c, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 137143 WARN  (zkCallback-113-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 137143 INFO  (jetty-closer-93-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2d2e4fc4{/solr,null,UNAVAILABLE}
   [junit4]   2> 138633 WARN  (zkCallback-145-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 138633 INFO  (jetty-closer-93-thread-4) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6f1919f0{/solr,null,UNAVAILABLE}
   [junit4]   2> 138639 INFO  (jetty-closer-93-thread-3) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7dfdf25{/solr,null,UNAVAILABLE}
   [junit4]   2> 138640 ERROR 
(SUITE-TestCollectionStateWatchers-seed#[E7E45103A974A256]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 138641 INFO  
(SUITE-TestCollectionStateWatchers-seed#[E7E45103A974A256]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:59250 59250
   [junit4]   2> 138641 INFO  (Thread-130) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:59250 59250
   [junit4]   2> 138642 WARN  (Thread-130) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        8       /solr/aliases.json
   [junit4]   2>        8       /solr/clusterprops.json
   [junit4]   2>        7       /solr/security.json
   [junit4]   2>        7       /solr/configs/config
   [junit4]   2>        3       /solr/collections/stateformat1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        17      /solr/collections/falsepredicate/state.json
   [junit4]   2>        12      /solr/collections/waitforstate/state.json
   [junit4]   2>        8       /solr/clusterstate.json
   [junit4]   2>        7       /solr/collections/testcollection/state.json
   [junit4]   2>        3       /solr/collections/stateformat1/state.json
   [junit4]   2>        3       
/solr/overseer_elect/election/98511170756018188-127.0.0.1:59255_solr-n_0000000001
   [junit4]   2>        2       /solr/collections/currentstate/state.json
   [junit4]   2>        2       /solr/collections/delayed/state.json
   [junit4]   2>        2       /solr/collections/tobedeleted/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        8       /solr/collections
   [junit4]   2>        5       /solr/live_nodes
   [junit4]   2>        2       /solr/overseer/queue
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 138643 INFO  
(SUITE-TestCollectionStateWatchers-seed#[E7E45103A974A256]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
C:\Users\jenkins\workspace\Lucene-Solr-6.6-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestCollectionStateWatchers_E7E45103A974A256-001
   [junit4]   2> Aug 19, 2017 4:47:11 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=lo, 
timezone=Asia/Ulan_Bator
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9 
(64-bit)/cpus=3,threads=1,free=105995568,total=332922880
   [junit4]   2> NOTE: All tests run in this JVM: 
[ConcurrentUpdateSolrClientTest, CoalesceEvaluatorTest, 
SelectWithEvaluatorsTest, TestFastInputStream, SolrQueryTest, 
CloudSolrClientTest, SolrExceptionTest, CommonAdminParamsTest, 
EqualsEvaluatorTest, NotEvaluatorTest, TestUpdateRequestCodec, 
HyperbolicCosineEvaluatorTest, SolrExampleJettyTest, SolrExampleBinaryTest, 
MultiplyEvaluatorTest, PowerEvaluatorTest, QueryResponseTest, 
TestCollectionStateWatchers]
   [junit4] Completed [72/130 (1!)] on J1 in 57.18s, 9 tests, 1 failure <<< 
FAILURES!

[...truncated 6842 lines...]
BUILD FAILED
C:\Users\jenkins\workspace\Lucene-Solr-6.6-Windows\build.xml:775: The following 
error occurred while executing this line:
C:\Users\jenkins\workspace\Lucene-Solr-6.6-Windows\build.xml:727: Some of the 
tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid5780.hprof

Total time: 65 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

[JENKINS-EA] Lucene-Solr-6.6-Windows (64bit/jdk-9-ea+181) - Build # 20 - Failure!

Reply via email to