Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/72/
Java: 64bit/jdk-12-ea+23 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.testDelegationTokenRenew

Error Message:
expected:<200> but was:<403>

Stack Trace:
java.lang.AssertionError: expected:<200> but was:<403>
        at 
__randomizedtesting.SeedInfo.seed([2B0352B75F945404:1C98A6A9675889A0]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.failNotEquals(Assert.java:834)
        at org.junit.Assert.assertEquals(Assert.java:645)
        at org.junit.Assert.assertEquals(Assert.java:631)
        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.renewDelegationToken(TestSolrCloudWithDelegationTokens.java:131)
        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.verifyDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:316)
        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.testDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:334)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:835)




Build Log:
[...truncated 12683 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithDelegationTokens
   [junit4]   2> 47734 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithDelegationTokens_2B0352B75F945404-001/init-core-data-001
   [junit4]   2> 47734 WARN  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 47735 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 47736 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 47737 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithDelegationTokens_2B0352B75F945404-001/tempDir-001
   [junit4]   2> 47737 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 47738 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 47738 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 47838 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:33207
   [junit4]   2> 47838 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:33207
   [junit4]   2> 47838 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 33207
   [junit4]   2> 47847 INFO  (zkConnectionManagerCallback-440-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 47854 INFO  (zkConnectionManagerCallback-442-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 47871 INFO  (zkConnectionManagerCallback-444-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 47873 WARN  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 47873 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 47873 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 47873 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 12-ea+23
   [junit4]   2> 47895 WARN  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 47895 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 47895 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 47895 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 12-ea+23
   [junit4]   2> 47950 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 47950 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 47950 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 47958 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@48acdfaa{/solr,null,AVAILABLE}
   [junit4]   2> 47959 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@4204356e{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:46567}
   [junit4]   2> 47959 INFO  (jetty-launcher-445-thread-2) [    ] 
o.e.j.s.Server Started @47979ms
   [junit4]   2> 47966 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 47966 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 47966 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 47971 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@14cc7ecb{/solr,null,AVAILABLE}
   [junit4]   2> 47959 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=46567}
   [junit4]   2> 47975 ERROR (jetty-launcher-445-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 47975 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 47975 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 47975 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 47975 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 47976 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-01-23T13:32:11.981989Z
   [junit4]   2> 47978 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@b8ab33a{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:45487}
   [junit4]   2> 47978 INFO  (jetty-launcher-445-thread-1) [    ] 
o.e.j.s.Server Started @47998ms
   [junit4]   2> 47978 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45487}
   [junit4]   2> 47979 ERROR (jetty-launcher-445-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 47979 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 47979 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 47979 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 47979 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 47979 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-01-23T13:32:11.985721Z
   [junit4]   2> 48006 INFO  (zkConnectionManagerCallback-447-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48007 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 48022 INFO  (zkConnectionManagerCallback-449-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48023 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 48072 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 48082 WARN  (jetty-launcher-445-thread-2) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@79fbded7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 48087 WARN  (jetty-launcher-445-thread-2) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@7530823[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 48088 INFO  (jetty-launcher-445-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33207/solr
   [junit4]   2> 48096 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 48107 WARN  (jetty-launcher-445-thread-1) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@609032b8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 48107 INFO  (zkConnectionManagerCallback-455-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48116 INFO  (zkConnectionManagerCallback-459-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48117 WARN  (jetty-launcher-445-thread-1) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@23b9645b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 48118 INFO  (jetty-launcher-445-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33207/solr
   [junit4]   2> 48137 INFO  (zkConnectionManagerCallback-463-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48154 INFO  (zkConnectionManagerCallback-467-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48160 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:45487_solr
   [junit4]   2> 48161 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.Overseer Overseer 
(id=72084921310969864-127.0.0.1:45487_solr-n_0000000000) starting
   [junit4]   2> 48198 INFO  (zkConnectionManagerCallback-474-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48203 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:33207/solr ready
   [junit4]   2> 48206 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46567_solr
   [junit4]   2> 48206 INFO  
(OverseerStateUpdate-72084921310969864-127.0.0.1:45487_solr-n_0000000000) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:45487_solr
   [junit4]   2> 48207 INFO  
(OverseerStateUpdate-72084921310969864-127.0.0.1:45487_solr-n_0000000000) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 48207 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.CoreContainer Initializing authentication 
plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 48213 WARN  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder 
org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without 
specifying system property 'java.security.auth.login.config'
   [junit4]   2> 48230 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.s.KerberosPlugin Params: {token.valid=30, 
delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, cookie.path=/, 
zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, 
token.validity=36000, signer.secret.provider.zookeeper.path=/token, 
type=kerberos, zk-dt-secret-manager.enable=true, kerberos.name.rules=DEFAULT, 
signer.secret.provider=zookeeper}
   [junit4]   2> 48235 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:45487_solr as DOWN
   [junit4]   2> 48235 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 48235 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45487_solr
   [junit4]   2> 48237 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.CoreContainer Initializing authentication 
plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 48237 WARN  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder 
org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without 
specifying system property 'java.security.auth.login.config'
   [junit4]   2> 48247 INFO  (zkCallback-473-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 48259 INFO  (zkCallback-458-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 48261 INFO  (zkCallback-466-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 48267 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.s.KerberosPlugin Params: {token.valid=30, 
delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, cookie.path=/, 
zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, 
token.validity=36000, signer.secret.provider.zookeeper.path=/token, 
type=kerberos, zk-dt-secret-manager.enable=true, kerberos.name.rules=DEFAULT, 
signer.secret.provider=zookeeper}
   [junit4]   2> 48318 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 48319 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 48357 INFO  (jetty-launcher-445-thread-1-EventThread) [    ] 
o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 48357 INFO  (jetty-launcher-445-thread-2-EventThread) [    ] 
o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 48623 WARN  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder 
org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without 
specifying system property 'java.security.auth.login.config'
   [junit4]   2> 48627 WARN  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder 
org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without 
specifying system property 'java.security.auth.login.config'
   [junit4]   2> 48691 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 48743 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45487.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5788c2c
   [junit4]   2> 48750 INFO  (zkConnectionManagerCallback-480-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 48752 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 48753 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:33207/solr ready
   [junit4]   2> 48761 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45487.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5788c2c
   [junit4]   2> 48761 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45487.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5788c2c
   [junit4]   2> 48763 INFO  (jetty-launcher-445-thread-1) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithDelegationTokens_2B0352B75F945404-001/tempDir-001/node1/.
   [junit4]   2> 48774 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 48914 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46567.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5788c2c
   [junit4]   2> 48937 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46567.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5788c2c
   [junit4]   2> 48937 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_46567.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5788c2c
   [junit4]   2> 48939 INFO  (jetty-launcher-445-thread-2) 
[n:127.0.0.1:46567_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithDelegationTokens_2B0352B75F945404-001/tempDir-001/node2/.
   [junit4]   2> 49046 INFO  (zkConnectionManagerCallback-486-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 49047 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 49048 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33207/solr ready
   [junit4]   2> 49148 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancelFail-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancelFail
   [junit4]   2> 49567 ERROR (qtp1271370069-1207) [    ] 
o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path 
[/ZKDTSMTokensRoot/DT_1]
   [junit4]   2> 49569 ERROR (qtp414837585-1211) [    ] 
o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path 
[/ZKDTSMTokensRoot/DT_1]
   [junit4]   2> 49578 ERROR (qtp1271370069-1205) [    ] 
o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path 
[/ZKDTSMTokensRoot/DT_2]
   [junit4]   2> 49580 ERROR (qtp414837585-1214) [    ] 
o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path 
[/ZKDTSMTokensRoot/DT_2]
   [junit4]   2> 49581 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancelFail-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancelFail
   [junit4]   2> 49605 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenVerify
   [junit4]   2> 49639 INFO  (qtp414837585-1214) [n:127.0.0.1:45487_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
action=LIST&delegation=GgADYmFyA2JhcgCKAWh66UGsigFonvXFrAMEFEj9qS0iD9AHqe8Gca8K5hzdhIQ8B3NvbHItZHQA&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 49639 INFO  (qtp414837585-1214) [n:127.0.0.1:45487_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=LIST&delegation=GgADYmFyA2JhcgCKAWh66UGsigFonvXFrAMEFEj9qS0iD9AHqe8Gca8K5hzdhIQ8B3NvbHItZHQA&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 49663 INFO  (zkConnectionManagerCallback-491-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 49675 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 49675 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 49723 INFO  (qtp1271370069-1205) [n:127.0.0.1:46567_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
action=LIST&delegation=GgADYmFyA2JhcgCKAWh66UGsigFonvXFrAMEFEj9qS0iD9AHqe8Gca8K5hzdhIQ8B3NvbHItZHQA&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 49723 INFO  (qtp1271370069-1205) [n:127.0.0.1:46567_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=LIST&delegation=GgADYmFyA2JhcgCKAWh66UGsigFonvXFrAMEFEj9qS0iD9AHqe8Gca8K5hzdhIQ8B3NvbHItZHQA&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 49730 INFO  (zkConnectionManagerCallback-496-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 49732 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 49744 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 49749 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenVerify
   [junit4]   2> 49769 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClient-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenSolrClient
   [junit4]   2> 49858 INFO  (qtp414837585-1213) [n:127.0.0.1:45487_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
action=LIST&delegation=GgADYmFyA2JhcgCKAWh66UJQigFonvXGUAQEFEJSN2MpPCSEYce10JfydWirAG4ZB3NvbHItZHQA&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 49858 INFO  (qtp414837585-1213) [n:127.0.0.1:45487_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=LIST&delegation=GgADYmFyA2JhcgCKAWh66UJQigFonvXGUAQEFEJSN2MpPCSEYce10JfydWirAG4ZB3NvbHItZHQA&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 49859 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClient-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenSolrClient
   [junit4]   2> 49896 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenewFail
   [junit4]   2> 49909 WARN  (qtp414837585-1214) [n:127.0.0.1:45487_solr    ] 
o.a.h.s.a.s.AuthenticationFilter Authentication exception: 
org.apache.hadoop.security.AccessControlException: foo tries to renew a token 
with renewer bar
   [junit4]   2> 49909 WARN  (qtp414837585-1214) [n:127.0.0.1:45487_solr    ] 
o.a.s.s.KerberosPlugin Could not find 
org.apache.solr.security.authentication.requestcontinues
   [junit4]   2> 49911 WARN  (qtp1271370069-1209) [    ] 
o.a.h.s.a.s.AuthenticationFilter Authentication exception: 
org.apache.hadoop.security.AccessControlException: foo tries to renew a token 
with renewer bar
   [junit4]   2> 49912 WARN  (qtp1271370069-1209) [    ] o.a.s.s.KerberosPlugin 
Could not find org.apache.solr.security.authentication.requestcontinues
   [junit4]   2> 49919 WARN  (qtp414837585-1213) [n:127.0.0.1:45487_solr    ] 
o.a.h.s.a.s.AuthenticationFilter Authentication exception: 
org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew 
a token with renewer renewUser
   [junit4]   2> 49919 WARN  (qtp414837585-1213) [n:127.0.0.1:45487_solr    ] 
o.a.s.s.KerberosPlugin Could not find 
org.apache.solr.security.authentication.requestcontinues
   [junit4]   2> 49931 WARN  (qtp1271370069-1207) [    ] 
o.a.h.s.a.s.AuthenticationFilter Authentication exception: 
org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew 
a token with renewer renewUser
   [junit4]   2> 49931 WARN  (qtp1271370069-1207) [    ] o.a.s.s.KerberosPlugin 
Could not find org.apache.solr.security.authentication.requestcontinues
   [junit4]   2> 49932 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenewFail
   [junit4]   2> 49953 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenew-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenew
   [junit4]   2> 49960 WARN  (qtp414837585-1211) [    ] 
o.a.h.s.a.s.AuthenticationFilter Authentication exception: 
org.apache.hadoop.security.AccessControlException: bar is trying to renew a 
token with wrong password
   [junit4]   2> 49960 WARN  (qtp414837585-1211) [    ] o.a.s.s.KerberosPlugin 
Could not find org.apache.solr.security.authentication.requestcontinues
   [junit4]   2> 49963 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenew-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenew
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestSolrCloudWithDelegationTokens 
-Dtests.method=testDelegationTokenRenew -Dtests.seed=2B0352B75F945404 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-TG 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.03s J1 | 
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<200> but 
was:<403>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([2B0352B75F945404:1C98A6A9675889A0]:0)
   [junit4]    >        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.renewDelegationToken(TestSolrCloudWithDelegationTokens.java:131)
   [junit4]    >        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.verifyDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:316)
   [junit4]    >        at 
org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.testDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:334)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    >        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    >        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    >        at 
java.base/java.lang.reflect.Method.invoke(Method.java:567)
   [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:835)
   [junit4]   2> 49996 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancel
   [junit4]   2> 50026 INFO  (zkConnectionManagerCallback-501-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 50027 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 50029 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 50032 ERROR (qtp1271370069-1209) [    ] 
o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path 
[/ZKDTSMTokensRoot/DT_8]
   [junit4]   2> 50042 INFO  (zkConnectionManagerCallback-506-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 50043 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 50044 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 50066 ERROR (qtp1271370069-1207) [    ] 
o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path 
[/ZKDTSMTokensRoot/DT_9]
   [junit4]   2> 50085 INFO  (zkConnectionManagerCallback-511-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 50091 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 50092 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 50163 INFO  (zkConnectionManagerCallback-516-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 50164 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 50165 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 50175 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancel
   [junit4]   2> 50217 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testZNodePaths-seed#[2B0352B75F945404]) 
[    ] o.a.s.SolrTestCaseJ4 ###Starting testZNodePaths
   [junit4]   2> 50250 INFO  (zkConnectionManagerCallback-518-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 50252 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testZNodePaths-seed#[2B0352B75F945404]) 
[    ] o.a.s.SolrTestCaseJ4 ###Ending testZNodePaths
   [junit4]   2> 50294 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationOtherOp
   [junit4]   2> 50326 INFO  (zkConnectionManagerCallback-523-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 50328 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[2B0352B75F945404])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 50328 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[2B0352B75F945404])
 [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:33207/solr ready
   [junit4]   2> 50336 INFO  (qtp1271370069-1207) [n:127.0.0.1:46567_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params 
op=someSolrOperation&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 50336 INFO  (qtp1271370069-1207) [n:127.0.0.1:46567_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={op=someSolrOperation&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 50348 INFO  
(TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[2B0352B75F945404])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationOtherOp
   [junit4]   2> 50365 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=35112311
   [junit4]   2> 50365 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45487_solr
   [junit4]   2> 50365 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 50365 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:45487_solr as DOWN
   [junit4]   2> 50376 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1427882200
   [junit4]   2> 50376 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:46567_solr
   [junit4]   2> 50377 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 50377 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1864b202: rootName = 
solr_45487, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@386a9a18
   [junit4]   2> 50382 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 50382 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.c.ZkController Publish node=127.0.0.1:46567_solr as DOWN
   [junit4]   2> 50383 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 50390 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 50390 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2ed8835a: rootName = 
solr_45487, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@46974b16
   [junit4]   2> 50394 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 50395 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6eb0bb2d: rootName = 
solr_46567, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@61edc2b5
   [junit4]   2> 50398 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 50398 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@3941518f: rootName = 
solr_45487, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@dbd50d0
   [junit4]   2> 50398 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 50406 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 50406 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2bc4dd8: rootName = 
solr_46567, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@46974b16
   [junit4]   2> 50412 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 50412 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@684239fc: rootName = 
solr_46567, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@dbd50d0
   [junit4]   2> 50413 INFO  (jetty-closer-524-thread-2) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7bf9d5c6[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@165c8d9c[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@59c2355c[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   1> Done close 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@79bb9143[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 50437 INFO  (closeThreadPool-529-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72084921310969864-127.0.0.1:45487_solr-n_0000000000) closing
   [junit4]   2> 50437 INFO  
(OverseerStateUpdate-72084921310969864-127.0.0.1:45487_solr-n_0000000000) 
[n:127.0.0.1:45487_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:45487_solr
   [junit4]   2> 50438 INFO  
(OverseerAutoScalingTriggerThread-72084921310969864-127.0.0.1:45487_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 50439 INFO  (closeThreadPool-529-thread-2) [    ] 
o.a.s.c.Overseer Overseer 
(id=72084921310969864-127.0.0.1:45487_solr-n_0000000000) closing
   [junit4]   2> 50441 INFO  (jetty-closer-524-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72084921310969864-127.0.0.1:45487_solr-n_0000000000) closing
   [junit4]   2> 50442 ERROR 
(Thread[Thread-214,5,TGRP-TestSolrCloudWithDelegationTokens]) [    ] 
o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received 
java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 50442 ERROR 
(Thread[Thread-212,5,TGRP-TestSolrCloudWithDelegationTokens]) [    ] 
o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received 
java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 50448 INFO  (jetty-closer-524-thread-1) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@b8ab33a{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 50448 INFO  (jetty-closer-524-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@14cc7ecb{/solr,null,UNAVAILABLE}
   [junit4]   2> 50448 INFO  (jetty-closer-524-thread-1) [    ] o.e.j.s.session 
node0 Stopped scavenging
   [junit4]   2> 50449 INFO  (jetty-closer-524-thread-2) [    ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@4204356e{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:0}
   [junit4]   2> 50449 INFO  (jetty-closer-524-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@48acdfaa{/solr,null,UNAVAILABLE}
   [junit4]   2> 50450 INFO  (jetty-closer-524-thread-2) [    ] o.e.j.s.session 
node0 Stopped scavenging
   [junit4]   2> 50450 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 50452 WARN  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        12      /solr/aliases.json
   [junit4]   2>        12      /solr/clusterprops.json
   [junit4]   2>        2       /solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        12      /solr/clusterstate.json
   [junit4]   2>        3       /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_7
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_6
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_9
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_8
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_1
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_3
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_2
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_5
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_4
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_10
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        12      /solr/live_nodes
   [junit4]   2>        12      /solr/collections
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2>        2       
/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 50453 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:33207
   [junit4]   2> 50453 INFO  
(SUITE-TestSolrCloudWithDelegationTokens-seed#[2B0352B75F945404]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 33207
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithDelegationTokens_2B0352B75F945404-001
   [junit4]   2> Jan 23, 2019 1:32:14 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 9 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6fc89b42),
 locale=fr-TG, timezone=Atlantic/Jan_Mayen
   [junit4]   2> NOTE: Linux 4.15.0-43-generic amd64/Oracle Corporation 12-ea 
(64-bit)/cpus=8,threads=1,free=210236032,total=512753664
   [junit4]   2> NOTE: All tests run in this JVM: 
[DistributedFacetPivotLargeTest, SearchHandlerTest, 
HdfsRestartWhileUpdatingTest, TestReqParamsAPI, 
TestSolrCloudWithDelegationTokens]
   [junit4] Completed [17/839 (1!)] on J1 in 3.01s, 8 tests, 1 failure <<< 
FAILURES!

[...truncated 45352 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/72/consoleText

[repro] Revision: 8cb89df72295523bc6b58a11579b0aa8174a323e

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=TestSolrCloudWithDelegationTokens 
-Dtests.method=testDelegationTokenRenew -Dtests.seed=2B0352B75F945404 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-TG 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSolrCloudWithDelegationTokens
[repro] ant compile-test

[...truncated 3577 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.TestSolrCloudWithDelegationTokens" -Dtests.showOutput=onerror 
"-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" 
-Dtests.seed=2B0352B75F945404 -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=fr-TG -Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[...truncated 110 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestSolrCloudWithDelegationTokens
[repro] Exiting with code 0

[...truncated 40 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to