Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Windows/313/ Java: 64bit/jdk-10.0.1 -XX:+UseCompressedOops -XX:+UseParallelGC
3 tests failed. FAILED: org.apache.solr.cloud.OverseerTest.testShardLeaderChange Error Message: Captured an uncaught exception in thread: Thread[id=330, name=OverseerCollectionConfigSetProcessor-72079276911755287-127.0.0.1:65339_solr-n_0000000000, state=RUNNABLE, group=Overseer collection creation process.] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=330, name=OverseerCollectionConfigSetProcessor-72079276911755287-127.0.0.1:65339_solr-n_0000000000, state=RUNNABLE, group=Overseer collection creation process.] at __randomizedtesting.SeedInfo.seed([3223CDF0C003C3F0:EC704A07DA9B3601]:0) Caused by: org.apache.solr.common.AlreadyClosedException at __randomizedtesting.SeedInfo.seed([3223CDF0C003C3F0]:0) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:69) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:425) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:156) at java.base/java.lang.Thread.run(Thread.java:844) FAILED: org.apache.solr.cloud.OverseerTest.testOverseerFailure Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([3223CDF0C003C3F0]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([3223CDF0C003C3F0]:0) Build Log: [...truncated 15733 lines...] [junit4] Suite: org.apache.solr.cloud.OverseerTest [junit4] 2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.OverseerTest_3223CDF0C003C3F0-001\init-core-data-001 [junit4] 2> 495902 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 495904 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) [junit4] 2> 495904 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 495935 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 495936 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 495936 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 496036 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:60995 [junit4] 2> 496036 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:60995 [junit4] 2> 496036 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 60995 [junit4] 2> 496039 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 496065 INFO (zkConnectionManagerCallback-2082-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 496065 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 496067 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 496081 INFO (zkConnectionManagerCallback-2084-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 496082 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 496082 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore [junit4] 2> 496082 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end [junit4] 2> 496094 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStateChange [junit4] 2> 496391 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 496393 INFO (zkConnectionManagerCallback-2088-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 496393 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 496416 WARN (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4a432828[provider=null,keyStore=null,trustStore=null] [junit4] 2> 496416 WARN (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4a432828[provider=null,keyStore=null,trustStore=null] [junit4] 2> 497895 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 497908 INFO (zkConnectionManagerCallback-2095-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 497910 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 498248 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 498253 INFO (zkConnectionManagerCallback-2100-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 498253 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 498284 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 498299 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 498307 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885058-127.0.0.1:60995_solr-n_0000000000) starting [junit4] 2> 498352 INFO (OverseerStateUpdate-72078715875885058-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 498358 WARN (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 498908 INFO (closeThreadPool-2102-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72078715875885058-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 498908 INFO (OverseerAutoScalingTriggerThread-72078715875885058-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 498908 INFO (OverseerStateUpdate-72078715875885058-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 498914 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 499031 INFO (TEST-OverseerTest.testStateChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testStateChange [junit4] 2> 499037 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDownNodeFailover [junit4] 2> 499401 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 499407 INFO (zkConnectionManagerCallback-2104-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 499407 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 499428 WARN (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@180bc049[provider=null,keyStore=null,trustStore=null] [junit4] 2> 499428 WARN (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@180bc049[provider=null,keyStore=null,trustStore=null] [junit4] 2> 499430 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 499442 INFO (zkConnectionManagerCallback-2111-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 499442 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 499460 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 499467 INFO (zkConnectionManagerCallback-2116-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 499467 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 499500 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 499515 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 499522 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885061-127.0.0.1:60995_solr-n_0000000000) starting [junit4] 2> 499542 WARN (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 499550 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 499557 INFO (OverseerStateUpdate-72078715875885061-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 499563 INFO (zkConnectionManagerCallback-2120-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 499563 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 499595 INFO (zkCallback-2083-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 499595 INFO (zkCallback-2103-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 499595 INFO (zkCallback-2119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 499598 INFO (zkCallback-2115-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 499603 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 499608 INFO (zkConnectionManagerCallback-2127-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 499608 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 499612 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 499615 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 499772 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection0/leaders/shard1 [junit4] 2> 499779 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection0/leaders/shard1/leader after winning as /collections/collection0/leader_elect/shard1/election/72078715875885064-127.0.0.1_core1-n_0000000000 [junit4] 2> 499960 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 499983 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885064-127.0.0.1_core1-n_0000000000 [junit4] 2> 500215 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection2/leaders/shard1 [junit4] 2> 500219 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection2/leaders/shard1/leader after winning as /collections/collection2/leader_elect/shard1/election/72078715875885064-127.0.0.1_core1-n_0000000000 [junit4] 2> 500366 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection3/leaders/shard1 [junit4] 2> 500381 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection3/leaders/shard1/leader after winning as /collections/collection3/leader_elect/shard1/election/72078715875885064-127.0.0.1_core1-n_0000000000 [junit4] 2> 500517 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection4/leaders/shard1 [junit4] 2> 500530 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection4/leaders/shard1/leader after winning as /collections/collection4/leader_elect/shard1/election/72078715875885064-127.0.0.1_core1-n_0000000000 [junit4] 2> 500759 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500762 INFO (zkConnectionManagerCallback-2129-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500762 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500762 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885061-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 500768 INFO (OverseerAutoScalingTriggerThread-72078715875885061-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 500768 INFO (OverseerStateUpdate-72078715875885061-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 500807 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 500810 WARN (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3919cbf3[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500811 WARN (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3919cbf3[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500813 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500820 INFO (zkConnectionManagerCallback-2136-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500821 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500826 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500835 INFO (zkConnectionManagerCallback-2141-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500836 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500840 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 500843 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 500848 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 500849 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885066-127.0.0.1:60995_solr-n_0000000001) starting [junit4] 2> 500864 WARN (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 500872 INFO (OverseerStateUpdate-72078715875885066-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 500876 INFO (OverseerStateUpdate-72078715875885066-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 500880 INFO (zkCallback-2119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 500880 INFO (zkCallback-2115-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 500880 INFO (zkCallback-2126-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 500880 INFO (zkCallback-2083-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 500882 INFO (zkCallback-2140-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 500882 INFO (zkCallback-2128-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 501594 INFO (closeThreadPool-2143-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72078715875885061-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 501594 INFO (closeThreadPool-2143-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72078715875885066-127.0.0.1:60995_solr-n_0000000001) closing [junit4] 2> 501594 INFO (OverseerAutoScalingTriggerThread-72078715875885066-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 501594 INFO (OverseerStateUpdate-72078715875885066-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 501633 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 501748 INFO (TEST-OverseerTest.testDownNodeFailover-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDownNodeFailover [junit4] 2> 501758 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReplay [junit4] 2> 501967 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=41005091 [junit4] 2> 501967 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=360955953 [junit4] 2> 502066 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 502071 INFO (zkConnectionManagerCallback-2147-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 502076 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 502091 WARN (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@9477cc0[provider=null,keyStore=null,trustStore=null] [junit4] 2> 502092 WARN (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@9477cc0[provider=null,keyStore=null,trustStore=null] [junit4] 2> 502103 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 502104 INFO (zkConnectionManagerCallback-2154-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 502105 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 502107 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 502121 INFO (zkConnectionManagerCallback-2159-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 502121 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 502130 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 502160 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 502164 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885069-127.0.0.1:60995_solr-n_0000000000) starting [junit4] 2> 502187 WARN (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 502187 INFO (OverseerStateUpdate-72078715875885069-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 502705 INFO (closeThreadPool-2161-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72078715875885069-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 502705 INFO (OverseerStateUpdate-72078715875885069-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 502705 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 502734 INFO (OverseerAutoScalingTriggerThread-72078715875885069-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 502866 INFO (TEST-OverseerTest.testReplay-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testReplay [junit4] 2> 502883 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExternalClusterStateChangeBehavior [junit4] 2> 503130 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 503135 INFO (zkConnectionManagerCallback-2165-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 503135 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 503141 WARN (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@22b5764[provider=null,keyStore=null,trustStore=null] [junit4] 2> 503141 WARN (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@22b5764[provider=null,keyStore=null,trustStore=null] [junit4] 2> 503150 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 503155 INFO (zkConnectionManagerCallback-2172-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 503155 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 503163 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 503171 INFO (zkConnectionManagerCallback-2177-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 503171 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 503186 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 503222 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 503231 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885072-127.0.0.1:60995_solr-n_0000000000) starting [junit4] 2> 503254 WARN (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 503260 INFO (OverseerStateUpdate-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 503439 INFO (OverseerStateUpdate-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() { [junit4] 2> "operation":"addreplica", [junit4] 2> "collection":"test", [junit4] 2> "shard":"x", [junit4] 2> "base_url":"http://127.0.0.1/solr", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "node_name":"node1", [junit4] 2> "core":"core1", [junit4] 2> "state":"down"} [junit4] 2> 503541 INFO (zkCallback-2083-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [0]) [junit4] 2> 503542 ERROR (OverseerStateUpdate-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Exception in Overseer main queue loop [junit4] 2> => org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:122) [junit4] 2> org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /clusterstate.json [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:122) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2384) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:349) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:349) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:220) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:259) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 503557 WARN (OverseerStateUpdate-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.o.ClusterStateMutator Collection test already exists. exit [junit4] 2> 503657 WARN (OverseerStateUpdate-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer work queue loop [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-0000000004 [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-0000000004 [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.removeFirst(ZkDistributedQueue.java:537) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.poll(ZkDistributedQueue.java:211) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:197) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 503657 INFO (OverseerStateUpdate-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 503777 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 503911 INFO (closeThreadPool-2179-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72078715875885072-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 503912 INFO (OverseerAutoScalingTriggerThread-72078715875885072-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 504064 INFO (TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExternalClusterStateChangeBehavior [junit4] 2> 504073 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShardAssignment [junit4] 2> 504228 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 504232 INFO (zkConnectionManagerCallback-2181-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 504232 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 504237 WARN (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@49254fd4[provider=null,keyStore=null,trustStore=null] [junit4] 2> 504237 WARN (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@49254fd4[provider=null,keyStore=null,trustStore=null] [junit4] 2> 504239 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 504244 INFO (zkConnectionManagerCallback-2188-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 504244 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 504248 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 504251 INFO (zkConnectionManagerCallback-2193-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 504251 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 504254 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 504257 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 504259 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72078715875885075-127.0.0.1:60995_solr-n_0000000000) starting [junit4] 2> 504274 WARN (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 504277 INFO (OverseerStateUpdate-72078715875885075-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 504287 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 504291 INFO (zkConnectionManagerCallback-2197-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 504291 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 504300 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 504301 INFO (zkCallback-2196-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 504301 INFO (zkCallback-2192-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 504301 INFO (zkCallback-2180-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 504412 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 504417 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885078-127.0.0.1_core1-n_0000000000 [junit4] 2> 504567 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2 [junit4] 2> 504583 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72078715875885078-127.0.0.1_core2-n_0000000000 [junit4] 2> 504708 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3 [junit4] 2> 504712 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard3/leader after winning as /collections/collection1/leader_elect/shard3/election/72078715875885078-127.0.0.1_core3-n_0000000000 [junit4] 2> 504829 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 504949 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2 [junit4] 2> 505080 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard3 [junit4] 2> 505107 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration. [junit4] 2> 505108 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration. [junit4] 2> 505108 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration. [junit4] 2> 505109 WARN (zkCallback-2196-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader [junit4] 2> 505115 WARN (zkCallback-2196-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader [junit4] 2> 505116 WARN (zkCallback-2196-thread-1) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader [junit4] 2> 505124 INFO (zkCallback-2192-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 505124 INFO (zkCallback-2180-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 505124 INFO (zkCallback-2196-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 505124 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 505573 INFO (closeThreadPool-2201-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72078715875885075-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 505573 INFO (OverseerStateUpdate-72078715875885075-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 505573 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 505580 INFO (OverseerAutoScalingTriggerThread-72078715875885075-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 506131 INFO (TEST-OverseerTest.testShardAssignment-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testShardAssignment [junit4] 2> 506151 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testShardLeaderChange [junit4] 2> 506472 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506486 INFO (zkConnectionManagerCallback-2205-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506486 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506492 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@e002294[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506492 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@e002294[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506495 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506499 WARN (Thread-612) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3f81224b[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506499 WARN (Thread-612) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3f81224b[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506504 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506510 INFO (zkConnectionManagerCallback-2214-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506510 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506517 INFO (zkConnectionManagerCallback-2217-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506517 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506519 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3fd902c1[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506519 WARN (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3fd902c1[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506522 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506523 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506529 INFO (zkConnectionManagerCallback-2225-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506529 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506537 INFO (zkConnectionManagerCallback-2229-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506537 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506543 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506544 INFO (zkConnectionManagerCallback-2234-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506544 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506547 INFO (Thread-612) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 506583 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 506583 INFO (Thread-612) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 506596 INFO (Thread-612) [ ] o.a.s.c.Overseer Overseer (id=72078715875885079-127.0.0.1:60995_solr-n_0000000000) starting [junit4] 2> 506618 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506636 INFO (zkConnectionManagerCallback-2236-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506636 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506641 WARN (Thread-612) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 506641 INFO (Thread-612) [ ] o.a.s.c.OverseerTest Killing overseer. [junit4] 2> 506655 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60995_solr [junit4] 2> 506658 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72078715875885080-127.0.0.1:60995_solr-n_0000000001) starting [junit4] 2> 506669 WARN (zkCallback-2213-thread-1) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 506670 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 506670 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 506670 INFO (zkCallback-2235-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 506671 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 506673 INFO (OverseerStateUpdate-72078715875885080-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 506677 INFO (OverseerStateUpdate-72078715875885080-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129) [junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:824) [junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:812) [junit4] 2> at org.apache.solr.cloud.OverseerTest$MockZKController.createCollection(OverseerTest.java:190) [junit4] 2> at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:922) [junit4] 2> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.base/java.lang.reflect.Method.invoke(Method.java:564) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2021) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:313) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:313) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93) [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127) [junit4] 2> ... 42 more [junit4] 2> 506746 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506747 INFO (OverseerStateUpdate-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer According to ZK I (id=72078715875885079-127.0.0.1:60995_solr-n_0000000000) am no longer a leader. propsId=null [junit4] 2> 506747 INFO (OverseerStateUpdate-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60995_solr [junit4] 2> 506747 INFO (OverseerStateUpdate-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer According to ZK I (id=72078715875885079-127.0.0.1:60995_solr-n_0000000000) am no longer a leader. propsId=null [junit4] 2> 506747 INFO (OverseerStateUpdate-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60995_solr [junit4] 2> 506755 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer Error communicating with ZooKeeper [junit4] 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:337) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331) ~[java/:?] [junit4] 2> at java.lang.Thread.run(Thread.java:844) [?:?] [junit4] 2> 506761 INFO (zkConnectionManagerCallback-2240-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506761 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506761 INFO (Thread-612) [ ] o.a.s.c.Overseer Overseer (id=72078715875885079-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 506762 INFO (OverseerAutoScalingTriggerThread-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 506762 INFO (OverseerCollectionConfigSetProcessor-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor According to ZK I (id=72078715875885079-127.0.0.1:60995_solr-n_0000000000) am no longer a leader. propsId=null [junit4] 2> 506762 ERROR (OverseerCollectionConfigSetProcessor-72078715875885079-127.0.0.1:60995_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) [junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2589) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:325) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:325) [junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.fetchZkChildren(ZkDistributedQueue.java:415) [junit4] 2> at org.apache.solr.cloud.OverseerTaskQueue.getTailId(OverseerTaskQueue.java:274) [junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:170) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> [junit4] 2> 506776 WARN (Thread-612) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1441a96d[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506776 WARN (Thread-612) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1441a96d[provider=null,keyStore=null,trustStore=null] [junit4] 2> 506779 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506782 INFO (zkConnectionManagerCallback-2247-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506782 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506788 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 506791 INFO (zkConnectionManagerCallback-2252-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 506791 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 506795 INFO (Thread-612) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 506799 INFO (Thread-612) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 506892 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 506899 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885085-node1_core1-n_0000000000 [junit4] 2> 507056 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 507062 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885085-node1_core1-n_0000000001 [junit4] 2> 507068 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507075 INFO (zkConnectionManagerCallback-2254-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507075 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507131 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 507142 INFO (zkCallback-2235-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507142 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507142 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507142 INFO (zkCallback-2213-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507142 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507142 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507154 INFO (zkCallback-2253-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507236 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 507243 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885085-node1_core1-n_0000000002 [junit4] 2> 507392 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 507396 INFO (zkCallback-2253-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885089-node2_core4-n_0000000003 [junit4] 2> 507412 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507412 INFO (zkCallback-2235-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507413 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507414 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507414 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507414 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507414 INFO (zkCallback-2253-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507519 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507536 INFO (zkConnectionManagerCallback-2258-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507536 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507542 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507555 INFO (zkConnectionManagerCallback-2263-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507556 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507567 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 507596 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 507603 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507609 INFO (zkConnectionManagerCallback-2265-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507609 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507620 INFO (Thread-612) [ ] o.a.s.c.OverseerTest Killing overseer. [junit4] 2> 507733 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507737 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 507741 INFO (zkConnectionManagerCallback-2267-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507741 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507741 INFO (Thread-612) [ ] o.a.s.c.Overseer Overseer (id=72078715875885079-127.0.0.1:60995_solr-n_0000000000) closing [junit4] 2> 507748 WARN (Thread-612) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@53107ae9[provider=null,keyStore=null,trustStore=null] [junit4] 2> 507748 WARN (Thread-612) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@53107ae9[provider=null,keyStore=null,trustStore=null] [junit4] 2> 507753 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507754 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507754 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507754 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507754 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507754 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507754 INFO (zkCallback-2253-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507759 INFO (zkCallback-2262-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507762 INFO (zkCallback-2264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 507763 WARN (OverseerStateUpdate-72078715875885080-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.o.ClusterStateMutator Collection collection1 already exists. exit [junit4] 2> 507767 INFO (zkConnectionManagerCallback-2276-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507767 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507771 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 507773 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 507779 INFO (zkCallback-2264-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885092-node1_core1-n_0000000004 [junit4] 2> 507787 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507787 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507787 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507787 INFO (zkCallback-2262-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507787 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507787 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507787 INFO (zkCallback-2253-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507799 INFO (zkConnectionManagerCallback-2281-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 507799 INFO (Thread-612) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 507892 INFO (zkCallback-2264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 507906 INFO (Thread-612) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 507909 INFO (Thread-612) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 508031 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 508068 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885092-node1_core1-n_0000000005 [junit4] 2> 508076 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 508089 INFO (zkConnectionManagerCallback-2283-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 508089 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 508104 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 508112 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2213-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2262-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2280-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508112 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508115 INFO (zkCallback-2282-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508118 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 508121 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885092-node1_core1-n_0000000006 [junit4] 2> 508130 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 508168 INFO (zkCallback-2282-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885096-node2_core4-n_0000000007 [junit4] 2> 508171 INFO (zkCallback-2262-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508171 INFO (zkCallback-2213-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508171 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508172 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508172 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508172 INFO (zkCallback-2280-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508172 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508172 INFO (zkCallback-2264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508185 INFO (zkCallback-2282-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508282 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 508296 INFO (zkConnectionManagerCallback-2287-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 508296 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 508313 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 508318 INFO (zkConnectionManagerCallback-2292-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 508318 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 508321 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 508327 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60995/solr ready [junit4] 2> 508336 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 508347 INFO (zkConnectionManagerCallback-2294-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 508347 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 508351 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 508379 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2262-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2282-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2280-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2083-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2251-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508379 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508383 INFO (zkCallback-2291-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 508391 WARN (OverseerStateUpdate-72078715875885080-127.0.0.1:60995_solr-n_0000000001) [ ] o.a.s.c.o.ClusterStateMutator Collection collection1 already exists. exit [junit4] 2> 508408 INFO (TEST-OverseerTest.testShardLeaderChange-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 508417 INFO (zkCallback-2293-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72078715875885099-node1_core1-n_0000000008 [junit4] 2> 508433 INFO (zkCallback-2213-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508433 INFO (zkCallback-2233-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508433 INFO (zkCallback-2228-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 508433 INFO (zkCallback-2262-thread-1) [ ] o.a [...truncated too long message...] -127.0.0.1:65339_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65339_solr [junit4] 2> 41757 INFO (OverseerAutoScalingTriggerThread-72079276911755265-127.0.0.1:65339_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 41764 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=330540731 [junit4] 2> 41764 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1990546716 [junit4] 2> 41765 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1712345483 [junit4] 2> 41765 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72079276911755265-127.0.0.1:65339_solr-n_0000000000) closing [junit4] 2> 41766 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=861415790 [junit4] 2> 41766 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1028704192 [junit4] 2> 41767 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1627486403 [junit4] 2> 41767 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=100262241 [junit4] 2> 41767 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=2006494185 [junit4] 2> 41767 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72079276911755265-127.0.0.1:65339_solr-n_0000000000) closing [junit4] 2> 41767 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer I (id=72079276911755265-127.0.0.1:65339_solr-n_0000000000) am exiting, but I'm still the leader [junit4] 2> 41768 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72079276911755265-127.0.0.1:65339_solr-n_0000000000) closing [junit4] 2> 41769 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:65339_solr [junit4] 2> 41770 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Overseer (id=72079276911755265-127.0.0.1:65339_solr-n_0000000001) starting [junit4] 2> 41775 WARN (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.c.Overseer Unable to check back-compat of .system collection - can't obtain ClusterState. [junit4] 2> 41779 INFO (zkCallback-444-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 41779 INFO (zkCallback-437-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 41779 INFO (zkCallback-4-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 41781 INFO (OverseerStateUpdate-72079276911755265-127.0.0.1:65339_solr-n_0000000001) [ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:65339_solr [junit4] 2> 41984 INFO (closeThreadPool-450-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72079276911755265-127.0.0.1:65339_solr-n_0000000001) closing [junit4] 2> 41984 INFO (OverseerStateUpdate-72079276911755265-127.0.0.1:65339_solr-n_0000000001) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:65339_solr [junit4] 2> 41985 INFO (OverseerAutoScalingTriggerThread-72079276911755265-127.0.0.1:65339_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 41990 WARN (OverseerExitThread) [ ] o.a.s.c.Overseer I (id=72079276911755265-127.0.0.1:65339_solr-n_0000000001) am exiting, but I'm still the leader [junit4] 2> 42104 INFO (TEST-OverseerTest.testOverseerStatsReset-seed#[3223CDF0C003C3F0]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset [junit4] OK 0.71s J0 | OverseerTest.testOverseerStatsReset [junit4] 1> / (0) [junit4] 1> [junit4] 2> 42107 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 42317 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 78 /solr/collections/collection1/state.json [junit4] 2> 74 /solr/aliases.json [junit4] 2> 74 /solr/clusterprops.json [junit4] 2> 13 /solr/collections/collection2/state.json [junit4] 2> 5 /solr/collections/c1/state.json [junit4] 2> 4 /solr/collections/collection3/state.json [junit4] 2> 3 /solr/collections/collection0/state.json [junit4] 2> 2 /solr/collections/collection4/state.json [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 416 /solr/clusterstate.json [junit4] 2> 20 /solr/autoscaling.json [junit4] 2> 3 /solr/collections/test/state.json [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 346 /solr/live_nodes [junit4] 2> 154 /solr/overseer/queue [junit4] 2> 133 /solr/collections [junit4] 2> 22 /solr/overseer/queue-work [junit4] 2> 20 /solr/autoscaling/events/.scheduled_maintenance [junit4] 2> 20 /solr/autoscaling/events/.auto_add_replicas [junit4] 2> 19 /solr/overseer/collection-queue-work [junit4] 2> [junit4] 2> 42343 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:65339 [junit4] 2> 42343 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 65339 [junit4] 2> 43350 INFO (SUITE-OverseerTest-seed#[3223CDF0C003C3F0]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released [junit4] 2> NOTE: test params are: codec=Asserting(Lucene80): {}, docValues:{}, maxPointsInLeafNode=1634, maxMBSortInHeap=5.705749427932799, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@37172d51), locale=ewo, timezone=Africa/Bamako [junit4] 2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 10.0.1 (64-bit)/cpus=3,threads=2,free=153113736,total=229638144 [junit4] 2> NOTE: All tests run in this JVM: [OverseerTest] [junit4] Completed [2/5 (1!)] on J0 in 42.30s, 14 tests, 1 error, 1 skipped <<< FAILURES! [...truncated 58 lines...] BUILD FAILED C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\lucene\common-build.xml:1572: The following error occurred while executing this line: C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\lucene\common-build.xml:1099: There were test failures: 5 suites, 70 tests, 1 error, 5 ignored [seed: 3223CDF0C003C3F0] Total time: 1 minute 44 seconds [repro] Setting last failure code to 1 [repro] Failures: [repro] 1/5 failed: org.apache.solr.cloud.OverseerTest [repro] Exiting with code 1 C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows>IF EXIST lucene\build move /y lucene\build lucene\build.repro 1 dir(s) moved. C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows>IF EXIST solr\build move /y solr\build solr\build.repro 1 dir(s) moved. C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows>IF EXIST lucene\build.orig move /y lucene\build.orig lucene\build 1 dir(s) moved. C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows>IF EXIST solr\build.orig move /y solr\build.orig solr\build 1 dir(s) moved. C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows>exit 0 Archiving artifacts Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 [WARNINGS] Parsing warnings in console log with parser Java Compiler (javac) Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 No credentials specified Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 <Git Blamer> Using GitBlamer to create author and commit information for all warnings. <Git Blamer> GIT_COMMIT=d58b8b759010bc26d58dadaddfa8f53d38d8becb, workspace=C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows [WARNINGS] Computing warning deltas based on reference build #312 Recording test results Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 Build step 'Publish JUnit test result report' changed build result to UNSTABLE Email was triggered for: Unstable (Test Failures) Sending email for trigger: Unstable (Test Failures) Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2 Setting ANT_1_8_2_HOME=C:\Users\jenkins\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org