Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Solaris/180/
Java: multiarch/jdk1.7.0 -d64 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:


Stack Trace:
java.lang.NullPointerException
        at 
__randomizedtesting.SeedInfo.seed([B8F1A293A26DD72E:D0EFA17F40FD8D60]:0)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.verifyReplicaStatus(AbstractDistribZkTestBase.java:222)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1244)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10570 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: 
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.OverseerTest_B8F1A293A26DD72E-001/init-core-data-001
   [junit4]   2> 1651405 INFO  
(SUITE-OverseerTest-seed#[B8F1A293A26DD72E]-worker) [    ] o.a.s.SolrTestCaseJ4 
Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1651405 INFO  
(SUITE-OverseerTest-seed#[B8F1A293A26DD72E]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore
   [junit4]   2> 1651405 INFO  
(SUITE-OverseerTest-seed#[B8F1A293A26DD72E]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore end
   [junit4]   2> 1651409 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testPlaceholders
   [junit4]   2> 1651410 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1651410 INFO  (Thread-3571) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1651410 INFO  (Thread-3571) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1651512 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:55083
   [junit4]   2> 1651513 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1651515 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1651571 INFO  (zkCallback-1298-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a324d2 name:ZooKeeperConnection 
Watcher:127.0.0.1:55083/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1651575 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1651595 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1651596 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1651603 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1651940 INFO  (zkCallback-1299-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@532ca501 
name:ZooKeeperConnection Watcher:127.0.0.1:55083 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1651941 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1651943 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1651950 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1651951 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1651962 INFO  (zkCallback-1300-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@407ec1ae 
name:ZooKeeperConnection Watcher:127.0.0.1:55083 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1651964 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1651966 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1651967 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1651984 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x150f5946a210002, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1651992 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1652012 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1652021 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1652029 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1652039 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1652048 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1652056 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1652057 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1652061 INFO  (zkCallback-1301-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@220a72c7 
name:ZooKeeperConnection Watcher:127.0.0.1:55083/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1652062 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1652063 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1652072 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1652098 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1652109 INFO  (zkCallback-1298-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1652111 INFO  (zkCallback-1301-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1652132 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1652142 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1652218 INFO  (zkCallback-1302-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@18d0fd7c 
name:ZooKeeperConnection Watcher:127.0.0.1:55083/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1652222 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1652227 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1652228 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1652238 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1652248 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1652253 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1652254 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94845609959292932-127.0.0.1:55083_solr-n_0000000000
   [junit4]   2> 1652254 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55083_solr
   [junit4]   2> 1652255 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1652265 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845609959292932-127.0.0.1:55083_solr-n_0000000000) starting
   [junit4]   2> 1652270 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1652281 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1652290 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1652305 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1652312 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1652320 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1652335 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1652341 INFO  
(OverseerCollectionConfigSetProcessor-94845609959292932-127.0.0.1:55083_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1652343 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1652344 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1652350 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"12",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 1652350 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=12 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"12",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1652351 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1652351 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard6
   [junit4]   2> 1652355 INFO  (zkCallback-1301-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1652355 INFO  (zkCallback-1302-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1652355 INFO  (zkCallback-1298-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1652850 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard6/election
   [junit4]   2> 1652860 INFO  (zkCallback-1302-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1652860 INFO  (zkCallback-1301-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1652861 INFO  (zkCallback-1298-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1652882 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard6/election/94845609959292931-node1_core1-n_0000000000
   [junit4]   2> 1652884 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard6
   [junit4]   2> 1652900 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1652942 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard6",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "core":"core1"} current state version: 1
   [junit4]   2> 1652956 ERROR 
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer could not process the current clusterstate state 
update message, skipping the message.
   [junit4]   2> org.apache.solr.common.SolrException: Error reading cluster 
properties
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:737)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ReplicaMutator.setState(ReplicaMutator.java:198)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:379)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.processQueueItem(Overseer.java:276)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:214)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /clusterprops.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:730)
   [junit4]   2>        ... 5 more
   [junit4]   2> 1652964 WARN  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer/queue/qn-0000000001
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.removeFirst(DistributedQueue.java:385)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.poll(DistributedQueue.java:188)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:229)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1652965 INFO  
(OverseerStateUpdate-94845609959292932-127.0.0.1:55083_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55083_solr
   [junit4]   2> 1652954 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x150f5946a210003, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1652976 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1652951 ERROR 
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]-EventThread) [    ] 
o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@6fef317c 
rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@4099fd4d[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 7]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1652950 INFO  (zkCallback-1301-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1652988 WARN  (zkCallback-1301-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1652949 INFO  (zkCallback-1298-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1653043 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:55083 55083
   [junit4]   2> 1653092 INFO  (Thread-3571) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:55083 55083
   [junit4]   2> 1653108 WARN  (Thread-3571) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2>        3       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1653115 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testPlaceholders
   [junit4]   2> 1653116 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845609959292932-127.0.0.1:55083_solr-n_0000000000) closing
   [junit4]   2> 1653124 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testOverseerFailure
   [junit4]   2> 1653125 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1653125 INFO  (Thread-3572) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1653125 INFO  (Thread-3572) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1653225 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:41639
   [junit4]   2> 1653226 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1653226 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1653231 INFO  (zkCallback-1304-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1db1cd83 
name:ZooKeeperConnection Watcher:127.0.0.1:41639 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1653231 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1653232 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1653234 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1653234 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1653236 INFO  (zkCallback-1305-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3cf36f51 
name:ZooKeeperConnection Watcher:127.0.0.1:41639 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1653237 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1653237 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1653237 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1653243 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1653244 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1653246 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2b946aee 
name:ZooKeeperConnection Watcher:127.0.0.1:41639/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1653246 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1653246 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1653247 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1653249 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1653252 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1653254 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1653257 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1653260 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1653263 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1653264 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1653266 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@11438d6 name:ZooKeeperConnection 
Watcher:127.0.0.1:41639/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1653267 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1653267 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1653270 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1653274 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1653277 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1653277 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1653277 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1653279 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1653294 INFO  (zkCallback-1308-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@559e22d2 
name:ZooKeeperConnection Watcher:127.0.0.1:41639/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1653294 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1653294 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1653294 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1653296 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1653301 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1653304 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1653305 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94845610071556100-127.0.0.1:41639_solr-n_0000000000
   [junit4]   2> 1653306 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41639_solr
   [junit4]   2> 1653306 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1653308 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845610071556100-127.0.0.1:41639_solr-n_0000000000) starting
   [junit4]   2> 1653310 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1653314 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1653323 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1653337 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1653419 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1653483 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1653506 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1653509 INFO  
(OverseerCollectionConfigSetProcessor-94845610071556100-127.0.0.1:41639_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1653515 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1653520 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1654546 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 1654549 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1654549 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1654549 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1654557 INFO  (zkCallback-1308-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1654558 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1654578 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1655044 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1655243 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1655246 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1655249 INFO  (zkCallback-1308-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1655278 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000000
   [junit4]   2> 1655283 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1655304 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1655326 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "core":"core1"} current state version: 1
   [junit4]   2> 1655331 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "core":"core1"}
   [junit4]   2> 1655339 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1"} current state version: 1
   [junit4]   2> 1655357 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1655361 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 1
   [junit4]   2> 1655362 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000001
   [junit4]   2> 1655363 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector was going to be leader 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000001
 , seq(0) 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000000
   [junit4]   2> 1655363 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1655363 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1655503 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1655503 INFO  (zkCallback-1308-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1655507 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1656599 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1656621 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000002
   [junit4]   2> 1656622 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector was going to be leader 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000002
 , seq(0) 
/collections/collection1/leader_elect/shard1/election/94845610071556099-node1_core1-n_0000000000
   [junit4]   2> 1656687 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1656688 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1656691 INFO  (zkCallback-1310-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@319ef2c name:ZooKeeperConnection 
Watcher:127.0.0.1:41639/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1656691 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1656691 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1656691 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845610071556100-127.0.0.1:41639_solr-n_0000000000) closing
   [junit4]   2> 1656691 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1656693 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1656694 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94845610071556101-127.0.0.1:41639_solr-n_0000000001
   [junit4]   2> 1656694 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41639_solr
   [junit4]   2> 1656694 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1656696 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845610071556101-127.0.0.1:41639_solr-n_0000000001) starting
   [junit4]   2> 1656697 INFO  
(OverseerStateUpdate-94845610071556100-127.0.0.1:41639_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41639_solr
   [junit4]   2> 1656705 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1656712 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1656713 INFO  
(OverseerCollectionConfigSetProcessor-94845610071556101-127.0.0.1:41639_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1656713 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1656715 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1656720 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 2
   [junit4]   2> 1656720 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1656720 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1656722 INFO  (zkCallback-1310-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1656727 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1656728 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1656798 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"deletecore",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1"} current state version: 3
   [junit4]   2> 1656902 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.o.ZkStateWriter going to delete_collection 
/collections/collection1/state.json
   [junit4]   2> 1656936 INFO  (zkCallback-1310-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1656938 INFO  (zkCallback-1310-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1656938 INFO  (zkCallback-1307-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1656938 INFO  (zkCallback-1306-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1656945 INFO  (zkCallback-1307-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1656946 INFO  (zkCallback-1306-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1657505 INFO  (zkCallback-1306-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1657517 INFO  (zkCallback-1307-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1657621 INFO  (zkCallback-1310-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1657637 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x150f59470d20005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1658718 INFO  
(OverseerCollectionConfigSetProcessor-94845610071556101-127.0.0.1:41639_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:355)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:172)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1658718 INFO  
(OverseerCollectionConfigSetProcessor-94845610071556101-127.0.0.1:41639_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor According to ZK I 
(id=94845610071556101-127.0.0.1:41639_solr-n_0000000001) am no longer a leader.
   [junit4]   2> 1659125 WARN  (zkCallback-1310-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1659149 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:41639 41639
   [junit4]   2> 1659177 INFO  (Thread-3572) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41639 41639
   [junit4]   2> 1659178 WARN  (Thread-3572) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/live_nodes
   [junit4]   2>        4       /solr/collections
   [junit4]   2>        2       /solr/overseer/queue-work
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/overseer/queue
   [junit4]   2> 
   [junit4]   2> 1659180 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testOverseerFailure
   [junit4]   2> 1659180 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845610071556101-127.0.0.1:41639_solr-n_0000000001) closing
   [junit4]   2> 1659181 INFO  
(OverseerStateUpdate-94845610071556101-127.0.0.1:41639_solr-n_0000000001) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41639_solr
   [junit4]   2> 1659189 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testReplay
   [junit4]   2> 1659190 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1659190 INFO  (Thread-3573) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1659190 INFO  (Thread-3573) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1659195 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1659290 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:40219
   [junit4]   2> 1659290 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1659292 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1659315 INFO  (zkCallback-1312-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ade03a9 
name:ZooKeeperConnection Watcher:127.0.0.1:40219/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1659315 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1659315 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1659315 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1659316 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1659319 INFO  (zkCallback-1313-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@22a1491 name:ZooKeeperConnection 
Watcher:127.0.0.1:40219 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1659319 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1659320 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1659323 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1659324 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1659326 INFO  (zkCallback-1314-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@28eedd37 
name:ZooKeeperConnection Watcher:127.0.0.1:40219 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1659326 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1659327 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1659327 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1659334 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1659337 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1659346 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1659353 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1659359 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1659362 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1659379 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1659396 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1659398 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1659403 INFO  (zkCallback-1315-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ab3b34f 
name:ZooKeeperConnection Watcher:127.0.0.1:40219/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1659404 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1659405 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1659405 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1659409 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1659413 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1659417 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] o.a.s.c.Overseer 
Overseer (id=null) closing
   [junit4]   2> 1659419 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94845610469163011-127.0.0.1:40219_solr-n_0000000000
   [junit4]   2> 1659421 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40219_solr
   [junit4]   2> 1659421 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1659427 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] o.a.s.c.Overseer 
Overseer (id=94845610469163011-127.0.0.1:40219_solr-n_0000000000) starting
   [junit4]   2> 1659429 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1659437 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1659441 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1659445 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1659449 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1659454 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1659455 INFO  
(OverseerCollectionConfigSetProcessor-94845610469163011-127.0.0.1:40219_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1659455 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1659456 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1659461 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1659461 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1659462 INFO  (zkCallback-1312-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1659462 INFO  (zkCallback-1315-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1659465 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1659466 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1659466 INFO  (zkCallback-1312-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1659467 INFO  (zkCallback-1315-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1659469 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 2
   [junit4]   2> 1659470 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1659766 INFO  (zkCallback-1312-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1659786 INFO  (zkCallback-1315-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1660008 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:40219 40219
   [junit4]   2> 1660026 INFO  (Thread-3573) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:40219 40219
   [junit4]   2> 1660031 WARN  (Thread-3573) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1660034 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testReplay
   [junit4]   2> 1660034 INFO  
(TEST-OverseerTest.testReplay-seed#[B8F1A293A26DD72E]) [    ] o.a.s.c.Overseer 
Overseer (id=94845610469163011-127.0.0.1:40219_solr-n_0000000000) closing
   [junit4]   2> 1660036 INFO  
(OverseerStateUpdate-94845610469163011-127.0.0.1:40219_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40219_solr
   [junit4]   2> 1660047 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1660087 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalClusterStateChangeBehavior
   [junit4]   2> 1660094 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1660094 INFO  (Thread-3574) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1660094 INFO  (Thread-3574) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1660194 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.ZkTestServer start zk server on port:55827
   [junit4]   2> 1660195 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1660195 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1660204 INFO  (zkCallback-1317-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b95d527 
name:ZooKeeperConnection Watcher:127.0.0.1:55827/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1660205 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1660205 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1660205 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1660205 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1660210 INFO  (zkCallback-1318-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4b0472b4 
name:ZooKeeperConnection Watcher:127.0.0.1:55827 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1660210 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1660210 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1660214 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1660215 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1660225 INFO  (zkCallback-1319-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@48399d87 
name:ZooKeeperConnection Watcher:127.0.0.1:55827 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1660225 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1660225 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1660225 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1660231 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1660233 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1660235 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1660237 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1660240 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1660244 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1660248 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1660249 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1660254 INFO  (zkCallback-1320-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3e89126f 
name:ZooKeeperConnection Watcher:127.0.0.1:55827/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1660255 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1660255 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1660256 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1660258 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1660261 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1660263 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1660263 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94845610528276483-127.0.0.1:55827_solr-n_0000000000
   [junit4]   2> 1660264 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 
127.0.0.1:55827_solr
   [junit4]   2> 1660264 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1660266 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.Overseer Overseer 
(id=94845610528276483-127.0.0.1:55827_solr-n_0000000000) starting
   [junit4]   2> 1660269 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1660273 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1660276 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1660283 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1660286 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1660289 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1660294 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[B8F1A293A26DD72E])
 [    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1660295 INFO  
(OverseerCollectionConfigSetProcessor-94845610528276483-127.0.0.1:55827_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1660295 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1660296 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1660302 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"} current state version: 0
   [junit4]   2> 1660302 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"}
   [junit4]   2> 1660303 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1660304 INFO  (zkCallback-1317-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1660304 INFO  (zkCallback-1320-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1660356 INFO  (zkCallback-1317-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1660356 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 1
   [junit4]   2> 1660357 INFO  (zkCallback-1320-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1660358 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1660358 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1660358 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1660361 INFO  
(OverseerStateUpdate-94845610528276483-127.0.0.1:55827_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1660362 INFO  (OverseerStateUpdate-94845610528276

[...truncated too long message...]

der_elect/shard2/election/94845614078754820-127.0.0.1_core3-n_0000000000
   [junit4]   2> 1717907 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard2
   [junit4]   2> 1717911 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1717930 INFO  
(OverseerStateUpdate-94845614078754819-127.0.0.1:43230_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core3"} current state version: 7
   [junit4]   2> 1718035 INFO  (zkCallback-1399-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1718035 INFO  (zkCallback-1401-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1718035 INFO  (zkCallback-1398-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1718082 INFO  (zkCallback-1401-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1718082 INFO  (zkCallback-1399-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1718088 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:43230 43230
   [junit4]   2> 1718112 INFO  (Thread-3582) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:43230 43230
   [junit4]   2> 1718117 WARN  (Thread-3582) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2>        3       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1718120 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testBadQueueItem
   [junit4]   2> 1718120 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[B8F1A293A26DD72E]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94845614078754819-127.0.0.1:43230_solr-n_0000000000) closing
   [junit4]   2> 1718125 INFO  
(OverseerStateUpdate-94845614078754819-127.0.0.1:43230_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43230_solr
   [junit4]   2> 1718126 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1721126 INFO  
(SUITE-OverseerTest-seed#[B8F1A293A26DD72E]-worker) [    ] o.a.s.SolrTestCaseJ4 
###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.OverseerTest_B8F1A293A26DD72E-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=mt_MT, 
timezone=America/Noronha
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.7.0_91 
(64-bit)/cpus=3,threads=1,free=136634528,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: 
[DistributedTermsComponentTest, FieldAnalysisRequestHandlerTest, 
TestRebalanceLeaders, DistributedFacetPivotSmallTest, 
TestFuzzyAnalyzedSuggestions, FieldMutatingUpdateProcessorTest, 
TestRawResponseWriter, TestFoldingMultitermQuery, TestDistributedMissingSort, 
TestSchemaManager, OutOfBoxZkACLAndCredentialsProvidersTest, 
FacetPivotSmallTest, MigrateRouteKeyTest, OpenCloseCoreStressTest, FullHLLTest, 
TestReplicationHandlerBackup, ResponseHeaderTest, HLLSerializationTest, 
TermVectorComponentTest, TestNoOpRegenerator, TestFieldCollectionResource, 
NoCacheHeaderTest, EchoParamsTest, TestInitParams, 
DistributedQueryComponentCustomSortTest, TestReqParamsAPI, DateMathParserTest, 
PreAnalyzedUpdateProcessorTest, SignatureUpdateProcessorFactoryTest, 
TestUniqueKeyFieldResource, DeleteLastCustomShardedReplicaTest, 
UpdateRequestProcessorFactoryTest, TestRangeQuery, CoreAdminRequestStatusTest, 
TestWriterPerf, TestTrackingShardHandlerFactory, TestUtils, 
CollectionsAPIDistributedZkTest, OverseerCollectionConfigSetProcessorTest, 
TestQueryUtils, TestHashQParserPlugin, TestDocBasedVersionConstraints, 
TestStressUserVersions, TestNRTOpen, TestSolrQueryParserResource, 
SolrCloudExampleTest, TestSolrQueryParser, TestBinaryResponseWriter, 
SolrCmdDistributorTest, TestConfigSetsAPIExclusivity, TestCSVResponseWriter, 
SpatialRPTFieldTypeTest, TestRestoreCore, TestCrossCoreJoin, 
LoggingHandlerTest, TestLeaderElectionZkExpiry, IndexSchemaRuntimeFieldTest, 
QueryParsingTest, ShardRoutingCustomTest, TestIndexSearcher, 
TestShardHandlerFactory, TestReRankQParserPlugin, SpellCheckCollatorTest, 
DefaultValueUpdateProcessorTest, ActionThrottleTest, TestRandomFaceting, 
TestSolrCoreProperties, SearchHandlerTest, TestCollationField, 
TestBulkSchemaConcurrent, AnalysisErrorHandlingTest, HdfsThreadLeakTest, 
BadCopyFieldTest, SuggestComponentContextFilterQueryTest, 
TestComplexPhraseQParserPlugin, TestDistributedStatsComponentCardinality, 
NumericFieldsTest, ZkStateReaderTest, ResponseLogComponentTest, 
TestPerFieldSimilarity, BinaryUpdateRequestHandlerTest, SynonymTokenizerTest, 
MultiTermTest, SolrIndexSplitterTest, TestAtomicUpdateErrorCases, 
TestCollectionAPI, TestRealTimeGet, AutoCommitTest, BasicZkTest, 
SpellPossibilityIteratorTest, TestRTimerTree, 
TestLeaderInitiatedRecoveryThread, DistributedVersionInfoTest, 
OutputWriterTest, RAMDirectoryFactoryTest, TestTrie, SpellCheckComponentTest, 
HttpPartitionTest, TestDynamicFieldCollectionResource, TestSchemaNameResource, 
HdfsUnloadDistributedZkTest, TriLevelCompositeIdRoutingTest, InfoHandlerTest, 
TestQuerySenderListener, SolrCoreCheckLockOnStartupTest, TestRestManager, 
TestSolrIndexConfig, TestReplicaProperties, TestEmbeddedSolrServerConstructors, 
TestQueryTypes, BlockCacheTest, DateFieldTest, ZkStateWriterTest, 
TestSystemIdResolver, AliasIntegrationTest, SolrInfoMBeanTest, 
TestIndexingPerformance, TestBM25SimilarityFactory, SolrPluginUtilsTest, 
FileUtilsTest, CollectionStateFormat2Test, TestBinaryField, 
TestSha256AuthenticationProvider, TestValueSourceCache, TestBadConfig, 
TestSolrConfigHandlerConcurrent, PKIAuthenticationIntegrationTest, 
TestLMJelinekMercerSimilarityFactory, TestManagedSynonymFilterFactory, 
TestJsonRequest, TermVectorComponentDistributedTest, TestDynamicLoading, 
CacheHeaderTest, FileBasedSpellCheckerTest, ChaosMonkeySafeLeaderTest, 
BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, 
OverseerTest]
   [junit4] Completed [277/545] on J1 in 69.74s, 12 tests, 1 error, 1 skipped 
<<< FAILURES!

[...truncated 857 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/build.xml:785: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/build.xml:729: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/build.xml:59: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/solr/build.xml:233: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/solr/common-build.xml:526:
 The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/lucene/common-build.xml:1452:
 The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-5.x-Solaris/lucene/common-build.xml:1006:
 There were test failures: 545 suites (7 ignored), 2158 tests, 1 error, 51 
ignored (37 assumptions) [seed: B8F1A293A26DD72E]

Total time: 83 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to