Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3728/

1 tests failed.
FAILED:  org.apache.solr.cloud.OverseerTest.testOverseerStatsReset

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
        at 
__randomizedtesting.SeedInfo.seed([73782F4BC38246B9:D82CC8775658E5B7]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at 
org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:722)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10497 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.OverseerTest_73782F4BC38246B9-001/init-core-data-001
   [junit4]   2> 1070136 INFO  
(SUITE-OverseerTest-seed#[73782F4BC38246B9]-worker) [    ] o.a.s.SolrTestCaseJ4 
Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1070136 INFO  
(SUITE-OverseerTest-seed#[73782F4BC38246B9]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore
   [junit4]   2> 1070136 INFO  
(SUITE-OverseerTest-seed#[73782F4BC38246B9]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore end
   [junit4]   2> 1070143 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalClusterStateChangeBehavior
   [junit4]   2> 1070143 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1070144 INFO  (Thread-4886) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1070144 INFO  (Thread-4886) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1070244 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.ZkTestServer start zk server on port:55832
   [junit4]   2> 1070244 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1070245 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1070247 INFO  (zkCallback-833-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4732d3c4 
name:ZooKeeperConnection Watcher:127.0.0.1:55832/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1070248 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1070248 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1070248 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1070249 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1070250 INFO  (zkCallback-834-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@540d73cd 
name:ZooKeeperConnection Watcher:127.0.0.1:55832 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1070250 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1070251 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1070252 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1070252 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1070254 INFO  (zkCallback-835-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@47548155 
name:ZooKeeperConnection Watcher:127.0.0.1:55832 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1070254 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1070254 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1070254 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1070260 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1070262 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1070263 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1070264 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1070267 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1070268 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1070270 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1070271 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1070272 INFO  (zkCallback-836-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6a863f95 
name:ZooKeeperConnection Watcher:127.0.0.1:55832/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1070272 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1070273 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1070273 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1070277 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1070278 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1070279 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1070280 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94825936247521283-127.0.0.1:55832_solr-n_0000000000
   [junit4]   2> 1070280 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 
127.0.0.1:55832_solr
   [junit4]   2> 1070280 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1070286 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.Overseer Overseer 
(id=94825936247521283-127.0.0.1:55832_solr-n_0000000000) starting
   [junit4]   2> 1070288 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1070292 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1070297 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1070299 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1070302 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1070304 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1070312 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1070313 INFO  
(OverseerCollectionConfigSetProcessor-94825936247521283-127.0.0.1:55832_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1070313 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1070314 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1070321 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"} current state version: 0
   [junit4]   2> 1070321 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"}
   [junit4]   2> 1070321 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1070323 INFO  (zkCallback-833-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070323 INFO  (zkCallback-836-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070379 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 1
   [junit4]   2> 1070379 INFO  (zkCallback-836-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070379 INFO  (zkCallback-833-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070380 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1070380 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1070380 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1070384 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1070384 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1070385 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1070385 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1070389 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"test",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 1
   [junit4]   2> 1070389 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: test
   [junit4]   2> 1070391 WARN  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer Bad version writing to ZK using compare-and-set, will force 
refresh cluster state
   [junit4]   2> org.apache.zookeeper.KeeperException$BadVersionException: 
KeeperErrorCode = BadVersion for /clusterstate.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:115)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:362)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:359)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:359)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:251)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.enqueueUpdate(ZkStateWriter.java:118)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.processQueueItem(Overseer.java:290)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:214)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1070399 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1070399 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1070399 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1070399 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1070400 INFO  (zkCallback-833-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070400 INFO  (zkCallback-836-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070409 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1070410 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1070410 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1070410 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1070410 INFO  (zkCallback-836-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070410 INFO  (zkCallback-833-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1070413 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"test",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 4
   [junit4]   2> 1070414 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: test
   [junit4]   2> 1070418 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"createshard",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "replicationFactor":"1"} current state version: 4
   [junit4]   2> 1070422 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} current state version: 4
   [junit4]   2> 1070422 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} 
   [junit4]   2> 1070527 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/test/state.json
   [junit4]   2> 1070551 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55832 55832
   [junit4]   2> 1070902 INFO  (Thread-4886) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:55832 55832
   [junit4]   2> 1070904 WARN  (Thread-4886) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/collections
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 1070904 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalClusterStateChangeBehavior
   [junit4]   2> 1070904 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[73782F4BC38246B9])
 [    ] o.a.s.c.Overseer Overseer 
(id=94825936247521283-127.0.0.1:55832_solr-n_0000000000) closing
   [junit4]   2> 1070904 INFO  
(OverseerStateUpdate-94825936247521283-127.0.0.1:55832_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55832_solr
   [junit4]   2> 1070909 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1070917 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testStateChange
   [junit4]   2> 1070918 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1070918 INFO  (Thread-4887) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1070918 INFO  (Thread-4887) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1071018 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:49932
   [junit4]   2> 1071018 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071019 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071022 INFO  (zkCallback-838-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@518c625a 
name:ZooKeeperConnection Watcher:127.0.0.1:49932/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071022 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071022 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071022 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071023 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071025 INFO  (zkCallback-839-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3a25aa7b 
name:ZooKeeperConnection Watcher:127.0.0.1:49932 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071025 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071025 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071026 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071027 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071028 INFO  (zkCallback-840-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7f965a3c 
name:ZooKeeperConnection Watcher:127.0.0.1:49932 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071028 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071028 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071028 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1071034 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1071037 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1071039 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1071040 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1071048 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1071048 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1071050 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071051 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071052 INFO  (zkCallback-841-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@32dff137 
name:ZooKeeperConnection Watcher:127.0.0.1:49932/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071052 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071052 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071053 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1071054 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1071057 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1071059 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1071059 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94825936298246147-127.0.0.1:49932_solr-n_0000000000
   [junit4]   2> 1071061 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49932_solr
   [junit4]   2> 1071061 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1071063 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825936298246147-127.0.0.1:49932_solr-n_0000000000) starting
   [junit4]   2> 1071064 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1071070 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1071074 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1071077 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1071081 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1071085 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1071098 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1071098 INFO  
(OverseerCollectionConfigSetProcessor-94825936298246147-127.0.0.1:49932_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1071098 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1071101 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1071105 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 0
   [junit4]   2> 1071106 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1071106 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1071109 INFO  (zkCallback-841-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1071109 INFO  (zkCallback-838-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1071156 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1071157 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1071157 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1071157 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1071260 INFO  (zkCallback-838-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1071260 INFO  (zkCallback-841-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1071308 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:49932 49932
   [junit4]   2> 1071458 INFO  (Thread-4887) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:49932 49932
   [junit4]   2> 1071459 WARN  (Thread-4887) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/collections
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 1071460 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testStateChange
   [junit4]   2> 1071460 INFO  
(TEST-OverseerTest.testStateChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825936298246147-127.0.0.1:49932_solr-n_0000000000) closing
   [junit4]   2> 1071460 INFO  
(OverseerStateUpdate-94825936298246147-127.0.0.1:49932_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:49932_solr
   [junit4]   2> 1071460 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1071466 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testOverseerFailure
   [junit4]   2> 1071467 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1071467 INFO  (Thread-4888) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1071467 INFO  (Thread-4888) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1071567 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:55728
   [junit4]   2> 1071567 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071568 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071570 INFO  (zkCallback-843-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@27b33259 
name:ZooKeeperConnection Watcher:127.0.0.1:55728 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071570 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071571 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071572 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071572 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071573 INFO  (zkCallback-844-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@14dc0e51 
name:ZooKeeperConnection Watcher:127.0.0.1:55728 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071573 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071574 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071574 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1071583 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071583 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071584 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@45050066 
name:ZooKeeperConnection Watcher:127.0.0.1:55728/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071584 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071585 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071585 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1071586 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1071587 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1071593 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1071596 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1071598 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1071603 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071604 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071621 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3f5ef1b4 
name:ZooKeeperConnection Watcher:127.0.0.1:55728/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071621 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071621 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071624 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1071626 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1071627 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1071628 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1071629 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1071637 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1071637 INFO  (zkCallback-847-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6f23c054 
name:ZooKeeperConnection Watcher:127.0.0.1:55728/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1071637 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1071638 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1071638 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1071639 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1071641 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1071642 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1071643 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94825936334225412-127.0.0.1:55728_solr-n_0000000000
   [junit4]   2> 1071644 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55728_solr
   [junit4]   2> 1071644 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1071645 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825936334225412-127.0.0.1:55728_solr-n_0000000000) starting
   [junit4]   2> 1071646 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1071654 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1071656 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1071658 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1071660 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1071662 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1071667 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1071667 INFO  
(OverseerCollectionConfigSetProcessor-94825936334225412-127.0.0.1:55728_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1071668 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1071669 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1072670 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 1072671 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1072671 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1072671 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1072672 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1072672 INFO  (zkCallback-847-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1072672 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1073171 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1073172 INFO  (zkCallback-847-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1073172 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1073173 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1073176 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000000
   [junit4]   2> 1073176 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1073178 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1073181 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "core":"core1"} current state version: 1
   [junit4]   2> 1073181 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "core":"core1"}
   [junit4]   2> 1073184 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1"} current state version: 1
   [junit4]   2> 1073189 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 1
   [junit4]   2> 1073189 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1073189 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1073190 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1073192 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000001
   [junit4]   2> 1073193 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector was going to be leader 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000001
 , seq(0) 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000000
   [junit4]   2> 1073291 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1073291 INFO  (zkCallback-847-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1073292 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1073675 INFO  
(OverseerCollectionConfigSetProcessor-94825936334225412-127.0.0.1:55728_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:355)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:172)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1073675 INFO  
(OverseerCollectionConfigSetProcessor-94825936334225412-127.0.0.1:55728_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor According to ZK I 
(id=94825936334225412-127.0.0.1:55728_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 1074345 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1074347 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000002
   [junit4]   2> 1074348 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector was going to be leader 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000002
 , seq(0) 
/collections/collection1/leader_elect/shard1/election/94825936334225411-node1_core1-n_0000000000
   [junit4]   2> 1074348 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1074352 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1074353 INFO  (zkCallback-849-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@257ff11c 
name:ZooKeeperConnection Watcher:127.0.0.1:55728/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1074353 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1074353 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1074354 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825936334225412-127.0.0.1:55728_solr-n_0000000000) closing
   [junit4]   2> 1074354 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1074354 INFO  
(OverseerStateUpdate-94825936334225412-127.0.0.1:55728_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55728_solr
   [junit4]   2> 1074362 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1074363 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1074371 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94825936334225413-127.0.0.1:55728_solr-n_0000000001
   [junit4]   2> 1074376 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55728_solr
   [junit4]   2> 1074376 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1074377 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825936334225413-127.0.0.1:55728_solr-n_0000000001) starting
   [junit4]   2> 1074387 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1074402 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1074403 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1074406 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 2
   [junit4]   2> 1074407 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1074407 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1074412 INFO  
(OverseerCollectionConfigSetProcessor-94825936334225413-127.0.0.1:55728_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1074419 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1074420 INFO  (zkCallback-849-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1074421 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1074433 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"deletecore",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1"} current state version: 3
   [junit4]   2> 1074535 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.o.ZkStateWriter going to delete_collection 
/collections/collection1/state.json
   [junit4]   2> 1074540 INFO  (zkCallback-849-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1074540 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1074541 INFO  (zkCallback-849-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1074541 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1074541 INFO  (zkCallback-845-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1074543 INFO  (zkCallback-845-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1075042 INFO  (zkCallback-846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1075043 INFO  (zkCallback-845-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1075043 INFO  (zkCallback-849-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1075046 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:55728 55728
   [junit4]   2> 1075228 INFO  (Thread-4888) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:55728 55728
   [junit4]   2> 1075229 WARN  (Thread-4888) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/collections
   [junit4]   2>        4       /solr/live_nodes
   [junit4]   2>        2       /solr/overseer/queue
   [junit4]   2>        2       /solr/overseer/queue-work
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1075230 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testOverseerFailure
   [junit4]   2> 1075230 INFO  
(TEST-OverseerTest.testOverseerFailure-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825936334225413-127.0.0.1:55728_solr-n_0000000001) closing
   [junit4]   2> 1075230 INFO  
(OverseerStateUpdate-94825936334225413-127.0.0.1:55728_solr-n_0000000001) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55728_solr
   [junit4]   2> 1075233 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1075239 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testShardLeaderChange
   [junit4]   2> 1075239 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1075240 INFO  (Thread-4889) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1075240 INFO  (Thread-4889) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1075340 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:56420
   [junit4]   2> 1075340 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1075340 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1075344 INFO  (zkCallback-851-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c91db70 
name:ZooKeeperConnection Watcher:127.0.0.1:56420/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1075344 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1075344 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1075345 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1075349 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1075354 INFO  (zkCallback-852-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@53b963e0 
name:ZooKeeperConnection Watcher:127.0.0.1:56420 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1075354 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1075355 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1075356 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1075357 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1075358 INFO  (zkCallback-853-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@205ac60a 
name:ZooKeeperConnection Watcher:127.0.0.1:56420 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1075358 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1075359 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1075359 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1075362 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1075364 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1075366 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1075367 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1075368 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1075370 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1075370 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
Using default ZkCredentialsProvider
   [junit4]   2> 1075371 INFO  (Thread-4890) [    ] o.a.s.c.c.ConnectionManager 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1075373 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1075373 INFO  (zkCallback-855-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4a58a348 
name:ZooKeeperConnection Watcher:127.0.0.1:56420/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1075373 INFO  (Thread-4890) [    ] o.a.s.c.c.ConnectionManager 
Client is connected to ZooKeeper
   [junit4]   2> 1075374 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
Using default ZkACLProvider
   [junit4]   2> 1075374 INFO  (Thread-4890) [    ] o.a.s.u.UpdateShardHandler 
Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1075374 INFO  (zkCallback-854-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@494316d5 
name:ZooKeeperConnection Watcher:127.0.0.1:56420/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1075374 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1075374 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1075375 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect
   [junit4]   2> 1075376 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1075376 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect/election
   [junit4]   2> 1075377 INFO  (Thread-4890) [    ] o.a.s.c.Overseer Overseer 
(id=null) closing
   [junit4]   2> 1075378 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1075378 INFO  (Thread-4890) [    ] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/overseer_elect/election/94825936581492739-127.0.0.1:56420_solr-n_0000000000
   [junit4]   2> 1075379 INFO  (Thread-4890) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56420_solr
   [junit4]   2> 1075379 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect/leader
   [junit4]   2> 1075380 INFO  (zkCallback-854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1075380 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1075380 INFO  (Thread-4890) [    ] o.a.s.c.Overseer Overseer 
(id=94825936581492739-127.0.0.1:56420_solr-n_0000000000) starting
   [junit4]   2> 1075382 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/queue
   [junit4]   2> 1075385 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/queue-work
   [junit4]   2> 1075387 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-map-failure
   [junit4]   2> 1075390 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-map-running
   [junit4]   2> 1075393 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-map-completed
   [junit4]   2> 1075395 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-queue-work
   [junit4]   2> 1075399 INFO  (Thread-4890) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1075399 INFO  (Thread-4890) [    ] o.a.s.SolrTestCaseJ4 
Killing overseer.
   [junit4]   2> 1075399 INFO  
(OverseerCollectionConfigSetProcessor-94825936581492739-127.0.0.1:56420_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1075400 INFO  
(OverseerStateUpdate-94825936581492739-127.0.0.1:56420_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1075401 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
Using default ZkCredentialsProvider
   [junit4]   2> 1075409 INFO  (Thread-4890) [    ] o.a.s.c.c.ConnectionManager 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 1075409 INFO  (zkCallback-857-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6f3e62b4 
name:ZooKeeperConnection Watcher:127.0.0.1:56420/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1075409 INFO  (Thread-4890) [    ] o.a.s.c.c.ConnectionManager 
Client is connected to ZooKeeper
   [junit4]   2> 1075409 INFO  (Thread-4890) [    ] o.a.s.c.c.SolrZkClient 
Using default ZkACLProvider
   [junit4]   2> 1075409 INFO  (Thread-4890) [    ] o.a.s.c.Overseer Overseer 
(id=94825936581492739-127.0.0.1:56420_solr-n_0000000000) closing
   [junit4]   2> 1075410 INFO  
(OverseerStateUpdate-94825936581492739-127.0.0.1:56420_solr-n_0000000000) [    
] o.a.s.c.Overseer According to ZK I 
(id=94825936581492739-127.0.0.1:56420_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 1075410 INFO  (Thread-4890) [    ] o.a.s.u.UpdateShardHandler 
Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1075410 INFO  
(OverseerStateUpdate-94825936581492739-127.0.0.1:56420_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:56420_solr
   [junit4]   2> 1075410 INFO  
(OverseerCollectionConfigSetProcessor-94825936581492739-127.0.0.1:56420_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor According to ZK I 
(id=94825936581492739-127.0.0.1:56420_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 1075412 ERROR 
(OverseerCollectionConfigSetProcessor-94825936581492739-127.0.0.1:56420_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor 
:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode 
= Session expired for /overseer/collection-queue-work
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:325)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:325)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.fetchZkChildren(DistributedQueue.java:311)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskQueue.getTailId(OverseerTaskQueue.java:270)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:144)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1075412 ERROR 
(OverseerCollectionConfigSetProcessor-94825936581492739-127.0.0.1:56420_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Unable to prioritize overseer 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /roles.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerNodePrioritizer.prioritizeOverseerNodes(OverseerNodePrioritizer.java:59)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:159)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1075415 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookee

[...truncated too long message...]

ning new node to shard shard=shard2
   [junit4]   2> 1142806 INFO  (zkCallback-953-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1142806 INFO  (zkCallback-955-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1142806 INFO  (zkCallback-952-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1143201 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard2/election
   [junit4]   2> 1143205 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard2/election/94825940814004228-127.0.0.1_core3-n_0000000000
   [junit4]   2> 1143206 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard2
   [junit4]   2> 1143208 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1143212 INFO  
(OverseerStateUpdate-94825940814004227-127.0.0.1:46666_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core3"} current state version: 7
   [junit4]   2> 1143316 INFO  (zkCallback-952-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1143316 INFO  (zkCallback-953-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1143317 INFO  (zkCallback-955-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1143363 INFO  (zkCallback-955-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1143363 INFO  (zkCallback-953-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1144863 WARN  (zkCallback-955-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1144865 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:46666 46666
   [junit4]   2> 1144987 INFO  (Thread-4897) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:46666 46666
   [junit4]   2> 1144988 WARN  (Thread-4897) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/collections
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 1144988 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testBadQueueItem
   [junit4]   2> 1144989 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[73782F4BC38246B9]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94825940814004227-127.0.0.1:46666_solr-n_0000000000) closing
   [junit4]   2> 1144989 INFO  
(OverseerStateUpdate-94825940814004227-127.0.0.1:46666_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46666_solr
   [junit4]   2> 1144990 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1147990 INFO  
(SUITE-OverseerTest-seed#[73782F4BC38246B9]-worker) [    ] o.a.s.SolrTestCaseJ4 
###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.OverseerTest_73782F4BC38246B9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {}, 
docValues:{}, sim=DefaultSimilarity, locale=in, timezone=SystemV/MST7MDT
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.7.0_80 (64-bit)/cpus=4,threads=1,free=98354112,total=520093696
   [junit4]   2> NOTE: All tests run in this JVM: [MBeansHandlerTest, 
TimeZoneUtilsTest, TestManagedResourceStorage, TestFiltering, 
DistributedQueueTest, TestQuerySenderListener, ExitableDirectoryReaderTest, 
TestFieldCollectionResource, HighlighterMaxOffsetTest, ShardRoutingTest, 
TestBM25SimilarityFactory, ZkCLITest, FileUtilsTest, TestDistributedGrouping, 
HdfsNNFailoverTest, TestLMJelinekMercerSimilarityFactory, 
AnalysisErrorHandlingTest, IndexBasedSpellCheckerTest, TestCrossCoreJoin, 
TestClusterStateMutator, BasicFunctionalityTest, DocumentBuilderTest, 
TestCloudSchemaless, DistributedTermsComponentTest, AsyncMigrateRouteKeyTest, 
DistributedFacetPivotWhiteBoxTest, TestStressVersions, DistanceFunctionTest, 
MultiTermTest, TestMissingGroups, CloudExitableDirectoryReaderTest, 
TestManagedStopFilterFactory, DOMUtilTest, TestManagedResource, 
TestClassicSimilarityFactory, TestExpandComponent, DocValuesTest, 
TestExactStatsCache, TestCodecSupport, DataDrivenBlockJoinTest, 
TestSerializedLuceneMatchVersion, TestLFUCache, ConnectionManagerTest, 
CollectionStateFormat2Test, SolrCmdDistributorTest, TestQueryUtils, 
TestMiniSolrCloudClusterBase, OpenCloseCoreStressTest, 
CollectionsAPIDistributedZkTest, SpellCheckCollatorTest, SpatialFilterTest, 
PKIAuthenticationIntegrationTest, TestUpdate, 
DistributedFacetPivotSmallAdvancedTest, TestHashPartitioner, 
TestWordDelimiterFilterFactory, UniqFieldsUpdateProcessorFactoryTest, 
BigEndianAscendingWordSerializerTest, TestHighlightDedupGrouping, 
SSLMigrationTest, ResponseHeaderTest, OutOfBoxZkACLAndCredentialsProvidersTest, 
TestSchemaSimilarityResource, TestQuerySenderNoQuery, HdfsRecoverLeaseTest, 
TestSolrDeletionPolicy2, RecoveryAfterSoftCommitTest, DistanceUnitsTest, 
DistributedVersionInfoTest, TestCursorMarkWithoutUniqueKey, 
TestMiniSolrCloudCluster, ClusterStateUpdateTest, TestSchemaResource, 
TestPivotHelperCode, ShardRoutingCustomTest, HLLUtilTest, DeleteReplicaTest, 
TestFastLRUCache, TestManagedSynonymFilterFactory, TestHdfsUpdateLog, 
DistributedMLTComponentTest, SpatialHeatmapFacetsTest, MinimalSchemaTest, 
TestLRUStatsCache, TestSystemIdResolver, SolrIndexConfigTest, 
TestRandomMergePolicy, OverseerTest]
   [junit4] Completed [279/545] on J1 in 77.88s, 12 tests, 1 failure, 1 skipped 
<<< FAILURES!

[...truncated 830 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:785: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:729: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:526:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1452:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1006:
 There were test failures: 545 suites (7 ignored), 2158 tests, 1 failure, 51 
ignored (37 assumptions) [seed: 73782F4BC38246B9]

Total time: 60 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to