Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/14260/
Java: 32bit/jdk1.9.0-ea-b78 -client -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       
"parent":null,       "range":null,       "state":"active",       
"replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr";,        
   "node_name":"node1",           "core":"core1",           "roles":"",         
  "state":"down"}}}},   "router":{"name":"implicit"}}, 
test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active 
clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr";,
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
        at 
__randomizedtesting.SeedInfo.seed([1F14A222D7145675:770AA1CE35840C3B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:601)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1261)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:504)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:746)




Build Log:
[...truncated 10087 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_1F14A222D7145675-001/init-core-data-001
   [junit4]   2> 1057043 INFO  
(SUITE-OverseerTest-seed#[1F14A222D7145675]-worker) [    ] o.a.s.SolrTestCaseJ4 
Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1057043 INFO  
(SUITE-OverseerTest-seed#[1F14A222D7145675]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore
   [junit4]   2> 1057043 INFO  
(SUITE-OverseerTest-seed#[1F14A222D7145675]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore end
   [junit4]   2> 1057045 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testReplay
   [junit4]   2> 1057045 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1057045 INFO  (Thread-3136) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1057045 INFO  (Thread-3136) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1057145 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:49574
   [junit4]   2> 1057146 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057148 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057151 INFO  (zkCallback-902-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@13945c9 name:ZooKeeperConnection 
Watcher:127.0.0.1:49574/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1057151 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057160 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057160 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057161 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057162 INFO  (zkCallback-903-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@87581f name:ZooKeeperConnection 
Watcher:127.0.0.1:49574 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1057162 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057162 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057163 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057177 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057177 INFO  (zkCallback-904-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@135ad23 name:ZooKeeperConnection 
Watcher:127.0.0.1:49574 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1057177 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057178 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057178 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1057188 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1057189 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1057190 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1057191 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1057192 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1057193 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1057196 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1057198 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057202 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057203 INFO  (zkCallback-905-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b199c6 name:ZooKeeperConnection 
Watcher:127.0.0.1:49574/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1057204 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057204 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057204 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1057216 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1057217 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1057218 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] o.a.s.c.Overseer 
Overseer (id=null) closing
   [junit4]   2> 1057219 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94554527247237123-127.0.0.1:49574_solr-n_0000000000
   [junit4]   2> 1057228 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49574_solr
   [junit4]   2> 1057228 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1057234 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] o.a.s.c.Overseer 
Overseer (id=94554527247237123-127.0.0.1:49574_solr-n_0000000000) starting
   [junit4]   2> 1057234 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1057238 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1057239 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1057241 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1057242 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1057252 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1057260 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1057261 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1057262 INFO  
(OverseerCollectionConfigSetProcessor-94554527247237123-127.0.0.1:49574_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1057263 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 0, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1057263 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1057264 INFO  (zkCallback-902-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1057264 INFO  (zkCallback-905-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1057265 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 0, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1057265 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1057265 INFO  (zkCallback-905-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1057265 INFO  (zkCallback-902-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1057267 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 2
   [junit4]   2> 1057267 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1057369 INFO  (zkCallback-902-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1057370 INFO  (zkCallback-905-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1057465 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:49574 49574
   [junit4]   2> 1057488 INFO  (Thread-3136) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:49574 49574
   [junit4]   2> 1057489 WARN  (Thread-3136) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1057489 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testReplay
   [junit4]   2> 1057489 INFO  
(TEST-OverseerTest.testReplay-seed#[1F14A222D7145675]) [    ] o.a.s.c.Overseer 
Overseer (id=94554527247237123-127.0.0.1:49574_solr-n_0000000000) closing
   [junit4]   2> 1057490 INFO  
(OverseerStateUpdate-94554527247237123-127.0.0.1:49574_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:49574_solr
   [junit4]   2> 1057490 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1057496 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testPlaceholders
   [junit4]   2> 1057496 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1057496 INFO  (Thread-3137) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1057496 INFO  (Thread-3137) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1057596 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:43322
   [junit4]   2> 1057597 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057597 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057605 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@109f2c9 name:ZooKeeperConnection 
Watcher:127.0.0.1:43322/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1057605 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057606 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057606 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057607 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057609 INFO  (zkCallback-908-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@b1ce68 name:ZooKeeperConnection 
Watcher:127.0.0.1:43322 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1057609 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057610 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057612 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057612 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057614 INFO  (zkCallback-909-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c5e1d8 name:ZooKeeperConnection 
Watcher:127.0.0.1:43322 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1057614 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057615 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057615 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1057618 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1057620 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1057621 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1057621 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1057622 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1057623 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1057625 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057630 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057658 INFO  (zkCallback-910-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@18f4dc9 name:ZooKeeperConnection 
Watcher:127.0.0.1:43322/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1057658 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057659 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057660 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1057662 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1057663 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1057664 INFO  (zkCallback-910-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1057665 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1057669 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1057670 INFO  (zkCallback-911-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@950202 name:ZooKeeperConnection 
Watcher:127.0.0.1:43322/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1057670 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1057671 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1057671 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1057672 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1057673 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1057674 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1057676 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94554527276793860-127.0.0.1:43322_solr-n_0000000000
   [junit4]   2> 1057677 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43322_solr
   [junit4]   2> 1057677 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1057681 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554527276793860-127.0.0.1:43322_solr-n_0000000000) starting
   [junit4]   2> 1057682 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1057693 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1057694 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1057695 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1057698 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1057700 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1057703 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1057703 INFO  
(OverseerCollectionConfigSetProcessor-94554527276793860-127.0.0.1:43322_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1057703 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1057704 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1057706 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"12",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 1057706 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=12 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"12",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1057706 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1057706 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1057707 INFO  (zkCallback-911-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1057707 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1057707 INFO  (zkCallback-910-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1058205 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1058207 INFO  (zkCallback-910-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1058207 INFO  (zkCallback-911-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1058207 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1058211 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard2/election/94554527276793859-node1_core1-n_0000000000
   [junit4]   2> 1058212 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1058214 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1058217 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1058217 WARN  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer/queue-work/qn-
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:388)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:385)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:385)
   [junit4]   2>        at 
org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:249)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.onEnqueue(Overseer.java:217)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.enqueueUpdate(ZkStateWriter.java:125)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.processQueueItem(Overseer.java:290)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:214)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:746)
   [junit4]   2> 1058218 INFO  (zkCallback-910-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1058218 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1058218 WARN  (zkCallback-910-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1058218 INFO  
(OverseerStateUpdate-94554527276793860-127.0.0.1:43322_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43322_solr
   [junit4]   2> 1058221 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1058222 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:43322 43322
   [junit4]   2> 1058327 INFO  (Thread-3137) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:43322 43322
   [junit4]   2> 1058328 WARN  (Thread-3137) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2>        3       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1058328 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testPlaceholders
   [junit4]   2> 1058328 INFO  
(TEST-OverseerTest.testPlaceholders-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554527276793860-127.0.0.1:43322_solr-n_0000000000) closing
   [junit4]   2> 1058331 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testStateChange
   [junit4]   2> 1058332 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1058332 INFO  (Thread-3138) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1058332 INFO  (Thread-3138) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1058432 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:37195
   [junit4]   2> 1058433 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058440 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058442 INFO  (zkCallback-913-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4d48ff name:ZooKeeperConnection 
Watcher:127.0.0.1:37195/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1058442 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058443 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058443 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058443 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058444 INFO  (zkCallback-914-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@17f7667 name:ZooKeeperConnection 
Watcher:127.0.0.1:37195 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1058444 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058445 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058446 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058446 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058448 INFO  (zkCallback-915-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@f49fb7 name:ZooKeeperConnection 
Watcher:127.0.0.1:37195 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1058449 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058449 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058450 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1058469 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1058473 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1058475 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1058480 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1058481 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1058482 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1058484 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058501 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058502 INFO  (zkCallback-916-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@90b9a1 name:ZooKeeperConnection 
Watcher:127.0.0.1:37195/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1058502 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058504 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058504 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1058508 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1058509 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1058509 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1058516 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94554527331581955-127.0.0.1:37195_solr-n_0000000000
   [junit4]   2> 1058528 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37195_solr
   [junit4]   2> 1058528 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1058533 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554527331581955-127.0.0.1:37195_solr-n_0000000000) starting
   [junit4]   2> 1058535 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1058541 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1058542 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1058543 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1058545 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1058546 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1058548 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1058552 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1058553 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1058558 INFO  
(OverseerCollectionConfigSetProcessor-94554527331581955-127.0.0.1:37195_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1058569 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 0
   [junit4]   2> 1058570 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1058570 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1058571 INFO  (zkCallback-913-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1058571 INFO  (zkCallback-916-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1058624 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1058624 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1058624 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1058624 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1058726 INFO  (zkCallback-916-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1058726 INFO  (zkCallback-913-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1058774 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:37195 37195
   [junit4]   2> 1058809 INFO  (Thread-3138) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:37195 37195
   [junit4]   2> 1058812 WARN  (Thread-3138) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1058821 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testStateChange
   [junit4]   2> 1058821 INFO  
(TEST-OverseerTest.testStateChange-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554527331581955-127.0.0.1:37195_solr-n_0000000000) closing
   [junit4]   2> 1058822 INFO  
(OverseerStateUpdate-94554527331581955-127.0.0.1:37195_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37195_solr
   [junit4]   2> 1058824 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1058834 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testDoubleAssignment
   [junit4]   2> 1058834 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1058835 INFO  (Thread-3139) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1058835 INFO  (Thread-3139) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1058936 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:48635
   [junit4]   2> 1058936 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058937 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058943 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@303ffe name:ZooKeeperConnection 
Watcher:127.0.0.1:48635/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1058943 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058943 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058944 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058948 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058948 INFO  (zkCallback-919-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@11cb11b name:ZooKeeperConnection 
Watcher:127.0.0.1:48635 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1058948 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058949 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058955 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058959 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058960 INFO  (zkCallback-920-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@139325a name:ZooKeeperConnection 
Watcher:127.0.0.1:48635 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1058960 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058961 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058961 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1058964 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1058966 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1058969 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1058978 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1058981 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1058982 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1058985 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1058987 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1058988 INFO  (zkCallback-921-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b3702a name:ZooKeeperConnection 
Watcher:127.0.0.1:48635/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1058988 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1058989 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1058990 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1058991 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1058993 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1058993 INFO  (zkCallback-921-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1058993 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1059007 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1059009 INFO  (zkCallback-922-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@626073 name:ZooKeeperConnection 
Watcher:127.0.0.1:48635/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1059009 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1059010 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1059010 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1059011 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1059012 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1059013 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1059013 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94554527364546564-127.0.0.1:48635_solr-n_0000000000
   [junit4]   2> 1059014 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48635_solr
   [junit4]   2> 1059014 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1059015 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554527364546564-127.0.0.1:48635_solr-n_0000000000) starting
   [junit4]   2> 1059016 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1059018 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1059027 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1059029 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1059030 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1059034 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1059036 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1059036 INFO  
(OverseerCollectionConfigSetProcessor-94554527364546564-127.0.0.1:48635_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1059037 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1059038 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1059040 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 1059040 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1059040 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1059040 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1059041 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1059041 INFO  (zkCallback-922-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1059041 INFO  (zkCallback-921-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1059539 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1059540 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1059540 INFO  (zkCallback-921-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1059540 INFO  (zkCallback-922-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1059543 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94554527364546563-node1_core1-n_0000000000
   [junit4]   2> 1059544 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1059545 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1059548 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1059568 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1059568 INFO  (zkCallback-922-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1059568 INFO  (zkCallback-921-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1059651 INFO  (zkCallback-922-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1059651 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1061069 WARN  (zkCallback-921-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1061069 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1061070 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1061071 INFO  (zkCallback-924-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c18cbd name:ZooKeeperConnection 
Watcher:127.0.0.1:48635/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1061071 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1061072 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1061073 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1061074 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1061075 INFO  (zkCallback-922-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1061075 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1061075 INFO  (zkCallback-924-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1061076 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1061077 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 2
   [junit4]   2> 1061077 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1061077 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1061078 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94554527364546565-node1_core1-n_0000000001
   [junit4]   2> 1061079 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1061080 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 1061182 INFO  (zkCallback-922-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1061182 INFO  (zkCallback-924-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1061182 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1061183 INFO  (zkCallback-918-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1061183 INFO  (zkCallback-924-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1061184 WARN  (zkCallback-924-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1061185 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:48635 48635
   [junit4]   2> 1061197 INFO  (Thread-3139) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:48635 48635
   [junit4]   2> 1061198 WARN  (Thread-3139) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        4       /solr/collections
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 1061201 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testDoubleAssignment
   [junit4]   2> 1061201 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554527364546564-127.0.0.1:48635_solr-n_0000000000) closing
   [junit4]   2> 1061201 INFO  
(OverseerStateUpdate-94554527364546564-127.0.0.1:48635_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:48635_solr
   [junit4]   2> 1061205 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1061211 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalClusterStateChangeBehavior
   [junit4]   2> 1061212 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1061212 INFO  (Thread-3140) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1061213 INFO  (Thread-3140) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1061313 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.ZkTestServer start zk server on port:60174
   [junit4]   2> 1061313 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1061317 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1061324 INFO  (zkCallback-925-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@12797bb name:ZooKeeperConnection 
Watcher:127.0.0.1:60174/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1061325 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1061325 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1061325 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1061326 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1061328 INFO  (zkCallback-926-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7c3466 name:ZooKeeperConnection 
Watcher:127.0.0.1:60174 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1061328 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1061328 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1061329 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1061330 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1061344 INFO  (zkCallback-927-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1974dc7 name:ZooKeeperConnection 
Watcher:127.0.0.1:60174 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1061344 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1061345 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1061345 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1061349 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1061351 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1061352 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1061353 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1061353 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1061355 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1061356 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1061361 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1061362 INFO  (zkCallback-928-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c12a04 name:ZooKeeperConnection 
Watcher:127.0.0.1:60174/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1061362 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1061363 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1061363 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1061367 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1061368 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1061369 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1061370 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94554527520456707-127.0.0.1:60174_solr-n_0000000000
   [junit4]   2> 1061370 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 
127.0.0.1:60174_solr
   [junit4]   2> 1061370 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1061372 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.Overseer Overseer 
(id=94554527520456707-127.0.0.1:60174_solr-n_0000000000) starting
   [junit4]   2> 1061372 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1061374 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1061375 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1061376 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1061385 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1061388 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1061390 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[1F14A222D7145675])
 [    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1061390 INFO  
(OverseerStateUpdate-94554527520456707-127.0.0.1:60174_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1061391 INFO  
(OverseerStateUpdate-94554527520456707-127.0.0.1:60174_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1061400 INFO  
(OverseerCollectionConfigSetProcessor-94554527520456707-127.0.0.1:60174_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1061401 INFO  
(OverseerStateUpdate-94554527520456707-127.0.0.1:60174_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"} current state version: 0
   [junit4]   2> 1061401 INFO  
(OverseerStateUpdate-94554527520456707-127.0.0.1:60174_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"}
   [junit4]   2> 1061401 INFO  
(OverseerStateUpdate-94554527520456707-127.0.0.1:60174_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1061402 INFO  (zkCallback-928-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1061402 INFO  (zkCallback-925-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1061454 INFO  
(OverseerStateUpdate-94554527520456707-127.0.0.1:6

[...truncated too long message...]

51 INFO  
(OverseerStateUpdate-94554531090530306-127.0.0.1:45842_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45842_solr
   [junit4]   2> 1116352 INFO  (OverseerExitThread) [    ] o.a.s.c.Overseer I'm 
exiting , but I'm still the leader
   [junit4]   2> 1116352 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94554531090530306-127.0.0.1:45842_solr-n_0000000001
   [junit4]   2> 1116353 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45842_solr
   [junit4]   2> 1116353 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1116354 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554531090530306-127.0.0.1:45842_solr-n_0000000001) starting
   [junit4]   2> 1116359 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1116359 INFO  
(OverseerCollectionConfigSetProcessor-94554531090530306-127.0.0.1:45842_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1116359 INFO  
(OverseerStateUpdate-94554531090530306-127.0.0.1:45842_solr-n_0000000001) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1116360 INFO  (zkCallback-1035-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1116360 INFO  (zkCallback-1034-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 1116361 INFO  
(OverseerStateUpdate-94554531090530306-127.0.0.1:45842_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1116363 INFO  (zkCallback-1034-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1117860 WARN  (zkCallback-1035-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1117861 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:45842 45842
   [junit4]   2> 1117902 INFO  (Thread-3147) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:45842 45842
   [junit4]   2> 1117903 WARN  (Thread-3147) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/overseer/queue
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2>        2       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1117903 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset
   [junit4]   2> 1117903 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[1F14A222D7145675]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94554531090530306-127.0.0.1:45842_solr-n_0000000001) closing
   [junit4]   2> 1117904 INFO  
(OverseerStateUpdate-94554531090530306-127.0.0.1:45842_solr-n_0000000001) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45842_solr
   [junit4]   2> 1117904 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1120905 INFO  
(SUITE-OverseerTest-seed#[1F14A222D7145675]-worker) [    ] o.a.s.SolrTestCaseJ4 
###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_1F14A222D7145675-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {}, 
docValues:{}, sim=ClassicSimilarity, locale=es_DO, timezone=Pacific/Funafuti
   [junit4]   2> NOTE: Linux 3.19.0-28-generic i386/Oracle Corporation 1.9.0-ea 
(32-bit)/cpus=12,threads=1,free=129985192,total=352333824
   [junit4]   2> NOTE: All tests run in this JVM: [TestDefaultStatsCache, 
TestSearchPerf, TestReRankQParserPlugin, XmlUpdateRequestHandlerTest, 
BigEndianAscendingWordDeserializerTest, AssignTest, TestRTimerTree, 
OverriddenZkACLAndCredentialsProvidersTest, RegexBoostProcessorTest, 
TestWriterPerf, NoCacheHeaderTest, SearchHandlerTest, TestCSVResponseWriter, 
TestFieldCollectionResource, TestManagedStopFilterFactory, 
AsyncCallRequestStatusResponseTest, TestPHPSerializedResponseWriter, 
TestPostingsSolrHighlighter, DocValuesMultiTest, 
CollectionsAPIAsyncDistributedZkTest, MigrateRouteKeyTest, QueryResultKeyTest, 
TestMiniSolrCloudClusterBase, FieldMutatingUpdateProcessorTest, 
TestHighFrequencyDictionaryFactory, TestSolrXml, TestSolrCloudWithKerberosAlt, 
FullSolrCloudDistribCmdsTest, TestSolrCLIRunExample, CloudMLTQParserTest, 
QueryParsingTest, CdcrVersionReplicationTest, SystemInfoHandlerTest, 
TestSearcherReuse, PluginInfoTest, SuggesterTest, MultiThreadedOCPTest, 
SolrCoreCheckLockOnStartupTest, TestDynamicFieldCollectionResource, 
TestCollationField, SuggesterWFSTTest, TestGroupingSearch, UpdateParamsTest, 
ClusterStateTest, TestManagedSchemaDynamicFieldResource, 
DirectUpdateHandlerTest, TestPerFieldSimilarity, RecoveryAfterSoftCommitTest, 
TestSolrDeletionPolicy1, TestManagedResourceStorage, TestIndexingPerformance, 
HdfsDirectoryFactoryTest, TestSolrDynamicMBean, DirectSolrConnectionTest, 
TestSolrConfigHandler, DirectUpdateHandlerOptimizeTest, 
UnloadDistributedZkTest, DistributedDebugComponentTest, 
CloudExitableDirectoryReaderTest, TestFuzzyAnalyzedSuggestions, 
AnalyticsMergeStrategyTest, BinaryUpdateRequestHandlerTest, 
TestExtendedDismaxParser, BasicAuthIntegrationTest, TestReload, 
TestConfigSetProperties, CollectionReloadTest, TestRandomRequestDistribution, 
LukeRequestHandlerTest, TestManagedResource, ShowFileRequestHandlerTest, 
TestStressRecovery, BadComponentTest, TestCoreDiscovery, TestXIncludeConfig, 
LeaderElectionTest, SuggesterTSTTest, TermVectorComponentDistributedTest, 
TestSolrQueryParser, CoreAdminHandlerTest, 
OverseerCollectionConfigSetProcessorTest, StatsComponentTest, 
ResponseHeaderTest, RAMDirectoryFactoryTest, BasicDistributedZk2Test, 
TestSolr4Spatial2, TestClassNameShortening, HdfsBasicDistributedZkTest, 
BasicDistributedZkTest, CollectionsAPIDistributedZkTest, 
OpenCloseCoreStressTest, OverseerTest]
   [junit4] Completed [250/546] on J2 in 63.91s, 12 tests, 1 failure, 1 skipped 
<<< FAILURES!

[...truncated 926 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:775: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:719: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:233: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:514: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1432: 
The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:987: 
There were test failures: 546 suites, 2145 tests, 1 failure, 71 ignored (35 
assumptions)

Total time: 55 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to