Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java8/614/

1 tests failed.
FAILED:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       
"parent":null,       "range":null,       "state":"active",       
"replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr";,        
   "node_name":"node1",           "core":"core1",           "roles":"",         
  "state":"down"}}}},   "router":{"name":"implicit"}}, 
test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active 
clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr";,
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
        at 
__randomizedtesting.SeedInfo.seed([F2841DF9912C36C4:9A9A1E1573BC6C8A]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.verifyReplicaStatus(AbstractDistribZkTestBase.java:229)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1247)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10160 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_F2841DF9912C36C4-001/init-core-data-001
   [junit4]   2> 769776 INFO  
(SUITE-OverseerTest-seed#[F2841DF9912C36C4]-worker) [    ] o.a.s.SolrTestCaseJ4 
Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 769776 INFO  
(SUITE-OverseerTest-seed#[F2841DF9912C36C4]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore
   [junit4]   2> 769776 INFO  
(SUITE-OverseerTest-seed#[F2841DF9912C36C4]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore end
   [junit4]   2> 769778 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testBadQueueItem
   [junit4]   2> 769778 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 769779 INFO  (Thread-2225) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 769779 INFO  (Thread-2225) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 769879 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:42186
   [junit4]   2> 769879 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 769879 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769885 INFO  (zkCallback-529-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6586836f 
name:ZooKeeperConnection Watcher:127.0.0.1:42186 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 769885 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769885 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 769886 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 769888 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769892 INFO  (zkCallback-530-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6c48c3c6 
name:ZooKeeperConnection Watcher:127.0.0.1:42186 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 769892 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769893 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 769893 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 769895 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 769896 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769897 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@8222f47 name:ZooKeeperConnection 
Watcher:127.0.0.1:42186/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 769897 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769897 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 769898 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 769899 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 769900 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 769901 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 769902 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 769903 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 769904 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769905 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@137630b0 
name:ZooKeeperConnection Watcher:127.0.0.1:42186/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 769905 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769905 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 769906 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 769907 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 769909 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 769910 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 769910 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94854050603139075-127.0.0.1:42186_solr-n_0000000000
   [junit4]   2> 769911 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42186_solr
   [junit4]   2> 769911 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 769912 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94854050603139075-127.0.0.1:42186_solr-n_0000000000) starting
   [junit4]   2> 769913 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 769915 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 769916 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 769917 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 769919 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 769920 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 769923 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 769923 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 769924 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 769924 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 769925 INFO  
(OverseerCollectionConfigSetProcessor-94854050603139075-127.0.0.1:42186_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 769928 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 769932 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769934 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4cacd04c 
name:ZooKeeperConnection Watcher:127.0.0.1:42186/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 769934 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769934 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 769935 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 769937 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1
   [junit4]   2> 769937 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 769938 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 769939 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 769941 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 0
   [junit4]   2> 769941 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 769941 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 769942 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 769943 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 769943 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 769945 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 770441 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 770442 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 770442 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 770442 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 770445 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard2/election/94854050603139076-127.0.0.1_core1-n_0000000000
   [junit4]   2> 770446 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 770447 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 770450 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 770451 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "core_node_name":"node2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 1
   [junit4]   2> 770452 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "core_node_name":"node2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 770452 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
   [junit4]   2> 770452 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
   [junit4]   2> 770554 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 770554 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 770554 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 770951 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard3/election
   [junit4]   2> 770957 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard3/election/94854050603139076-127.0.0.1_core2-n_0000000000
   [junit4]   2> 770958 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 770960 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 770963 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 770965 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "core_node_name":"node3",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 2
   [junit4]   2> 770966 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "core_node_name":"node3",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 770966 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
   [junit4]   2> 770966 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 771069 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771070 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771070 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771464 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 771469 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94854050603139076-127.0.0.1_core3-n_0000000000
   [junit4]   2> 771470 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 771471 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 771474 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "state":"active"} current state version: 3
   [junit4]   2> 771577 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771577 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771577 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771626 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core0",
   [junit4]   2>   "core_node_name":"node0",
   [junit4]   2>   "collection":"",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 4
   [junit4]   2> 771627 ERROR 
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.CollectionMutator Skipping invalid Overseer message because it has 
no collection specified: {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core0",
   [junit4]   2>   "core_node_name":"node0",
   [junit4]   2>   "collection":"",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 771629 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"deletecore",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core0",
   [junit4]   2>   "core_node_name":"node0",
   [junit4]   2>   "collection":""} current state version: 4
   [junit4]   2> 771630 ERROR 
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.CollectionMutator Skipping invalid Overseer message because it has 
no collection specified: {
   [junit4]   2>   "operation":"deletecore",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core0",
   [junit4]   2>   "core_node_name":"node0",
   [junit4]   2>   "collection":""}
   [junit4]   2> 771631 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 4
   [junit4]   2> 771632 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 771633 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection2
   [junit4]   2> 771633 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 771736 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771736 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 771736 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 772129 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard2/election
   [junit4]   2> 772131 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 772131 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 772131 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 772134 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard2/election/94854050603139076-127.0.0.1_core1-n_0000000000
   [junit4]   2> 772135 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard2
   [junit4]   2> 772137 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 772140 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 5
   [junit4]   2> 772142 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "core_node_name":"node2",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 5
   [junit4]   2> 772142 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "core_node_name":"node2",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 772143 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
   [junit4]   2> 772143 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
   [junit4]   2> 772246 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 772246 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 772246 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 772640 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard3/election
   [junit4]   2> 772644 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard3/election/94854050603139076-127.0.0.1_core2-n_0000000000
   [junit4]   2> 772646 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard3
   [junit4]   2> 772647 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 772650 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "state":"active"} current state version: 6
   [junit4]   2> 772652 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "core_node_name":"node3",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 6
   [junit4]   2> 772652 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "core_node_name":"node3",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 772652 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
   [junit4]   2> 772652 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 772754 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 772754 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 772754 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 773150 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard1/election
   [junit4]   2> 773154 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard1/election/94854050603139076-127.0.0.1_core3-n_0000000000
   [junit4]   2> 773154 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard1
   [junit4]   2> 773156 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 773158 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection2",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "state":"active"} current state version: 7
   [junit4]   2> 773260 INFO  (zkCallback-531-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 773260 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 773261 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 773309 INFO  (zkCallback-534-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 773310 INFO  (zkCallback-532-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 773312 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x150fd41a7b50004, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 773314 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:42186 42186
   [junit4]   2> 773314 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x150fd41a7b50003, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 773538 INFO  (Thread-2225) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:42186 42186
   [junit4]   2> 773538 WARN  (Thread-2225) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        3       /solr/live_nodes
   [junit4]   2>        3       /solr/collections
   [junit4]   2> 
   [junit4]   2> 773539 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testBadQueueItem
   [junit4]   2> 773539 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94854050603139075-127.0.0.1:42186_solr-n_0000000000) closing
   [junit4]   2> 773539 INFO  
(OverseerStateUpdate-94854050603139075-127.0.0.1:42186_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42186_solr
   [junit4]   2> 773542 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 773545 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testOverseerStatsReset
   [junit4]   2> 773545 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 773546 INFO  (Thread-2226) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 773546 INFO  (Thread-2226) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 773646 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:35372
   [junit4]   2> 773646 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 773657 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 773659 INFO  (zkCallback-535-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@26b07068 
name:ZooKeeperConnection Watcher:127.0.0.1:35372 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 773659 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 773659 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 773661 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 773672 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 773676 INFO  (zkCallback-536-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4e18e3b9 
name:ZooKeeperConnection Watcher:127.0.0.1:35372 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 773677 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 773677 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 773677 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 773680 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 773680 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 773681 INFO  (zkCallback-537-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@638960ce 
name:ZooKeeperConnection Watcher:127.0.0.1:35372/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 773682 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 773682 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 773682 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 773683 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 773685 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 773686 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 773687 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 773688 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 773690 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 773692 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 773692 INFO  (zkCallback-538-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6cdc0adf 
name:ZooKeeperConnection Watcher:127.0.0.1:35372/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 773693 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 773693 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 773694 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 773696 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 773697 INFO  (zkCallback-537-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 773698 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 773699 INFO  (zkCallback-538-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 773699 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 773701 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 773702 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 773702 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94854050850013186-127.0.0.1:35372_solr-n_0000000000
   [junit4]   2> 773703 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35372_solr
   [junit4]   2> 773703 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 773704 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94854050850013186-127.0.0.1:35372_solr-n_0000000000) starting
   [junit4]   2> 773706 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 773708 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 773709 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 773712 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 773714 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 773716 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 773719 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 773720 INFO  
(OverseerCollectionConfigSetProcessor-94854050850013186-127.0.0.1:35372_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 773721 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 773733 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 773735 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 773735 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 773735 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 773737 INFO  (zkCallback-537-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 773737 INFO  (zkCallback-538-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 774231 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 774232 INFO  (zkCallback-537-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 774233 INFO  (zkCallback-538-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 774235 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94854050850013187-node1_core1-n_0000000000
   [junit4]   2> 774236 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 774237 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 774239 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94854050850013186-127.0.0.1:35372_solr-n_0000000000) closing
   [junit4]   2> 774239 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ElectionContext Canceling election 
/overseer_elect/election/94854050850013186-127.0.0.1:35372_solr-n_0000000000
   [junit4]   2> 774239 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35372_solr
   [junit4]   2> 774247 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94854050850013186-127.0.0.1:35372_solr-n_0000000001
   [junit4]   2> 774248 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35372_solr
   [junit4]   2> 774248 INFO  (OverseerExitThread) [    ] o.a.s.c.Overseer I'm 
exiting , but I'm still the leader
   [junit4]   2> 774248 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 774250 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94854050850013186-127.0.0.1:35372_solr-n_0000000001) starting
   [junit4]   2> 774256 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 774257 INFO  (zkCallback-538-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 774257 INFO  (zkCallback-537-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
   [junit4]   2> 774257 INFO  
(OverseerCollectionConfigSetProcessor-94854050850013186-127.0.0.1:35372_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 774263 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000001) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 774264 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:35372 35372
   [junit4]   2> 774264 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000001) [    
] o.a.s.c.Overseer 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:411)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:143)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 774264 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000001) [    
] o.a.s.c.Overseer According to ZK I 
(id=94854050850013186-127.0.0.1:35372_solr-n_0000000001) am no longer a leader.
   [junit4]   2> 774264 INFO  
(OverseerStateUpdate-94854050850013186-127.0.0.1:35372_solr-n_0000000001) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35372_solr
   [junit4]   2> 774266 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 774472 INFO  (Thread-2226) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:35372 35372
   [junit4]   2> 774473 WARN  (Thread-2226) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 774473 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset
   [junit4]   2> 774474 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94854050850013186-127.0.0.1:35372_solr-n_0000000001) closing
   [junit4]   2> 774474 ERROR 
(OverseerCollectionConfigSetProcessor-94854050850013186-127.0.0.1:35372_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor Unable to prioritize overseer 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /roles.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerNodePrioritizer.prioritizeOverseerNodes(OverseerNodePrioritizer.java:59)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:159)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 774479 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testShardLeaderChange
   [junit4]   2> 774480 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 774480 INFO  (Thread-2227) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 774480 INFO  (Thread-2227) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 774580 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:46113
   [junit4]   2> 774580 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 774581 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 774584 INFO  (zkCallback-540-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@47d2f2cb 
name:ZooKeeperConnection Watcher:127.0.0.1:46113/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 774584 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 774584 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 774584 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 774584 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 774586 INFO  (zkCallback-541-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3b00b9af 
name:ZooKeeperConnection Watcher:127.0.0.1:46113 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 774586 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 774586 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 774587 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 774587 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 774588 INFO  (zkCallback-542-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7d815694 
name:ZooKeeperConnection Watcher:127.0.0.1:46113 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 774588 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 774589 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 774589 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 774591 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 774593 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 774594 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 774595 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 774596 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 774598 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 774598 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient Using 
default ZkCredentialsProvider
   [junit4]   2> 774598 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 774600 INFO  (Thread-2228) [    ] o.a.s.c.c.ConnectionManager 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 774601 INFO  (zkCallback-543-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@72ce45b6 
name:ZooKeeperConnection Watcher:127.0.0.1:46113/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 774601 INFO  (zkCallback-544-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1264c560 
name:ZooKeeperConnection Watcher:127.0.0.1:46113/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 774601 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 774601 INFO  (Thread-2228) [    ] o.a.s.c.c.ConnectionManager 
Client is connected to ZooKeeper
   [junit4]   2> 774601 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient Using 
default ZkACLProvider
   [junit4]   2> 774601 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 774601 INFO  (Thread-2228) [    ] o.a.s.u.UpdateShardHandler 
Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 774602 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect
   [junit4]   2> 774603 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 774603 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect/election
   [junit4]   2> 774604 INFO  (Thread-2228) [    ] o.a.s.c.Overseer Overseer 
(id=null) closing
   [junit4]   2> 774605 INFO  (Thread-2228) [    ] o.a.s.c.LeaderElector Joined 
leadership election with path: 
/overseer_elect/election/94854050911027204-127.0.0.1:46113_solr-n_0000000000
   [junit4]   2> 774605 INFO  (Thread-2228) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46113_solr
   [junit4]   2> 774605 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect/leader
   [junit4]   2> 774605 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 774606 INFO  (Thread-2228) [    ] o.a.s.c.Overseer Overseer 
(id=94854050911027204-127.0.0.1:46113_solr-n_0000000000) starting
   [junit4]   2> 774606 INFO  (zkCallback-543-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 774608 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 774608 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/queue
   [junit4]   2> 774609 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/queue-work
   [junit4]   2> 774611 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-map-failure
   [junit4]   2> 774612 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-map-running
   [junit4]   2> 774614 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-map-completed
   [junit4]   2> 774615 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer/collection-queue-work
   [junit4]   2> 774618 INFO  (Thread-2228) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 774618 INFO  
(OverseerCollectionConfigSetProcessor-94854050911027204-127.0.0.1:46113_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 774619 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 774619 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 774621 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 774622 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 774622 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 774622 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 774624 INFO  (Thread-2228) [    ] o.a.s.SolrTestCaseJ4 Killing 
overseer.
   [junit4]   2> 774625 WARN  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /clusterstate.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:370)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:367)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:367)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:251)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.enqueueUpdate(ZkStateWriter.java:152)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.processQueueItem(Overseer.java:290)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:214)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 774625 INFO  
(OverseerStateUpdate-94854050911027204-127.0.0.1:46113_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46113_solr
   [junit4]   2> 774625 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient Using 
default ZkCredentialsProvider
   [junit4]   2> 774628 INFO  (Thread-2228) [    ] o.a.s.c.c.ConnectionManager 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 774630 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 774630 INFO  (zkCallback-546-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7cd3436b 
name:ZooKeeperConnection Watcher:127.0.0.1:46113/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 774630 INFO  (Thread-2228) [    ] o.a.s.c.c.ConnectionManager 
Client is connected to ZooKeeper
   [junit4]   2> 774630 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient Using 
default ZkACLProvider
   [junit4]   2> 774631 INFO  (Thread-2228) [    ] o.a.s.c.Overseer Overseer 
(id=94854050911027204-127.0.0.1:46113_solr-n_0000000000) closing
   [junit4]   2> 774631 INFO  (Thread-2228) [    ] o.a.s.u.UpdateShardHandler 
Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 774633 ERROR 
(OverseerHdfsCoreFailoverThread-94854050911027204-127.0.0.1:46113_solr-n_0000000000)
 [    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
OverseerAutoReplicaFailoverThread had an error in its thread work 
loop.:org.apache.solr.common.SolrException: Error reading cluster properties
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:732)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(OverseerAutoReplicaFailoverThread.java:152)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:131)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.InterruptedException: sleep interrupted
   [junit4]   2>        at java.lang.Thread.sleep(Native Method)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:725)
   [junit4]   2>        ... 3 more
   [junit4]   2> 
   [junit4]   2> 774634 INFO  (Thread-2228) [    ] o.a.s.c.Overseer Overseer 
(id=null) closing
   [junit4]   2> 774634 INFO  (Thread-2228) [    ] o.a.s.c.LeaderElector Joined 
leadership election with path: 
/overseer_elect/election/94854050911027205-127.0.0.1:46113_solr-n_0000000001
   [junit4]   2> 774635 INFO  (Thread-2228) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46113_solr
   [junit4]   2> 774635 INFO  (Thread-2228) [    ] o.a.s.c.c.SolrZkClient 
makePath: /overseer_elect/leader
   [junit4]   2> 774636 INFO  (Thread-2228) [    ] o.a.s.c.Overseer Overseer 
(id=94854050911027205-127.0.0.1:46113_solr-n_0000000001) starting
   [junit4]   2> 774642 INFO  (Thread-2228) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 774642 INFO  
(OverseerCollectionConfigSetProcessor-94854050911027205-127.0.0.1:46113_solr-n_0000000001)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 774642 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 774643 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 774645 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 774646 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 774646 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 774646 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 774647 INFO  (zkCallback-546-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 774647 INFO  (zkCallback-543-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 774649 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 1
   [junit4]   2> 774649 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 774649 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 774751 INFO  (zkCallback-543-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 774751 INFO  (zkCallback-546-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 775109 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 775111 INFO  (zkCallback-543-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 775111 INFO  (zkCallback-546-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 775114 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94854050911027203-node1_core1-n_0000000000
   [junit4]   2> 775114 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 775116 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 775119 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 775119 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 775121 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 2
   [junit4]   2> 775121 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 775121 INFO  
(OverseerStateUpdate-94854050911027205-127.0.0.1:46113_solr-n_0000000001) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 775122 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94854050911027203-node1_core1-n_0000000001
   [junit4]   2> 775122 INFO  
(TEST-OverseerTest.testShardLeaderChange-seed#[F2841DF9912C36C4]) [    ] 
o.a.s.c.LeaderElector was going to be leader /colle

[...truncated too long message...]

 ] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"test",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 823470 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: test
   [junit4]   2> 823471 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/test/state.json
   [junit4]   2> 823472 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "operation":"createshard",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "replicationFactor":"1"} current state version: 2
   [junit4]   2> 823473 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} current state version: 2
   [junit4]   2> 823473 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} 
   [junit4]   2> 823590 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/test/state.json version: 0
   [junit4]   2> 828640 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[F2841DF9912C36C4])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34531 34531
   [junit4]   2> 828763 INFO  (Thread-2236) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:34531 34531
   [junit4]   2> 828764 WARN  (Thread-2236) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 828765 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[F2841DF9912C36C4])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalClusterStateChangeBehavior
   [junit4]   2> 828765 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[F2841DF9912C36C4])
 [    ] o.a.s.c.Overseer Overseer 
(id=94854054098108419-127.0.0.1:34531_solr-n_0000000000) closing
   [junit4]   2> 828765 INFO  
(OverseerStateUpdate-94854054098108419-127.0.0.1:34531_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34531_solr
   [junit4]   2> 828765 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testExternalClusterStateChangeBehavior 
-Dtests.seed=F2841DF9912C36C4 -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.locale=it -Dtests.timezone=Antarctica/Davis -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] FAILURE 5.69s J2 | 
OverseerTest.testExternalClusterStateChangeBehavior <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Illegal state, was: 
down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "parent":null,
   [junit4]    >       "range":null,
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{"core_node1":{
   [junit4]    >           "base_url":"http://127.0.0.1/solr";,
   [junit4]    >           "node_name":"node1",
   [junit4]    >           "core":"core1",
   [junit4]    >           "roles":"",
   [junit4]    >           "state":"down"}}}},
   [junit4]    >   "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F2841DF9912C36C4:9A9A1E1573BC6C8A]:0)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.verifyReplicaStatus(AbstractDistribZkTestBase.java:229)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1247)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 831771 INFO  
(SUITE-OverseerTest-seed#[F2841DF9912C36C4]-worker) [    ] o.a.s.SolrTestCaseJ4 
###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_F2841DF9912C36C4-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, 
docValues:{}, sim=ClassicSimilarity, locale=it, timezone=Antarctica/Davis
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_66 (64-bit)/cpus=4,threads=1,free=244315248,total=523239424
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexSearcher, 
TestPHPSerializedResponseWriter, TestTrieFacet, SliceStateTest, 
PrimitiveFieldTypeTest, XmlUpdateRequestHandlerTest, 
FullSolrCloudDistribCmdsTest, TestClassicSimilarityFactory, 
DistributedFacetPivotSmallTest, TestPerFieldSimilarity, 
DirectUpdateHandlerTest, TestSolrQueryParser, SolrCoreCheckLockOnStartupTest, 
TestFastWriter, SpatialHeatmapFacetsTest, TestSolrIndexConfig, 
JavabinLoaderTest, TestManagedResourceStorage, SampleTest, 
TestExtendedDismaxParser, TestMiniSolrCloudClusterBase, SuggesterWFSTTest, 
TestStressRecovery, DeleteReplicaTest, AnalyticsQueryTest, 
TestSortingResponseWriter, FullHLLTest, MultiThreadedOCPTest, 
FieldMutatingUpdateProcessorTest, TestRecovery, TestAddFieldRealTimeGet, 
TestDistributedStatsComponentCardinality, DocValuesMultiTest, 
TestHashQParserPlugin, RequestHandlersTest, DeleteLastCustomShardedReplicaTest, 
TestBulkSchemaAPI, CircularListTest, TestSweetSpotSimilarityFactory, 
DeleteShardTest, TestZkChroot, TestLRUStatsCache, TestRandomMergePolicy, 
TestManagedStopFilterFactory, HdfsDirectoryTest, TestSolrDeletionPolicy1, 
TestReload, LeaderFailoverAfterPartitionTest, DirectUpdateHandlerOptimizeTest, 
TestStressReorder, TestJmxMonitoredMap, AssignTest, HighlighterMaxOffsetTest, 
OverriddenZkACLAndCredentialsProvidersTest, HLLSerializationTest, 
CdcrVersionReplicationTest, CursorMarkTest, HardAutoCommitTest, 
TestFieldResource, HighlighterConfigTest, TestElisionMultitermQuery, 
BasicDistributedZk2Test, ScriptEngineTest, 
TestOverriddenPrefixQueryForCustomFieldType, TestClusterStateMutator, 
HdfsBasicDistributedZkTest, ConnectionManagerTest, 
DistributedFacetPivotSmallAdvancedTest, AutoCommitTest, MigrateRouteKeyTest, 
TestComplexPhraseQParserPlugin, OverseerTest]
   [junit4] Completed [240/556] on J2 in 62.01s, 12 tests, 1 failure, 1 skipped 
<<< FAILURES!

[...truncated 1042 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/build.xml:775:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/common-build.xml:516:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/lucene/common-build.xml:987:
 There were test failures: 556 suites (8 ignored), 2209 tests, 1 failure, 83 
ignored (69 assumptions) [seed: F2841DF9912C36C4]

Total time: 56 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to