Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java8/538/

2 tests failed.
FAILED:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       
"parent":null,       "range":null,       "state":"active",       
"replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr";,        
   "node_name":"node1",           "core":"core1",           "roles":"",         
  "state":"down"}}}},   "router":{"name":"implicit"}}, 
test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active 
clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr";,
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
        at 
__randomizedtesting.SeedInfo.seed([8ADAD47FB12C4A79:E2C4D79353BC1037]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:601)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1261)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication

Error Message:
Index: 0, Size: 0

Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
        at 
__randomizedtesting.SeedInfo.seed([8ADAD47FB12C4A79:7DA93A2777C4E59F]:0)
        at java.util.ArrayList.rangeCheck(ArrayList.java:653)
        at java.util.ArrayList.get(ArrayList.java:429)
        at 
org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication(TestReplicationHandler.java:1239)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10009 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_8ADAD47FB12C4A79-001/init-core-data-001
   [junit4]   2> 1049000 INFO  
(SUITE-OverseerTest-seed#[8ADAD47FB12C4A79]-worker) [    ] o.a.s.SolrTestCaseJ4 
Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1049000 INFO  
(SUITE-OverseerTest-seed#[8ADAD47FB12C4A79]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore
   [junit4]   2> 1049000 INFO  
(SUITE-OverseerTest-seed#[8ADAD47FB12C4A79]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore end
   [junit4]   2> 1049004 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testReplay
   [junit4]   2> 1049008 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1049008 INFO  (Thread-3026) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1049008 INFO  (Thread-3026) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1049108 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:55288
   [junit4]   2> 1049108 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049137 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049143 INFO  (zkCallback-890-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@359f0483 
name:ZooKeeperConnection Watcher:127.0.0.1:55288/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049153 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049153 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049153 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049154 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049155 INFO  (zkCallback-891-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5328a6f1 
name:ZooKeeperConnection Watcher:127.0.0.1:55288 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049155 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049155 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049163 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049172 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049175 INFO  (zkCallback-892-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@67ee70c8 
name:ZooKeeperConnection Watcher:127.0.0.1:55288 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049176 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049176 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049176 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1049180 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1049181 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1049182 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1049183 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1049184 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1049203 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1049206 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1049209 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049223 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049224 INFO  (zkCallback-893-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1c474c16 
name:ZooKeeperConnection Watcher:127.0.0.1:55288/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049224 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049224 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049224 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1049228 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1049229 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1049230 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] o.a.s.c.Overseer 
Overseer (id=null) closing
   [junit4]   2> 1049230 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94754520599232515-127.0.0.1:55288_solr-n_0000000000
   [junit4]   2> 1049230 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55288_solr
   [junit4]   2> 1049230 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1049231 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] o.a.s.c.Overseer 
Overseer (id=94754520599232515-127.0.0.1:55288_solr-n_0000000000) starting
   [junit4]   2> 1049237 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1049239 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1049240 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1049241 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1049243 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1049246 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1049247 INFO  
(OverseerCollectionConfigSetProcessor-94754520599232515-127.0.0.1:55288_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1049257 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1049257 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1049260 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1049260 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1049261 INFO  (zkCallback-890-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1049264 INFO  (zkCallback-893-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1049264 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: workQueueSize: 2, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1049284 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core2",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1049284 INFO  (zkCallback-890-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1049285 INFO  (zkCallback-893-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1049286 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 2
   [junit4]   2> 1049286 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "shard":"s1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core3",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1049388 INFO  (zkCallback-890-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1049388 INFO  (zkCallback-893-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1049467 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:55288 55288
   [junit4]   2> 1049687 INFO  (Thread-3026) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:55288 55288
   [junit4]   2> 1049688 WARN  (Thread-3026) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1049689 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testReplay
   [junit4]   2> 1049689 INFO  
(TEST-OverseerTest.testReplay-seed#[8ADAD47FB12C4A79]) [    ] o.a.s.c.Overseer 
Overseer (id=94754520599232515-127.0.0.1:55288_solr-n_0000000000) closing
   [junit4]   2> 1049690 INFO  
(OverseerStateUpdate-94754520599232515-127.0.0.1:55288_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55288_solr
   [junit4]   2> 1049712 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalClusterStateChangeBehavior
   [junit4]   2> 1049712 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1049712 INFO  (Thread-3027) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1049712 INFO  (Thread-3027) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1049728 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1049812 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.ZkTestServer start zk server on port:32784
   [junit4]   2> 1049813 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049838 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049841 INFO  (zkCallback-895-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2adeb549 
name:ZooKeeperConnection Watcher:127.0.0.1:32784/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049841 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049841 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049841 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049842 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049843 INFO  (zkCallback-896-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@8c25651 name:ZooKeeperConnection 
Watcher:127.0.0.1:32784 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1049843 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049843 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049851 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049853 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049878 INFO  (zkCallback-897-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@260c974b 
name:ZooKeeperConnection Watcher:127.0.0.1:32784 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049878 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049878 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049878 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1049898 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1049899 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1049900 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1049901 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1049902 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1049903 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1049905 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1049922 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1049924 INFO  (zkCallback-898-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6a69474c 
name:ZooKeeperConnection Watcher:127.0.0.1:32784/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1049924 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1049924 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1049924 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1049925 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1049926 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1049927 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1049927 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94754520645304323-127.0.0.1:32784_solr-n_0000000000
   [junit4]   2> 1049927 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 
127.0.0.1:32784_solr
   [junit4]   2> 1049927 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1049929 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.Overseer Overseer 
(id=94754520645304323-127.0.0.1:32784_solr-n_0000000000) starting
   [junit4]   2> 1049929 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1049931 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1049932 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1049933 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1049935 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1049937 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1049967 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1049972 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1049973 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1049979 INFO  
(OverseerCollectionConfigSetProcessor-94754520645304323-127.0.0.1:32784_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1049999 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"} current state version: 0
   [junit4]   2> 1050000 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"down"}
   [junit4]   2> 1050000 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1050002 INFO  (zkCallback-895-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1050002 INFO  (zkCallback-898-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1050037 INFO  (zkCallback-895-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1050062 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 5, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 1
   [junit4]   2> 1050063 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1050063 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1050063 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1050065 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 5, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1050065 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"c1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1050065 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1050065 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1050067 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 5, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"test",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 1
   [junit4]   2> 1050067 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: test
   [junit4]   2> 1050068 WARN  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer Bad version writing to ZK using compare-and-set, will force 
refresh cluster state
   [junit4]   2> org.apache.zookeeper.KeeperException$BadVersionException: 
KeeperErrorCode = BadVersion for /clusterstate.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:115)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:370)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:367)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:367)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:251)
   [junit4]   2>        at 
org.apache.solr.cloud.overseer.ZkStateWriter.enqueueUpdate(ZkStateWriter.java:118)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.processQueueItem(Overseer.java:290)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:214)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1050070 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 5, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"test",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 1050070 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: test
   [junit4]   2> 1050072 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/test/state.json
   [junit4]   2> 1050073 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 5, message = {
   [junit4]   2>   "operation":"createshard",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "replicationFactor":"1"} current state version: 2
   [junit4]   2> 1050075 INFO  (zkCallback-898-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1050076 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 5, message = {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} current state version: 2
   [junit4]   2> 1050076 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"test",
   [junit4]   2>   "shard":"x",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"down"} 
   [junit4]   2> 1050179 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/test/state.json version: 0
   [junit4]   2> 1055275 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:32784 32784
   [junit4]   2> 1055535 INFO  (Thread-3027) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:32784 32784
   [junit4]   2> 1055536 WARN  (Thread-3027) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1055537 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalClusterStateChangeBehavior
   [junit4]   2> 1055537 INFO  
(TEST-OverseerTest.testExternalClusterStateChangeBehavior-seed#[8ADAD47FB12C4A79])
 [    ] o.a.s.c.Overseer Overseer 
(id=94754520645304323-127.0.0.1:32784_solr-n_0000000000) closing
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testExternalClusterStateChangeBehavior 
-Dtests.seed=8ADAD47FB12C4A79 -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.locale=es_AR -Dtests.timezone=America/Atka -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 5.85s J2 | 
OverseerTest.testExternalClusterStateChangeBehavior <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Illegal state, was: 
down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "parent":null,
   [junit4]    >       "range":null,
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{"core_node1":{
   [junit4]    >           "base_url":"http://127.0.0.1/solr";,
   [junit4]    >           "node_name":"node1",
   [junit4]    >           "core":"core1",
   [junit4]    >           "roles":"",
   [junit4]    >           "state":"down"}}}},
   [junit4]    >   "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8ADAD47FB12C4A79:E2C4D79353BC1037]:0)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:601)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1261)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1055542 INFO  
(OverseerStateUpdate-94754520645304323-127.0.0.1:32784_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:32784_solr
   [junit4]   2> 1055565 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testStateChange
   [junit4]   2> 1055566 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1055566 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1055566 INFO  (Thread-3028) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1055567 INFO  (Thread-3028) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1055666 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:56806
   [junit4]   2> 1055667 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1055671 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1055679 INFO  (zkCallback-900-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@76e990e3 
name:ZooKeeperConnection Watcher:127.0.0.1:56806/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1055679 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1055680 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1055680 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1055681 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1055681 INFO  (zkCallback-901-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@8ee1403 name:ZooKeeperConnection 
Watcher:127.0.0.1:56806 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1055681 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1055682 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1055683 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1055684 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1055684 INFO  (zkCallback-902-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6e34a70d 
name:ZooKeeperConnection Watcher:127.0.0.1:56806 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1055684 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1055684 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1055684 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1055693 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1055694 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1055695 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1055696 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1055697 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1055698 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1055699 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1055701 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1055701 INFO  (zkCallback-903-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@777825d2 
name:ZooKeeperConnection Watcher:127.0.0.1:56806/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1055701 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1055701 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1055701 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1055702 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1055703 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1055704 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1055704 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94754521029738499-127.0.0.1:56806_solr-n_0000000000
   [junit4]   2> 1055705 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56806_solr
   [junit4]   2> 1055705 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1055706 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94754521029738499-127.0.0.1:56806_solr-n_0000000000) starting
   [junit4]   2> 1055707 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1055708 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1055710 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1055711 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1055712 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1055714 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1055717 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1055718 INFO  
(OverseerCollectionConfigSetProcessor-94754521029738499-127.0.0.1:56806_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1055718 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1055719 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1055721 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"} current state version: 0
   [junit4]   2> 1055722 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"recovering"}
   [junit4]   2> 1055722 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1055723 INFO  (zkCallback-900-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1055723 INFO  (zkCallback-903-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1055772 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1055772 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "roles":"",
   [junit4]   2>   "state":"active"}
   [junit4]   2> 1055772 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
   [junit4]   2> 1055772 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
   [junit4]   2> 1055875 INFO  (zkCallback-900-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1055875 INFO  (zkCallback-903-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
   [junit4]   2> 1055927 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:56806 56806
   [junit4]   2> 1056097 INFO  (Thread-3028) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:56806 56806
   [junit4]   2> 1056098 WARN  (Thread-3028) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        2       /solr/live_nodes
   [junit4]   2>        2       /solr/collections
   [junit4]   2> 
   [junit4]   2> 1056099 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testStateChange
   [junit4]   2> 1056099 INFO  
(TEST-OverseerTest.testStateChange-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94754521029738499-127.0.0.1:56806_solr-n_0000000000) closing
   [junit4]   2> 1056099 INFO  
(OverseerStateUpdate-94754521029738499-127.0.0.1:56806_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:56806_solr
   [junit4]   2> 1056113 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testOverseerStatsReset
   [junit4]   2> 1056114 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1056124 INFO  (Thread-3029) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1056124 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
   [junit4]   2> 1056124 INFO  (Thread-3029) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1056224 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:50761
   [junit4]   2> 1056224 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1056227 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1056242 INFO  (zkCallback-905-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4dd5ae22 
name:ZooKeeperConnection Watcher:127.0.0.1:50761 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1056244 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1056244 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1056247 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1056264 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1056278 INFO  (zkCallback-906-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@28997525 
name:ZooKeeperConnection Watcher:127.0.0.1:50761 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1056279 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1056279 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1056279 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1056283 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1056287 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1056289 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4f216cf2 
name:ZooKeeperConnection Watcher:127.0.0.1:50761/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1056289 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1056290 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1056290 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1056291 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1056292 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1056303 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1056304 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1056305 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1056307 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1056316 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1056317 INFO  (zkCallback-908-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6fb24326 
name:ZooKeeperConnection Watcher:127.0.0.1:50761/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1056317 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1056317 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1056338 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1056355 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
   [junit4]   2> 1056358 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1056359 INFO  (zkCallback-908-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
   [junit4]   2> 1056359 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1056360 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1056362 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1056363 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1056364 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94754521065652226-127.0.0.1:50761_solr-n_0000000000
   [junit4]   2> 1056364 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50761_solr
   [junit4]   2> 1056364 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1056365 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94754521065652226-127.0.0.1:50761_solr-n_0000000000) starting
   [junit4]   2> 1056366 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1056367 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1056369 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1056379 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1056382 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1056383 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1056385 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1056391 INFO  
(OverseerCollectionConfigSetProcessor-94754521065652226-127.0.0.1:50761_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
   [junit4]   2> 1056391 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1056402 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
   [junit4]   2> 1056403 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"recovering",
   [junit4]   2>   "node_name":"node1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://node1/solr/"}
   [junit4]   2> 1056403 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1056403 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1056404 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1056406 INFO  (zkCallback-908-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 1056904 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1056906 INFO  (zkCallback-907-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1056906 INFO  (zkCallback-908-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 1056909 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94754521065652227-node1_core1-n_0000000000
   [junit4]   2> 1056909 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1056911 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1056913 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://node1/solr/";,
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1056915 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94754521065652226-127.0.0.1:50761_solr-n_0000000000) closing
   [junit4]   2> 1056915 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ElectionContext Canceling election 
/overseer_elect/election/94754521065652226-127.0.0.1:50761_solr-n_0000000000
   [junit4]   2> 1056916 INFO  
(OverseerStateUpdate-94754521065652226-127.0.0.1:50761_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:50761_solr
   [junit4]   2> 1056919 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94754521065652226-127.0.0.1:50761_solr-n_0000000001
   [junit4]   2> 1056919 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50761_solr
   [junit4]   2> 1056919 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1056920 ERROR 
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector node exists
   [junit4]   2> org.apache.zookeeper.KeeperException$NodeExistsException: 
KeeperErrorCode = NodeExists for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:508)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:505)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:463)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:450)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:650)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:744)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1056921 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.ElectionContext Canceling election 
/overseer_elect/election/94754521065652226-127.0.0.1:50761_solr-n_0000000001
   [junit4]   2> 1056922 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94754521065652226-127.0.0.1:50761_solr-n_0000000002
   [junit4]   2> 1056922 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50761_solr
   [junit4]   2> 1056922 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1056923 ERROR 
(TEST-OverseerTest.testOverseerStatsReset-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.LeaderElector node exists
   [junit4]   2> org.apache.zookeeper.KeeperException$NodeExistsException: 
KeeperErrorCode = NodeExists for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:508)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:505)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:463)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:450)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:650)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:430)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:160)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:255)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:744)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1056924 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[8A

[...truncated too long message...]

enkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-027/./collection1/data
   [junit4]   2> 1192853 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-027/./collection1/data/index
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-027/./collection1/data/index;done=false>>]
   [junit4]   2> 1192853 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-027/./collection1/data/index
   [junit4]   2> 1192854 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@58820e6f{/solr,null,UNAVAILABLE}
   [junit4]   2> 1192862 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    ] 
o.e.j.s.ServerConnector Stopped ServerConnector@65c18896{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1192862 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=882189152
   [junit4]   2> 1192862 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@44c1fde2
   [junit4]   2> 1192862 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.u.UpdateHandler closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1192863 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1192863 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 
0 - closing IndexWriter
   [junit4]   2> 1192863 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with 
IndexWriterCloser
   [junit4]   2> 1192864 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 1192864 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 
directories currently being tracked
   [junit4]   2> 1192864 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-028/./collection1/data
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-028/./collection1/data;done=false>>]
   [junit4]   2> 1192864 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-028/./collection1/data
   [junit4]   2> 1192864 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-028/./collection1/data/index
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-028/./collection1/data/index;done=false>>]
   [junit4]   2> 1192864 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001/solr-instance-028/./collection1/data/index
   [junit4]   2> 1192865 INFO  
(TEST-TestReplicationHandler.testEmptyCommits-seed#[8ADAD47FB12C4A79]) [    
x:collection1] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@79fb5b84{/solr,null,UNAVAILABLE}
   [junit4]   2> 1192866 INFO  
(SUITE-TestReplicationHandler-seed#[8ADAD47FB12C4A79]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_8ADAD47FB12C4A79-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): 
{name=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 
id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 
newname=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))},
 docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, 
locale=ar_OM, timezone=Asia/Bangkok
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=119831336,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: 
[CoreMergeIndexesAdminHandlerTest, DistributedQueryElevationComponentTest, 
TestRawResponseWriter, TestRandomFaceting, SolrCoreTest, 
TestLuceneMatchVersion, ReturnFieldsTest, TestNoOpRegenerator, 
TestDynamicFieldResource, TestBadConfig, TestImplicitCoreProperties, 
HdfsUnloadDistributedZkTest, TestInitQParser, TestPhraseSuggestions, 
TestSimpleTrackingShardHandler, ResponseLogComponentTest, 
TestSolrCloudWithKerberosAlt, QueryElevationComponentTest, 
TestSolrConfigHandler, DateRangeFieldTest, TestValueSourceCache, 
SuggestComponentContextFilterQueryTest, TestFilteredDocIdSet, 
LeaderInitiatedRecoveryOnCommitTest, DistributedSpellCheckComponentTest, 
TestStandardQParsers, AssignTest, TestLazyCores, 
TestHighFrequencyDictionaryFactory, TestRequestStatusCollectionAPI, 
TestBinaryField, TestAuthorizationFramework, 
LeaderInitiatedRecoveryOnShardRestartTest, HdfsBasicDistributedZk2Test, 
ExitableDirectoryReaderTest, OutputWriterTest, 
CdcrReplicationDistributedZkTest, TestCSVLoader, StandardRequestHandlerTest, 
TestComponentsName, TestDistributedMissingSort, DateFieldTest, TestRangeQuery, 
TestAnalyzedSuggestions, TestSolrConfigHandlerConcurrent, 
TestCloudManagedSchemaConcurrent, TestIntervalFaceting, 
AnalysisErrorHandlingTest, TestAtomicUpdateErrorCases, DateMathParserTest, 
TestRandomDVFaceting, ParsingFieldUpdateProcessorsTest, 
DistribJoinFromCollectionTest, TestStressLucene, AliasIntegrationTest, 
SyncSliceTest, TestOmitPositions, SolrRequestParserTest, TestFunctionQuery, 
TestConfig, LeaderElectionIntegrationTest, TestDistributedSearch, 
QueryEqualityTest, TestCloudManagedSchema, FileBasedSpellCheckerTest, 
TestSimpleQParserPlugin, BasicDistributedZkTest, TestCollationFieldDocValues, 
TestRealTimeGet, TestHighlightDedupGrouping, TestSolr4Spatial, 
HdfsChaosMonkeySafeLeaderTest, FileUtilsTest, RemoteQueryErrorTest, TestJoin, 
BufferStoreTest, RankQueryTest, MigrateRouteKeyTest, CursorPagingTest, 
SparseHLLTest, TestHdfsUpdateLog, TestManagedSynonymFilterFactory, 
PeerSyncTest, DisMaxRequestHandlerTest, SmileWriterTest, TestReplicationHandler]
   [junit4] Completed [284/553] on J0 in 113.23s, 13 tests, 1 error <<< 
FAILURES!

[...truncated 834 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/build.xml:775:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/solr/common-build.xml:516:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-trunk-Java8/lucene/common-build.xml:987:
 There were test failures: 553 suites (8 ignored), 2173 tests, 1 error, 1 
failure, 51 ignored (38 assumptions) [seed: 8ADAD47FB12C4A79]

Total time: 55 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to