Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10933/
Java: 32bit/jdk1.7.0_65 -client -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
Could not register as the leader because creating the ephemeral registration 
node in ZooKeeper failed

Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because 
creating the ephemeral registration node in ZooKeeper failed
        at 
__randomizedtesting.SeedInfo.seed([32C8E711A988EB4E:36C068E2BB2D046F]:0)
        at 
org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:144)
        at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
        at 
org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
        at 
org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: 
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
        at 
org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:457)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454)
        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:411)
        at 
org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:398)
        at 
org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:136)
        at 
org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
        at 
org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:131)
        ... 47 more




Build Log:
[...truncated 11886 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-32C8E711A988EB4E-001/init-core-data-001
   [junit4]   2> 1751592 T4364 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (false)
   [junit4]   2> 1751592 T4364 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1751593 T4364 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 1751595 T4364 oas.SolrTestCaseJ4.setUp ###Starting 
testDoubleAssignment
   [junit4]   2> 1751595 T4364 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1751596 T4365 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1751696 T4364 oasc.ZkTestServer.run start zk server on 
port:60218
   [junit4]   2> 1751697 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1751699 T4371 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@57c50d name:ZooKeeperConnection 
Watcher:127.0.0.1:60218/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1751700 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1751701 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1751702 T4373 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@11e65aa name:ZooKeeperConnection 
Watcher:127.0.0.1:60218 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1751703 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1751706 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1751707 T4375 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@194c249 name:ZooKeeperConnection 
Watcher:127.0.0.1:60218 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1751708 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1751709 T4364 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1751713 T4364 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1751717 T4364 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1751720 T4364 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1751722 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1751727 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1751729 T4377 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2f82b5 name:ZooKeeperConnection 
Watcher:127.0.0.1:60218/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1751729 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1751732 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1751736 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node1
   [junit4]   2> 1751741 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1751742 T4381 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@d29d83 name:ZooKeeperConnection 
Watcher:127.0.0.1:60218/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1751742 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1751744 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1751747 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1751751 T4364 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:60218_solr
   [junit4]   2> 1751752 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1751755 T4364 oasc.Overseer.start Overseer 
(id=92197342219862020-127.0.0.1:60218_solr-n_0000000000) starting
   [junit4]   2> 1751757 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1751760 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1751763 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1751767 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1751770 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1751773 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1751778 T4383 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1751779 T4382 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1751782 T4382 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1751782 T4382 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"recovering",
   [junit4]   2>          "node_name":"node1",
   [junit4]   2>          "core":"core1",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "base_url":"http://node1/solr/"}
   [junit4]   2> 1751783 T4382 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1]
   [junit4]   2> 1751783 T4382 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 1751787 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1751787 T4378 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1751788 T4379 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1752280 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1752292 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 1752299 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1752299 T4364 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1752301 T4382 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1752304 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1752305 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1752306 T4386 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@104e222 name:ZooKeeperConnection 
Watcher:127.0.0.1:60218/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1752307 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1752308 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1752311 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node1
   [junit4]   2> 1752316 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1752316 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1752317 T4382 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"recovering",
   [junit4]   2>          "node_name":"node1",
   [junit4]   2>          "core":"core1",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "base_url":"http://node1/solr/"}
   [junit4]   2> 1752317 T4382 oasc.Overseer$ClusterStateUpdater.updateState 
shard=shard1 is already registered
   [junit4]   2> 1752319 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1752321 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 1752327 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1752332 T4384 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1752434 T4387 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1752434 T4364 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1752434 T4378 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1752439 T4364 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:60218 60218
   [junit4]   2> 1753115 T4365 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:60218 60218
   [junit4]   2> 1753117 T4364 oas.SolrTestCaseJ4.tearDown ###Ending 
testDoubleAssignment
   [junit4]   2> 1753118 T4382 oasc.Overseer$ClusterStateUpdater.run Overseer 
Loop exiting : 127.0.0.1:60218_solr
   [junit4]   2> 1753121 T4388 
oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read 
the data org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1753127 T4364 oas.SolrTestCaseJ4.setUp ###Starting 
testShardAssignment
   [junit4]   2> 1753128 T4364 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1753130 T4389 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1753229 T4364 oasc.ZkTestServer.run start zk server on 
port:50820
   [junit4]   2> 1753231 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1753233 T4395 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1cbefb4 name:ZooKeeperConnection 
Watcher:127.0.0.1:50820 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1753234 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1753237 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1753238 T4397 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@855b59 name:ZooKeeperConnection 
Watcher:127.0.0.1:50820 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1753239 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1753239 T4364 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1753245 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1753246 T4399 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1152bcd name:ZooKeeperConnection 
Watcher:127.0.0.1:50820/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1753247 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1753247 T4364 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1753251 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1753252 T4401 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@15ffc19 name:ZooKeeperConnection 
Watcher:127.0.0.1:50820/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1753253 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1753254 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1753257 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1753263 T4364 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:50820_solr
   [junit4]   2> 1753264 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1753267 T4364 oasc.Overseer.start Overseer 
(id=92197342320394243-127.0.0.1:50820_solr-n_0000000000) starting
   [junit4]   2> 1753270 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1753274 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1753278 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1753283 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1753288 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1753294 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1753302 T4403 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1753303 T4364 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1753303 T4402 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1753306 T4364 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1753308 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1753312 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1753313 T4405 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@a82d09 name:ZooKeeperConnection 
Watcher:127.0.0.1:50820/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1753314 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1753316 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1753319 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1
   [junit4]   2> 1753325 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1753327 T4402 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1753329 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "node_name":"127.0.0.1",
   [junit4]   2>          "core":"core1",
   [junit4]   2>          "core_node_name":"node1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 1753329 T4402 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 1753329 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard3
   [junit4]   2> 1753333 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1753334 T4406 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1753334 T4407 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1753825 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1753837 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard3
   [junit4]   2> 1753845 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1753847 T4402 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1753847 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1753851 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "node_name":"127.0.0.1",
   [junit4]   2>          "core":"core2",
   [junit4]   2>          "core_node_name":"node2",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 1753851 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=3
   [junit4]   2> 1753852 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard2
   [junit4]   2> 1753855 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1753957 T4406 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1753957 T4407 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754347 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1754351 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard2
   [junit4]   2> 1754354 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754354 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754354 T4409 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754355 T4402 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1754357 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754358 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "node_name":"127.0.0.1",
   [junit4]   2>          "core":"core3",
   [junit4]   2>          "core_node_name":"node3",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 1754358 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=3
   [junit4]   2> 1754358 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 1754359 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754461 T4407 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754461 T4406 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754855 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1754864 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 1754868 T4409 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754868 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754868 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754870 T4402 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1754870 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754873 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "node_name":"127.0.0.1",
   [junit4]   2>          "core":"core4",
   [junit4]   2>          "core_node_name":"node4",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 1754873 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=3
   [junit4]   2> 1754874 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard3
   [junit4]   2> 1754876 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1754978 T4406 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1754978 T4407 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1755370 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1755387 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755387 T4409 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755387 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755390 T4402 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1755391 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "node_name":"127.0.0.1",
   [junit4]   2>          "core":"core5",
   [junit4]   2>          "core_node_name":"node5",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 1755391 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=3
   [junit4]   2> 1755391 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard2
   [junit4]   2> 1755395 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755498 T4406 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1755498 T4407 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1755887 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1755897 T4408 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755897 T4410 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755897 T4409 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1755899 T4402 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1755901 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "node_name":"127.0.0.1",
   [junit4]   2>          "core":"core6",
   [junit4]   2>          "core_node_name":"node6",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 1755901 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=3
   [junit4]   2> 1755901 T4402 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 1755903 T4409 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1756006 T4407 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1756006 T4406 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1756397 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1756403 T4405 oaz.ClientCnxn$EventThread.processEvent ERROR 
Error while calling watcher  java.util.concurrent.RejectedExecutionException: 
Task java.util.concurrent.FutureTask@1c60da1 rejected from 
java.util.concurrent.ThreadPoolExecutor@1a8f833[Shutting down, pool size = 2, 
active threads = 2, queued tasks = 0, completed tasks = 8]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 1756403 T4411 oasc.LeaderElector$ElectionWatcher.process WARN  
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1757903 T4407 oasc.LeaderElector$ElectionWatcher.process WARN  
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /collections/collection1/leader_elect/shard2/election
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:285)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:282)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:282)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2>        at 
org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:204)
   [junit4]   2>        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2>        at 
java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1757907 T4364 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:50820 50820
   [junit4]   2> 1758455 T4389 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:50820 50820
   [junit4]   2> 1758456 T4364 oas.SolrTestCaseJ4.tearDown ###Ending 
testShardAssignment
   [junit4]   2> 1758457 T4402 oasc.Overseer$ClusterStateUpdater.run Overseer 
Loop exiting : 127.0.0.1:50820_solr
   [junit4]   2> 1758459 T4412 
oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read 
the data org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1758464 T4364 oas.SolrTestCaseJ4.setUp ###Starting 
testPlaceholders
   [junit4]   2> 1758465 T4364 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1758466 T4413 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1758565 T4364 oasc.ZkTestServer.run start zk server on 
port:37479
   [junit4]   2> 1758566 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1758568 T4419 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@84142a name:ZooKeeperConnection 
Watcher:127.0.0.1:37479/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1758568 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1758569 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1758570 T4421 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@11abd6e name:ZooKeeperConnection 
Watcher:127.0.0.1:37479 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1758571 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1758574 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1758575 T4423 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@19f6e2c name:ZooKeeperConnection 
Watcher:127.0.0.1:37479 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1758575 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1758576 T4364 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1758578 T4364 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1758580 T4364 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1758582 T4364 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1758584 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1758587 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1758588 T4425 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@b04aa9 name:ZooKeeperConnection 
Watcher:127.0.0.1:37479/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1758588 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1758590 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1758592 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node1
   [junit4]   2> 1758596 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1758598 T4429 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@cfa4af name:ZooKeeperConnection 
Watcher:127.0.0.1:37479/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1758598 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1758598 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1758600 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1758604 T4364 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:37479_solr
   [junit4]   2> 1758605 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1758608 T4364 oasc.Overseer.start Overseer 
(id=92197342670028804-127.0.0.1:37479_solr-n_0000000000) starting
   [junit4]   2> 1758609 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1758611 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1758613 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1758614 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1758616 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1758619 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1758625 T4431 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1758626 T4430 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1758628 T4430 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1758628 T4430 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=12 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"recovering",
   [junit4]   2>          "node_name":"node1",
   [junit4]   2>          "core":"core1",
   [junit4]   2>          "core_node_name":"node1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"12",
   [junit4]   2>          "base_url":"http://node1/solr/"}
   [junit4]   2> 1758629 T4430 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, 
shard7, shard8, shard9, shard10, shard11, shard12]
   [junit4]   2> 1758629 T4430 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard9
   [junit4]   2> 1758632 T4432 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1758633 T4426 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1758633 T4427 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1759127 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard9/election
   [junit4]   2> 1759135 T4364 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard9
   [junit4]   2> 1759140 T4432 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1759141 T4364 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1759141 T4430 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1759142 T4430 oasc.Overseer$ClusterStateUpdater.run WARN Solr 
cannot talk to ZK, exiting Overseer main queue loop 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /clusterstate.json
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ClusterState.load(ClusterState.java:239)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:445)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:242)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:234)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1759142 T4430 oasc.Overseer$ClusterStateUpdater.run Overseer 
Loop exiting : 127.0.0.1:37479_solr
   [junit4]   2> 1759143 T4433 
oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read 
the data org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1759144 T4364 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:37479 37479
   [junit4]   2> 1759555 T4413 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:37479 37479
   [junit4]   2> 1759557 T4364 oas.SolrTestCaseJ4.tearDown ###Ending 
testPlaceholders
   [junit4]   2> 1759564 T4364 oas.SolrTestCaseJ4.setUp ###Starting 
testShardAssignmentBigger
   [junit4]   2> 1759566 T4364 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1759567 T4434 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1759667 T4364 oasc.ZkTestServer.run start zk server on 
port:34236
   [junit4]   2> 1759668 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759670 T4440 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2f437b name:ZooKeeperConnection 
Watcher:127.0.0.1:34236 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1759670 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759672 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759672 T4442 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@422df2 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1759673 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759673 T4364 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1759675 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759676 T4444 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@41e266 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759676 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759676 T4364 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1759679 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759681 T4446 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@20d3eb name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759681 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759683 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1759686 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1759692 T4364 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:34236_solr
   [junit4]   2> 1759692 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1759694 T4364 oasc.Overseer.start Overseer 
(id=92197342742118403-127.0.0.1:34236_solr-n_0000000000) starting
   [junit4]   2> 1759695 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1759697 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1759701 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1759705 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1759707 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1759711 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1759717 T4448 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1759717 T4364 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1759718 T4447 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1759719 T4364 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1759720 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759723 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759725 T4450 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7c46be name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759725 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759727 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759731 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node0
   [junit4]   2> 1759736 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759737 T4454 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1311558 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759737 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759738 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759741 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node1
   [junit4]   2> 1759746 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759746 T4457 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@762d70 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759747 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759748 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759750 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node2
   [junit4]   2> 1759753 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759754 T4460 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@449a24 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759754 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759755 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759757 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node3
   [junit4]   2> 1759762 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759764 T4463 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@10231f0 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759764 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759766 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759769 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node4
   [junit4]   2> 1759773 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759774 T4466 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3ca7f0 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759774 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759776 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759779 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node5
   [junit4]   2> 1759783 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759784 T4469 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@b75553 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759785 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759787 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759789 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node6
   [junit4]   2> 1759793 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759794 T4472 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@15e1e91 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759795 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759796 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759798 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node7
   [junit4]   2> 1759803 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759804 T4475 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1829106 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759805 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759807 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759810 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node8
   [junit4]   2> 1759816 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759817 T4478 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1997d80 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759818 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759820 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759823 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node9
   [junit4]   2> 1759830 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759832 T4481 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@106a0b8 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759832 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759833 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759836 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node10
   [junit4]   2> 1759840 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759841 T4484 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@49398a name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759841 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759842 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759845 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node11
   [junit4]   2> 1759850 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759852 T4487 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1cd2a99 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759852 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759853 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759854 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node12
   [junit4]   2> 1759858 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759860 T4490 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@8fbfe9 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759860 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759861 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759862 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node13
   [junit4]   2> 1759865 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759866 T4493 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a8acc2 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759866 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759867 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759868 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node14
   [junit4]   2> 1759871 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759872 T4496 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@726433 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759872 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759873 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759874 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node15
   [junit4]   2> 1759878 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759878 T4499 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1273e8a name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759879 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759879 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759881 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node16
   [junit4]   2> 1759884 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759885 T4502 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@189f2ab name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759885 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759886 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759888 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node17
   [junit4]   2> 1759891 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759892 T4505 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1974c26 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759892 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759893 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759894 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node18
   [junit4]   2> 1759898 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759899 T4508 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@192fd3b name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759899 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759900 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759902 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node19
   [junit4]   2> 1759905 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759906 T4511 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@83862b name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759907 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759907 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759908 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node20
   [junit4]   2> 1759914 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759915 T4514 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@38fa6 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759915 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759916 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759918 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node21
   [junit4]   2> 1759921 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759922 T4517 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@594206 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759922 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759923 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759925 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node22
   [junit4]   2> 1759930 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759931 T4520 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@aa7a50 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759931 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759932 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759935 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node23
   [junit4]   2> 1759942 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759943 T4523 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1ff3313 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759944 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759945 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759949 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node24
   [junit4]   2> 1759955 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759957 T4526 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a4f1e4 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759958 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759960 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759964 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node25
   [junit4]   2> 1759972 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759973 T4529 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@14136d7 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759973 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759975 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759978 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node26
   [junit4]   2> 1759986 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1759987 T4532 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b676ac name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1759988 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1759990 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1759992 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node27
   [junit4]   2> 1759999 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760000 T4535 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@443921 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760001 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760002 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760006 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node28
   [junit4]   2> 1760014 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760016 T4538 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@8acb38 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760016 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760018 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760021 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node29
   [junit4]   2> 1760028 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760030 T4541 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@53eba0 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760030 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760031 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760034 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node30
   [junit4]   2> 1760042 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760043 T4544 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1be7868 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760044 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760046 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760050 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node31
   [junit4]   2> 1760056 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760057 T4547 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2ffeff name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760058 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760060 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760064 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node32
   [junit4]   2> 1760071 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760073 T4550 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@12d2a15 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760073 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760075 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760078 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node33
   [junit4]   2> 1760088 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760089 T4553 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e3fc08 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760090 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760091 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760094 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node34
   [junit4]   2> 1760102 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760104 T4556 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@8a593e name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760104 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760106 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760109 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node35
   [junit4]   2> 1760119 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760120 T4559 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@f60ca name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760121 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760123 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760125 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node36
   [junit4]   2> 1760132 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760133 T4562 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1d9ec0 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760133 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760134 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760136 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node37
   [junit4]   2> 1760144 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760146 T4565 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@190b5d2 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760146 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760148 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760151 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node38
   [junit4]   2> 1760159 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760161 T4568 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@19aa63 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760161 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760163 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760167 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node39
   [junit4]   2> 1760180 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760181 T4571 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@c5f962 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760182 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760183 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760186 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node40
   [junit4]   2> 1760196 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760198 T4574 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@11f2c91 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760198 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760200 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760203 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node41
   [junit4]   2> 1760213 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760214 T4577 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@14156b4 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760215 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760216 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760220 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node42
   [junit4]   2> 1760229 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760230 T4580 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@19d1ffc name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760230 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760232 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760235 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node43
   [junit4]   2> 1760245 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760246 T4583 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@975731 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760246 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760248 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760251 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node44
   [junit4]   2> 1760259 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760260 T4586 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1bc9083 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760261 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760262 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760265 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node45
   [junit4]   2> 1760275 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760276 T4589 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1289b6b name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760277 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760278 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760282 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node46
   [junit4]   2> 1760292 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760294 T4592 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1687e66 name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760295 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760296 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760299 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node47
   [junit4]   2> 1760307 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760309 T4595 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b3df3e name:ZooKeeperConnection 
Watcher:127.0.0.1:34236/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1760309 T4364 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1760310 T4364 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1760314 T4364 oascc.SolrZkClient.makePath makePath: 
/live_nodes/node48
   [junit4]   2> 1760323 T4364 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1760324 T4598 oascc.ConnectionManager.process Watcher 
org.apache.so

[...truncated too long message...]

9978 T4364 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1829981 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1829986 T4364 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:50244_solr
   [junit4]   2> 1829987 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1829990 T4364 oasc.Overseer.start Overseer 
(id=92197347347857411-127.0.0.1:50244_solr-n_0000000000) starting
   [junit4]   2> 1829993 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1829997 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1830002 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1830007 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1830010 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1830013 T4364 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1830020 T5101 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1830021 T5100 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1830022 T4364 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1830024 T5100 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1830025 T5100 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=null message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>          "node_name":"node1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "core":"core1",
   [junit4]   2>          "roles":"",
   [junit4]   2>          "state":"recovering"}
   [junit4]   2> 1830025 T5100 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 1830029 T5102 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1830030 T5103 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 1830074 T4364 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1830077 T5102 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1830079 T5100 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1830081 T5100 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=null message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "base_url":"http://127.0.0.1/solr";,
   [junit4]   2>          "node_name":"node1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "core":"core1",
   [junit4]   2>          "roles":"",
   [junit4]   2>          "state":"active"}
   [junit4]   2> 1830081 T5100 oasc.Overseer$ClusterStateUpdater.updateState 
node=core_node1 is already registered
   [junit4]   2> 1830081 T5100 oasc.Overseer$ClusterStateUpdater.updateState 
shard=shard1 is already registered
   [junit4]   2> 1830085 T5102 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1830187 T5103 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 1830231 T4364 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:50244 50244
   [junit4]   2> 1830778 T5087 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:50244 50244
   [junit4]   2> 1830780 T4364 oas.SolrTestCaseJ4.tearDown ###Ending 
testStateChange
   [junit4]   2> 1830781 T5100 oasc.Overseer$ClusterStateUpdater.run Overseer 
Loop exiting : 127.0.0.1:50244_solr
   [junit4]   2> 1830782 T5104 
oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read 
the data org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1833784 T4364 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-32C8E711A988EB4E-001
   [junit4]   2> NOTE: test params are: codec=Lucene46, sim=DefaultSimilarity, 
locale=es_PY, timezone=Europe/San_Marino
   [junit4]   2> NOTE: Linux 3.13.0-32-generic i386/Oracle Corporation 1.7.0_65 
(32-bit)/cpus=8,threads=1,free=182870928,total=490733568
   [junit4]   2> NOTE: All tests run in this JVM: [TestStressRecovery, 
TestFoldingMultitermQuery, HdfsBasicDistributedZk2Test, TimeZoneUtilsTest, 
TestReloadAndDeleteDocs, TriLevelCompositeIdRoutingTest, HdfsSyncSliceTest, 
TestSolr4Spatial, TestReplicationHandler, HdfsBasicDistributedZkTest, 
MBeansHandlerTest, ResponseLogComponentTest, FieldFacetTest, 
ReplicationFactorTest, TestAnalyzeInfixSuggestions, 
TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions, 
TestLMJelinekMercerSimilarityFactory, MigrateRouteKeyTest, 
HdfsCollectionsAPIDistributedZkTest, TestQuerySenderListener, 
TestFileDictionaryLookup, TestSolrCoreProperties, TestCollationFieldDocValues, 
HighlighterTest, NotRequiredUniqueKeyTest, TestCodecSupport, ExpressionTest, 
ZkCLITest, TestCopyFieldCollectionResource, TestClassNameShortening, 
DisMaxRequestHandlerTest, ShowFileRequestHandlerTest, 
DistributedDebugComponentTest, TestDynamicFieldCollectionResource, 
IndexBasedSpellCheckerTest, TestNoOpRegenerator, QueryResultKeyTest, 
TestJmxIntegration, TestSchemaVersionResource, RecoveryZkTest, 
TestComplexPhraseQParserPlugin, TestPartialUpdateDeduplication, 
TestComponentsName, DocValuesMultiTest, JsonLoaderTest, 
DistributedIntervalFacetingTest, TestTrie, TestReRankQParserPlugin, 
TestCloudManagedSchemaConcurrent, QueryEqualityTest, TestRemoteStreaming, 
DocumentAnalysisRequestHandlerTest, TestFastLRUCache, CursorMarkTest, 
TestDynamicFieldResource, DateFieldTest, SpellPossibilityIteratorTest, 
TestCloudInspectUtil, UpdateParamsTest, PathHierarchyTokenizerFactoryTest, 
TestOverriddenPrefixQueryForCustomFieldType, StandardRequestHandlerTest, 
AddSchemaFieldsUpdateProcessorFactoryTest, LeaderElectionTest, 
FastVectorHighlighterTest, TestDocBasedVersionConstraints, TestFaceting, 
WordBreakSolrSpellCheckerTest, HdfsWriteToMultipleCollectionsTest, 
SolrCmdDistributorTest, ChaosMonkeyNothingIsSafeTest, TestRangeQuery, 
CoreAdminCreateDiscoverTest, TestRandomDVFaceting, SuggestComponentTest, 
SuggesterTSTTest, TestAddFieldRealTimeGet, TestWordDelimiterFilterFactory, 
SpellCheckComponentTest, ExternalFileFieldSortTest, TestSolrJ, 
TestExceedMaxTermLength, TestSolrDeletionPolicy1, TestSort, AssignTest, 
TestArbitraryIndexDir, BasicDistributedZkTest, TestSolrIndexConfig, 
PingRequestHandlerTest, TestSearcherReuse, PreAnalyzedUpdateProcessorTest, 
DeleteInactiveReplicaTest, TestSolrXmlPersistence, TestManagedSchema, 
DirectUpdateHandlerTest, TestFastWriter, ResponseHeaderTest, TestConfig, 
FileUtilsTest, PluginInfoTest, PrimUtilsTest, TestUtils, SyncSliceTest, 
OverseerTest]
   [junit4] Completed on J0 in 82.23s, 9 tests, 1 error <<< FAILURES!

[...truncated 633 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298:
 The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: 
There were test failures: 422 suites, 1754 tests, 1 error, 39 ignored (18 
assumptions)

Total time: 97 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_65 -client 
-XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to