Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Solaris/172/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerStatsReset
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at
__randomizedtesting.SeedInfo.seed([73C054B779021893:D894B38BECD8BB9D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at
org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:722)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9276 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTest_73C054B779021893-001/init-core-data-001
[junit4] 2> 41646 INFO
(SUITE-OverseerTest-seed#[73C054B779021893]-worker) [ ] o.a.s.SolrTestCaseJ4
Randomized ssl (false) and clientAuth (false)
[junit4] 2> 41646 INFO
(SUITE-OverseerTest-seed#[73C054B779021893]-worker) [ ] o.a.s.SolrTestCaseJ4
####initCore
[junit4] 2> 41646 INFO
(SUITE-OverseerTest-seed#[73C054B779021893]-worker) [ ] o.a.s.SolrTestCaseJ4
####initCore end
[junit4] 2> 41653 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Starting testOverseerFailure
[junit4] 2> 41653 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 41654 INFO (Thread-89) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 41654 INFO (Thread-89) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 41755 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer start zk server on port:33478
[junit4] 2> 41755 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 41756 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 41772 INFO (zkCallback-25-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@118772f1
name:ZooKeeperConnection Watcher:127.0.0.1:33478 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 41772 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 41772 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 41776 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 41777 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 41782 INFO (zkCallback-26-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@2bd61e36
name:ZooKeeperConnection Watcher:127.0.0.1:33478 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 41782 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 41783 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 41783 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 41789 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 41791 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 41794 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@277c0178
name:ZooKeeperConnection Watcher:127.0.0.1:33478/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 41794 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 41795 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 41800 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 41805 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 41807 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 41810 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 41813 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 41816 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 41820 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 41821 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 41826 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@5d3de31b
name:ZooKeeperConnection Watcher:127.0.0.1:33478/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 41827 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 41828 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 41834 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 41837 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
[junit4] 2> 41840 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 41840 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 41846 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 41852 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 41866 INFO (zkCallback-29-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@47ea6be4
name:ZooKeeperConnection Watcher:127.0.0.1:33478/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 41866 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 41867 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 41867 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 41888 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 41891 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 41895 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 41896 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/overseer_elect/election/94828002538291204-127.0.0.1:33478_solr-n_0000000000
[junit4] 2> 41897 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33478_solr
[junit4] 2> 41897 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 41901 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002538291204-127.0.0.1:33478_solr-n_0000000000) starting
[junit4] 2> 41903 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 41907 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 41912 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 41917 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 41921 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 41926 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 41934 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerAutoReplicaFailoverThread Starting
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 41934 INFO
(OverseerCollectionConfigSetProcessor-94828002538291204-127.0.0.1:33478_solr-n_0000000000)
[ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer
operations
[junit4] 2> 41939 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 41939 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 42944 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"} current state version: 0
[junit4] 2> 42945 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 42945 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 42945 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 42948 INFO (zkCallback-29-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 42948 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 42949 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 43440 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 43448 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 43448 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 43448 INFO (zkCallback-29-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 43456 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000000
[junit4] 2> 43458 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
[junit4] 2> 43464 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 43471 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 43472 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"}
[junit4] 2> 43481 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 43486 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 43490 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"} current state version: 1
[junit4] 2> 43491 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 43491 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
[junit4] 2> 43499 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000001
[junit4] 2> 43500 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector was going to be leader
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000001
, seq(0)
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000000
[junit4] 2> 43599 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 43599 INFO (zkCallback-29-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 43600 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 43942 INFO
(OverseerCollectionConfigSetProcessor-94828002538291204-127.0.0.1:33478_solr-n_0000000000)
[ ] o.a.s.c.OverseerTaskProcessor
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:355)
[junit4] 2> at
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:172)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 43942 INFO
(OverseerCollectionConfigSetProcessor-94828002538291204-127.0.0.1:33478_solr-n_0000000000)
[ ] o.a.s.c.OverseerTaskProcessor According to ZK I
(id=94828002538291204-127.0.0.1:33478_solr-n_0000000000) am no longer a leader.
[junit4] 2> 44608 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 44615 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000002
[junit4] 2> 44616 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector was going to be leader
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000002
, seq(0)
/collections/collection1/leader_elect/shard1/election/94828002538291203-node1_core1-n_0000000000
[junit4] 2> 44616 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 44617 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 44619 INFO (zkCallback-31-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@e05cc4a name:ZooKeeperConnection
Watcher:127.0.0.1:33478/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 44619 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 44620 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 44620 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002538291204-127.0.0.1:33478_solr-n_0000000000) closing
[junit4] 2> 44620 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 44620 INFO
(OverseerStateUpdate-94828002538291204-127.0.0.1:33478_solr-n_0000000000) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33478_solr
[junit4] 2> 44625 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could
not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 44628 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 44629 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/overseer_elect/election/94828002538291205-127.0.0.1:33478_solr-n_0000000001
[junit4] 2> 44630 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33478_solr
[junit4] 2> 44630 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 44633 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002538291205-127.0.0.1:33478_solr-n_0000000001) starting
[junit4] 2> 44654 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerAutoReplicaFailoverThread Starting
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 44654 INFO
(OverseerCollectionConfigSetProcessor-94828002538291205-127.0.0.1:33478_solr-n_0000000001)
[ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer
operations
[junit4] 2> 44655 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 44656 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 44664 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer processMessage: workQueueSize: 3, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"}
[junit4] 2> 44664 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"}
[junit4] 2> 44665 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44666 INFO (zkCallback-31-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44666 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44671 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer processMessage: workQueueSize: 3, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "core":"core1"}
[junit4] 2> 44675 INFO (zkCallback-31-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44675 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44676 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44678 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer processMessage: workQueueSize: 3, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 44679 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 44679 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
[junit4] 2> 44680 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44680 INFO (zkCallback-31-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44680 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44683 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"} current state version: 5
[junit4] 2> 44684 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 44684 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
[junit4] 2> 44799 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44800 INFO (zkCallback-31-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44801 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 44823 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"deletecore",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1"} current state version: 6
[junit4] 2> 44953 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.o.ZkStateWriter going to delete_collection
/collections/collection1/state.json
[junit4] 2> 45013 INFO (zkCallback-31-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 45014 INFO (zkCallback-27-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 45016 INFO (zkCallback-28-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 45016 INFO (zkCallback-27-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 45019 INFO (zkCallback-31-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 45020 INFO (zkCallback-28-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 45519 INFO (zkCallback-27-thread-2) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 45519 INFO (zkCallback-31-thread-2) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 45519 INFO (zkCallback-28-thread-2) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 45532 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:33478 33478
[junit4] 2> 45551 INFO (Thread-89) [ ] o.a.s.c.ZkTestServer connecting
to 127.0.0.1:33478 33478
[junit4] 2> 45554 WARN (Thread-89) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 45554 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Ending testOverseerFailure
[junit4] 2> 45554 INFO
(TEST-OverseerTest.testOverseerFailure-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002538291205-127.0.0.1:33478_solr-n_0000000001) closing
[junit4] 2> 45554 INFO
(OverseerStateUpdate-94828002538291205-127.0.0.1:33478_solr-n_0000000001) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33478_solr
[junit4] 2> 45555 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could
not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 45569 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Starting testDoubleAssignment
[junit4] 2> 45571 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 45571 INFO (Thread-90) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 45571 INFO (Thread-90) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 45671 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer start zk server on port:58871
[junit4] 2> 45671 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 45672 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 45676 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@1c6273a2
name:ZooKeeperConnection Watcher:127.0.0.1:58871/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45677 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 45677 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 45677 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 45678 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 45681 INFO (zkCallback-34-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@33eb2f44
name:ZooKeeperConnection Watcher:127.0.0.1:58871 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45681 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 45681 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 45688 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 45688 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 45693 INFO (zkCallback-35-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@4c79afa5
name:ZooKeeperConnection Watcher:127.0.0.1:58871 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45693 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 45694 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 45694 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 45704 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 45708 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 45711 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 45715 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 45718 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 45720 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 45726 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 45728 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 45730 INFO (zkCallback-36-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@f73c2e6 name:ZooKeeperConnection
Watcher:127.0.0.1:58871/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 45730 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 45731 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 45736 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 45740 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
[junit4] 2> 45743 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 45743 INFO (zkCallback-36-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 45745 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 45745 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 45749 INFO (zkCallback-37-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@13901309
name:ZooKeeperConnection Watcher:127.0.0.1:58871/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45749 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 45750 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 45750 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 45754 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 45758 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 45760 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 45761 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/overseer_elect/election/94828002794930180-127.0.0.1:58871_solr-n_0000000000
[junit4] 2> 45761 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58871_solr
[junit4] 2> 45761 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 45763 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002794930180-127.0.0.1:58871_solr-n_0000000000) starting
[junit4] 2> 45765 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 45768 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 45772 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 45776 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 45782 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 45787 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 45796 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerAutoReplicaFailoverThread Starting
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 45797 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 45798 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 45797 INFO
(OverseerCollectionConfigSetProcessor-94828002794930180-127.0.0.1:58871_solr-n_0000000000)
[ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer
operations
[junit4] 2> 45805 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"} current state version: 0
[junit4] 2> 45806 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 45806 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 45806 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 45809 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 45809 INFO (zkCallback-36-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 45809 INFO (zkCallback-37-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 46304 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 46308 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 46308 INFO (zkCallback-36-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 46309 INFO (zkCallback-37-thread-1) [ ]
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/collections, has occurred - updating...
[junit4] 2> 46319 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/collections/collection1/leader_elect/shard1/election/94828002794930179-node1_core1-n_0000000000
[junit4] 2> 46321 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
[junit4] 2> 46331 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 46346 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 46347 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"}
[junit4] 2> 46350 INFO (zkCallback-37-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 46350 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 46351 INFO (zkCallback-36-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 46356 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 46357 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 46358 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 46361 INFO (zkCallback-39-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@f1c0a7e name:ZooKeeperConnection
Watcher:127.0.0.1:58871/solr got event WatchedEvent state:SyncConnected
type:None path:null path:null type:None
[junit4] 2> 46361 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 46361 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 46370 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 46374 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
[junit4] 2> 46376 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 46376 INFO (zkCallback-39-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 46377 INFO (zkCallback-37-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 0)
[junit4] 2> 46381 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath:
/collections/collection1/leader_elect/shard1/election
[junit4] 2> 46391 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"} current state version: 1
[junit4] 2> 46392 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 46392 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
[junit4] 2> 46397 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/collections/collection1/leader_elect/shard1/election/94828002794930181-node1_core1-n_0000000001
[junit4] 2> 46399 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
[junit4] 2> 46407 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 46409 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "core":"core1"}
[junit4] 2> 46415 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://node1/solr/";,
[junit4] 2> "core":"core1"} current state version: 1
[junit4] 2> 46527 INFO (zkCallback-39-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 46527 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 46531 INFO (zkCallback-37-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 1)
[junit4] 2> 46543 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from
client sessionid 0x150e590ed5a0004, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 46544 INFO (zkCallback-39-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 46544 INFO (zkCallback-33-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 1)
[junit4] 2> 46547 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from
client sessionid 0x150e590ed5a0005, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 46547 WARN (zkCallback-39-thread-1) [ ]
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 46550 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:58871 58871
[junit4] 2> 46587 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxnFactory Ignoring unexpected runtime exception
[junit4] 2> java.nio.channels.CancelledKeyException
[junit4] 2> at
sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at
sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 46587 INFO (Thread-90) [ ] o.a.s.c.ZkTestServer connecting
to 127.0.0.1:58871 58871
[junit4] 2> 46593 WARN (Thread-90) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2>
[junit4] 2> 46593 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Ending testDoubleAssignment
[junit4] 2> 46593 INFO
(TEST-OverseerTest.testDoubleAssignment-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002794930180-127.0.0.1:58871_solr-n_0000000000) closing
[junit4] 2> 46594 INFO
(OverseerStateUpdate-94828002794930180-127.0.0.1:58871_solr-n_0000000000) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:58871_solr
[junit4] 2> 46596 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could
not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 46606 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Starting testStateChange
[junit4] 2> 46609 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 46610 INFO (Thread-91) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 46610 INFO (Thread-91) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 46712 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer start zk server on port:42543
[junit4] 2> 46712 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 46713 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 46724 INFO (zkCallback-40-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@127ac516
name:ZooKeeperConnection Watcher:127.0.0.1:42543/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 46725 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 46725 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 46725 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 46726 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 46729 INFO (zkCallback-41-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@622d3370
name:ZooKeeperConnection Watcher:127.0.0.1:42543 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 46729 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 46730 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 46737 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 46738 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 46741 INFO (zkCallback-42-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@5e731f32
name:ZooKeeperConnection Watcher:127.0.0.1:42543 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 46741 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 46742 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 46742 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 46749 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 46752 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 46757 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 46760 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 46763 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 46765 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 46768 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 46769 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 46780 INFO (zkCallback-43-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@3f1eae56
name:ZooKeeperConnection Watcher:127.0.0.1:42543/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 46780 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 46781 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 46781 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 46787 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 46790 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 46792 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 46793 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.LeaderElector Joined leadership election with path:
/overseer_elect/election/94828002862956547-127.0.0.1:42543_solr-n_0000000000
[junit4] 2> 46794 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42543_solr
[junit4] 2> 46794 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 46797 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002862956547-127.0.0.1:42543_solr-n_0000000000) starting
[junit4] 2> 46800 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 46804 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 46809 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 46813 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 46816 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 46822 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 46831 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.OverseerAutoReplicaFailoverThread Starting
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
autoReplicaFailoverWaitAfterExpiration=30000
autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 46832 INFO
(OverseerCollectionConfigSetProcessor-94828002862956547-127.0.0.1:42543_solr-n_0000000000)
[ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer
operations
[junit4] 2> 46836 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 46837 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 46851 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"} current state version: 0
[junit4] 2> 46855 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 46855 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 46863 INFO (zkCallback-43-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 0)
[junit4] 2> 46863 INFO (zkCallback-40-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 0)
[junit4] 2> 46895 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 46896 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr";,
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 46896 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
[junit4] 2> 46896 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
[junit4] 2> 47002 INFO (zkCallback-40-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 0)
[junit4] 2> 47002 INFO (zkCallback-43-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred
- updating... (live nodes size: 0)
[junit4] 2> 47046 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from
client sessionid 0x150e590f1680000, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 47060 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:42543 42543
[junit4] 2> 47168 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxnFactory Ignoring unexpected runtime exception
[junit4] 2> java.nio.channels.CancelledKeyException
[junit4] 2> at
sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at
sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 47169 INFO (Thread-91) [ ] o.a.s.c.ZkTestServer connecting
to 127.0.0.1:42543 42543
[junit4] 2> 47172 WARN (Thread-91) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/live_nodes
[junit4] 2> 2 /solr/collections
[junit4] 2>
[junit4] 2> 47172 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Ending testStateChange
[junit4] 2> 47172 INFO
(TEST-OverseerTest.testStateChange-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828002862956547-127.0.0.1:42543_solr-n_0000000000) closing
[junit4] 2> 47172 INFO
(OverseerStateUpdate-94828002862956547-127.0.0.1:42543_solr-n_0000000000) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42543_solr
[junit4] 2> 47174 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could
not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 47178 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Starting testReplay
[junit4] 2> 47180 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 47180 INFO (Thread-92) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 47180 INFO (Thread-92) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 47280 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer start zk server on port:43412
[junit4] 2> 47280 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 47281 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 47288 INFO (zkCallback-45-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@2fec3778
name:ZooKeeperConnection Watcher:127.0.0.1:43412/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47288 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 47289 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 47289 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 47289 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 47292 INFO (zkCallback-46-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@61b90a9d
name:ZooKeeperConnection Watcher:127.0.0.1:43412 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47293 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 47293 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 47296 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 47296 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 47299 INFO (zkCallback-47-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@5214f564
name:ZooKeeperConnection Watcher:127.0.0.1:43412 got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47300 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 47300 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 47300 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 47307 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 47310 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 47314 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 47317 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 47319 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 47321 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 47327 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 47332 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 47332 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 47337 INFO (zkCallback-48-thread-1) [ ]
o.a.s.c.c.ConnectionManager Watcher
org.apache.solr.common.cloud.ConnectionManager@4fa52ad3
name:ZooKeeperConnection Watcher:127.0.0.1:43412/solr got event WatchedEvent
state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47337 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 47337 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 47337 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
socketTimeout=600000&connTimeout=60000&retry=true
[junit4] 2> 47340 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 47343 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [ ]
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 47346 INFO
(TEST-OverseerTest.testReplay-seed#[73C054B779021893]) [
[...truncated too long message...]
nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 83874 INFO (zkCallback-118-thread-1) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 3)
[junit4] 2> 83875 INFO (zkCallback-119-thread-2) [ ]
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
nodes size: 3)
[junit4] 2> 83875 ERROR
(TEST-OverseerTest.testShardAssignmentBigger-seed#[73C054B779021893]-EventThread)
[ ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@6b4af8
rejected from
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@454de2d[Terminated,
pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 14]
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 85375 WARN (zkCallback-117-thread-2) [ ]
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 85378 ERROR
(TEST-OverseerTest.testShardAssignmentBigger-seed#[73C054B779021893]-EventThread)
[ ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@5c01f29b
rejected from
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@583e7dc3[Shutting
down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks =
14]
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 85380 ERROR
(TEST-OverseerTest.testShardAssignmentBigger-seed#[73C054B779021893]-EventThread)
[ ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@8934d21
rejected from
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@4d91d257[Shutting
down, pool size = 2, active threads = 0, queued tasks = 0, completed tasks =
16]
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 85381 INFO
(TEST-OverseerTest.testShardAssignmentBigger-seed#[73C054B779021893]) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:50598 50598
[junit4] 2> 85474 INFO (Thread-100) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:50598 50598
[junit4] 2> 85474 WARN (Thread-100) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 14 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 14 /solr/clusterstate.json
[junit4] 2> 4
/solr/collections/collection1/leader_elect/shard2/election/94828004804132878-node10_core10-n_0000000005
[junit4] 2> 2
/solr/collections/collection1/leader_elect/shard1/election/94828004804132873-node5_core5-n_0000000005
[junit4] 2> 2
/solr/collections/collection1/leader_elect/shard1/election/94828004804132875-node7_core7-n_0000000001
[junit4] 2> 2
/solr/collections/collection1/leader_elect/shard1/election/94828004804132876-node8_core8-n_0000000004
[junit4] 2> 2
/solr/collections/collection1/leader_elect/shard2/election/94828004804132870-node2_core2-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 14 /solr/live_nodes
[junit4] 2> 14 /solr/collections
[junit4] 2>
[junit4] 2> 85475 INFO
(TEST-OverseerTest.testShardAssignmentBigger-seed#[73C054B779021893]) [ ]
o.a.s.SolrTestCaseJ4 ###Ending testShardAssignmentBigger
[junit4] 2> 85475 INFO
(TEST-OverseerTest.testShardAssignmentBigger-seed#[73C054B779021893]) [ ]
o.a.s.c.Overseer Overseer
(id=94828004804132867-127.0.0.1:50598_solr-n_0000000000) closing
[junit4] 2> 85476 INFO
(OverseerStateUpdate-94828004804132867-127.0.0.1:50598_solr-n_0000000000) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:50598_solr
[junit4] 2> 85476 ERROR (OverseerExitThread) [ ] o.a.s.c.Overseer could
not read the data
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
[junit4] 2> at
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
[junit4] 2> 88476 INFO
(SUITE-OverseerTest-seed#[73C054B779021893]-worker) [ ] o.a.s.SolrTestCaseJ4
###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTest_73C054B779021893-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {},
docValues:{}, sim=ClassicSimilarity, locale=ar_EG, timezone=Africa/Dakar
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_66
(64-bit)/cpus=3,threads=1,free=167515760,total=214958080
[junit4] 2> NOTE: All tests run in this JVM: [ReplicationFactorTest,
DeleteShardTest, TestEmbeddedSolrServerConstructors, AnalyticsQueryTest,
TestReplicationHandlerBackup, SampleTest, OverseerTest]
[junit4] Completed [16/555] on J0 in 46.85s, 12 tests, 1 failure, 1 skipped
<<< FAILURES!
[...truncated 1745 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:775: The
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:719: The
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:59: The
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build.xml:233:
The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/common-build.xml:516:
The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:1432:
The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:987:
There were test failures: 555 suites (8 ignored), 2200 tests, 1 failure, 81
ignored (67 assumptions) [seed: 73C054B779021893]
Total time: 73 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
