Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1602/ Java: 64bit/jdk-14.0.1 -XX:+UseCompressedOops -XX:+UseSerialGC
2 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.cloud.LeaderElectionTest Error Message: 1 thread leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 1) Thread[id=12433, name=SessionTracker, state=TIMED_WAITING, group=TGRP-LeaderElectionTest] at [email protected]/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.LeaderElectionTest: 1) Thread[id=12433, name=SessionTracker, state=TIMED_WAITING, group=TGRP-LeaderElectionTest] at [email protected]/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157) at __randomizedtesting.SeedInfo.seed([12172D7A441F7E52]:0) FAILED: junit.framework.TestSuite.org.apache.solr.search.facet.TestJsonFacets Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([12172D7A441F7E52]:0) Build Log: [...truncated 14814 lines...] [junit4] Suite: org.apache.solr.cloud.LeaderElectionTest [junit4] 2> 1340351 INFO (SUITE-LeaderElectionTest-seed#[12172D7A441F7E52]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf' [junit4] 2> 1340351 INFO (SUITE-LeaderElectionTest-seed#[12172D7A441F7E52]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 1340352 INFO (SUITE-LeaderElectionTest-seed#[12172D7A441F7E52]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionTest_12172D7A441F7E52-001/data-dir-93-001 [junit4] 2> 1340352 WARN (SUITE-LeaderElectionTest-seed#[12172D7A441F7E52]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4 [junit4] 2> 1340352 INFO (SUITE-LeaderElectionTest-seed#[12172D7A441F7E52]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 1340353 INFO (SUITE-LeaderElectionTest-seed#[12172D7A441F7E52]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth [junit4] 2> 1340357 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStressElection [junit4] 2> 1340357 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1340358 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 [junit4] 2> 1340358 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1340358 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. [junit4] 2> 1340457 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer start zk server on port: 59518 [junit4] 2> 1340458 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59518 [junit4] 2> 1340458 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59518 [junit4] 2> 1340458 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59518 [junit4] 2> 1340460 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1340464 INFO (zkConnectionManagerCallback-7629-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1340464 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1340468 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1340472 INFO (zkConnectionManagerCallback-7631-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1340472 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1340473 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1340477 INFO (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1340477 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1340485 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1340488 INFO (zkConnectionManagerCallback-7638-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1340488 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1341342 INFO (stressElection-7636-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1341344 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1341356 INFO (zkConnectionManagerCallback-7642-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1341357 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1341359 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1341359 INFO (stressElection-7636-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241467577729027-shard10-n_0000000000 [junit4] 2> 1341361 INFO (zkConnectionManagerCallback-7646-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1341361 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1341363 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1341363 WARN (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b65060003. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060003, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060003, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1341365 INFO (zkConnectionManagerCallback-7650-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1341365 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1341366 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1341366 INFO (zkConnectionManagerCallback-7654-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1341366 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1341371 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1341373 INFO (zkConnectionManagerCallback-7658-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1341373 INFO (Thread-1694) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1341397 WARN (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Session 0x100a73b65060002 for sever localhost/127.0.0.1:59518, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060002, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060002, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1341397 WARN (NIOWorkerThread-6) [ ] o.a.z.s.NIOServerCnxn Unexpected exception [junit4] 2> => EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:59535, session = 0x100a73b65060004 [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) [junit4] 2> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:59535, session = 0x100a73b65060004 [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:326) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1341499 WARN (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a692b04 name: ZooKeeperConnection Watcher:127.0.0.1:59518/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 1341499 WARN (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 1341513 INFO (stressElection-7636-thread-2) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1341516 INFO (stressElection-7636-thread-2) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241467577729031-shard14-n_0000000001 [junit4] 2> 1341600 WARN (Thread-1694-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b65060005. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060005, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060005, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1341718 INFO (stressElection-7636-thread-3) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1341747 INFO (stressElection-7636-thread-4) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1341747 ERROR (stressElection-7636-thread-4) [ ] o.a.s.c.LeaderElectionTest setup failed [junit4] 2> => java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard1 [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:81) [junit4] 2> java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard1 [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:81) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$TestLeaderElectionContext.<init>(LeaderElectionTest.java:93) ~[test/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:165) ~[test/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:177) [test/:?] [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?] [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard1 [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2256) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:79) ~[java/:?] [junit4] 2> ... 9 more [junit4] 2> 1341782 INFO (stressElection-7636-thread-5) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1341782 ERROR (stressElection-7636-thread-5) [ ] o.a.s.c.LeaderElectionTest setup failed [junit4] 2> => java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard1 [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:81) [junit4] 2> java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard1 [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:81) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$TestLeaderElectionContext.<init>(LeaderElectionTest.java:93) ~[test/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:165) ~[test/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:177) [test/:?] [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?] [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard1 [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2256) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:79) ~[java/:?] [junit4] 2> ... 9 more [junit4] 2> 1341794 INFO (stressElection-7636-thread-6) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1341795 WARN (Thread-1694-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Session 0x100a73b65060004 for sever localhost/127.0.0.1:59518, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => java.nio.channels.CancelledKeyException [junit4] 2> at java.base/sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:74) [junit4] 2> java.nio.channels.CancelledKeyException: null [junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:74) ~[?:?] [junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:93) ~[?:?] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.enableWrite(ClientCnxnSocketNIO.java:379) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1342501 WARN (NIOWorkerThread-8) [ ] o.a.z.s.NIOServerCnxn Unexpected exception [junit4] 2> => EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:59538, session = 0x100a73b65060007 [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) [junit4] 2> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:59538, session = 0x100a73b65060007 [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:326) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1342760 WARN (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100a73b65060002 has expired [junit4] 2> 1342760 WARN (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a692b04 name: ZooKeeperConnection Watcher:127.0.0.1:59518/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 1342761 WARN (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 1342761 WARN (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Session 0x100a73b65060002 for sever localhost/127.0.0.1:59518, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100a73b65060002 has expired [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1419) [junit4] 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100a73b65060002 has expired [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1419) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1342767 WARN (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 1342769 INFO (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1342774 INFO (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1342774 INFO (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1342774 INFO (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper [junit4] 2> 1342774 INFO (zkConnectionManagerCallback-7633-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient Connected: true [junit4] 2> 1343058 WARN (NIOWorkerThread-12) [ ] o.a.z.s.NIOServerCnxn Unexpected exception [junit4] 2> => EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:59539, session = 0x100a73b65060008 [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) [junit4] 2> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /127.0.0.1:59539, session = 0x100a73b65060008 [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:326) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1343397 ERROR (stressElection-7636-thread-6) [ ] o.a.s.c.LeaderElectionTest setup failed [junit4] 2> => org.apache.solr.common.AlreadyClosedException [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:69) [junit4] 2> org.apache.solr.common.AlreadyClosedException: null [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:69) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315) ~[java/:?] [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.<init>(ShardLeaderElectionContextBase.java:79) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$TestLeaderElectionContext.<init>(LeaderElectionTest.java:93) ~[test/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$ClientThread.setupOnConnect(LeaderElectionTest.java:165) ~[test/:?] [junit4] 2> at org.apache.solr.cloud.LeaderElectionTest$ClientThread.run(LeaderElectionTest.java:177) [test/:?] [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?] [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] [junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1343615 WARN (zkConnectionManagerCallback-7633-thread-1-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Session 0x100a73b65060009 for sever localhost/127.0.0.1:59518, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060009, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060009, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1343716 WARN (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a692b04 name: ZooKeeperConnection Watcher:127.0.0.1:59518/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 1343716 WARN (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected [junit4] 2> 1345649 WARN (zkConnectionManagerCallback-7633-thread-1-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100a73b65060009 has expired [junit4] 2> 1345649 WARN (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a692b04 name: ZooKeeperConnection Watcher:127.0.0.1:59518/solr got event WatchedEvent state:Expired type:None path:null path: null type: None [junit4] 2> 1345649 WARN (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... [junit4] 2> 1345649 WARN (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... [junit4] 2> 1345649 WARN (zkConnectionManagerCallback-7633-thread-1-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn Session 0x100a73b65060009 for sever localhost/127.0.0.1:59518, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100a73b65060009 has expired [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1419) [junit4] 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100a73b65060009 has expired [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1419) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1345650 INFO (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1345653 INFO (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1345653 INFO (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1345653 INFO (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper [junit4] 2> 1345653 INFO (zkConnectionManagerCallback-7633-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient Connected: true [junit4] 2> 1346255 WARN (Thread-1694-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b65060007. [junit4] 2> => java.nio.channels.CancelledKeyException [junit4] 2> at java.base/sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:74) [junit4] 2> java.nio.channels.CancelledKeyException: null [junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:74) ~[?:?] [junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:93) ~[?:?] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.enableWrite(ClientCnxnSocketNIO.java:379) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1346357 WARN (Thread-1694-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b65060008. [junit4] 2> => java.nio.channels.CancelledKeyException [junit4] 2> at java.base/sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:74) [junit4] 2> java.nio.channels.CancelledKeyException: null [junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:74) ~[?:?] [junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:93) ~[?:?] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.enableWrite(ClientCnxnSocketNIO.java:379) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1346459 WARN (zkConnectionManagerCallback-7658-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@674501b7 name: ZooKeeperConnection Watcher:127.0.0.1:59518/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None [junit4] 2> 1346462 WARN (zkConnectionManagerCallback-7633-thread-1-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b6506000a. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b6506000a, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b6506000a, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1346563 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 1346566 WARN (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59518)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b65060000. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060000, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b65060000, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1346801 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:59518 [junit4] 2> 1346801 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59518 [junit4] 2> 1346801 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59518 [junit4] 2> 1346801 INFO (TEST-LeaderElectionTest.testStressElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testStressElection [junit4] 2> 1346807 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testParallelElection [junit4] 2> 1346808 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1346808 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 [junit4] 2> 1346808 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1346809 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. [junit4] 2> 1346913 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer start zk server on port: 59620 [junit4] 2> 1346913 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59620 [junit4] 2> 1346913 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59620 [junit4] 2> 1346913 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59620 [junit4] 2> 1346916 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1346924 INFO (zkConnectionManagerCallback-7662-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1346924 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1346932 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1346940 INFO (zkConnectionManagerCallback-7664-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1346940 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1346942 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1346951 INFO (zkConnectionManagerCallback-7666-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1346951 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1346966 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.LeaderElectionTest Testing parallel election across 3 shards [junit4] 2> 1346968 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1346976 INFO (zkConnectionManagerCallback-7670-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1346977 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1346980 INFO (Thread-parshard11) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/parshard1 [junit4] 2> 1346981 INFO (Thread-parshard31) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/parshard3 [junit4] 2> 1346981 INFO (Thread-parshard21) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/parshard2 [junit4] 2> 1347001 INFO (Thread-parshard21) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/parshard2/leader after winning as /collections/collection1/leader_elect/parshard2/election/72241468000501763-parshard21-n_0000000000 [junit4] 2> 1347001 INFO (Thread-parshard31) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/parshard3/leader after winning as /collections/collection1/leader_elect/parshard3/election/72241468000501763-parshard31-n_0000000000 [junit4] 2> 1347004 INFO (Thread-parshard11) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/parshard1/leader after winning as /collections/collection1/leader_elect/parshard1/election/72241468000501763-parshard11-n_0000000000 [junit4] 2> 1347083 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.LeaderElectionTest First replicas brought up and registered [junit4] 2> 1347084 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1347088 INFO (zkConnectionManagerCallback-7674-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1347088 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1347090 INFO (Thread-parshard12) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/parshard1 [junit4] 2> 1347092 INFO (Thread-parshard22) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/parshard2 [junit4] 2> 1347092 INFO (Thread-parshard32) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/parshard3 [junit4] 2> 1347195 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.LeaderElectionTest Second replicas brought up and registered [junit4] 2> 1347198 WARN (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59620)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b7e390003. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390003, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390003, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1347207 INFO (zkCallback-7673-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/parshard3/leader after winning as /collections/collection1/leader_elect/parshard3/election/72241468000501764-parshard32-n_0000000001 [junit4] 2> 1347208 INFO (zkCallback-7673-thread-2) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/parshard2/leader after winning as /collections/collection1/leader_elect/parshard2/election/72241468000501764-parshard22-n_0000000001 [junit4] 2> 1347211 INFO (zkCallback-7673-thread-3) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/parshard1/leader after winning as /collections/collection1/leader_elect/parshard1/election/72241468000501764-parshard12-n_0000000001 [junit4] 2> 1347213 INFO (zkCallback-7673-thread-2) [ ] o.a.s.c.LeaderElectionTest Sleeping for 20000ms to simulate leadership takeover delay [junit4] 2> 1347215 INFO (zkCallback-7673-thread-1) [ ] o.a.s.c.LeaderElectionTest Sleeping for 20000ms to simulate leadership takeover delay [junit4] 2> 1347216 INFO (zkCallback-7673-thread-3) [ ] o.a.s.c.LeaderElectionTest Sleeping for 20000ms to simulate leadership takeover delay [junit4] 2> 1367240 WARN (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59620)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b7e390004. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390004, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390004, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1367448 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 1367468 WARN (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59620)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b7e390000. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390000, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390000, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1367586 WARN (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59620)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73b7e390001. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390001, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73b7e390001, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1367805 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:59620 [junit4] 2> 1367805 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59620 [junit4] 2> 1367806 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59620 [junit4] 2> 1367806 INFO (TEST-LeaderElectionTest.testParallelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testParallelElection [junit4] 2> 1367910 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCancelElection [junit4] 2> 1367952 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1367953 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 [junit4] 2> 1367953 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1368041 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. [junit4] 2> 1368055 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer start zk server on port: 59693 [junit4] 2> 1368055 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59693 [junit4] 2> 1368055 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59693 [junit4] 2> 1368055 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59693 [junit4] 2> 1368066 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1368073 WARN (NIOWorkerThread-2) [ ] o.a.z.s.NIOServerCnxn Close of session 0x0 [junit4] 2> => java.io.IOException: ZooKeeperServer not running [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.readLength(NIOServerCnxn.java:544) [junit4] 2> java.io.IOException: ZooKeeperServer not running [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.readLength(NIOServerCnxn.java:544) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:332) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1368074 WARN (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59693)) [ ] o.a.z.ClientCnxn Session 0x0 for sever localhost/127.0.0.1:59693, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1370482 INFO (zkConnectionManagerCallback-7678-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1370483 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1370505 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1370518 INFO (zkConnectionManagerCallback-7680-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1370518 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1370519 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1370541 INFO (zkConnectionManagerCallback-7682-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1370542 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1370992 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection2/leaders/slice1 [junit4] 2> 1371102 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection2/leaders/slice1/leader after winning as /collections/collection2/leader_elect/slice1/election/72241469398974466-dummynode1-n_0000000000 [junit4] 2> 1372636 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection2/leaders/slice1 [junit4] 2> 1373773 INFO (zkCallback-7681-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection2/leaders/slice1/leader after winning as /collections/collection2/leader_elect/slice1/election/72241469398974466-dummynode2-n_0000000001 [junit4] 2> 1375578 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 1375695 WARN (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59693)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73bd1940001. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bd1940001, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bd1940001, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1375820 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:59693 [junit4] 2> 1375821 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59693 [junit4] 2> 1375821 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59693 [junit4] 2> 1375836 INFO (TEST-LeaderElectionTest.testCancelElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCancelElection [junit4] 2> 1375855 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBasic [junit4] 2> 1375860 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1375862 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 [junit4] 2> 1375862 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1375870 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. [junit4] 2> 1375985 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer start zk server on port: 59737 [junit4] 2> 1375985 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59737 [junit4] 2> 1375985 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59737 [junit4] 2> 1375985 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59737 [junit4] 2> 1376028 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1376032 WARN (NIOWorkerThread-2) [ ] o.a.z.s.NIOServerCnxn Close of session 0x0 [junit4] 2> => java.io.IOException: ZooKeeperServer not running [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.readLength(NIOServerCnxn.java:544) [junit4] 2> java.io.IOException: ZooKeeperServer not running [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.readLength(NIOServerCnxn.java:544) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:332) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1376033 WARN (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59737)) [ ] o.a.z.ClientCnxn Session 0x0 for sever localhost/127.0.0.1:59737, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1386121 INFO (zkConnectionManagerCallback-7686-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1386122 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1386132 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1386146 INFO (zkConnectionManagerCallback-7688-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1386147 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1386148 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1386161 INFO (zkConnectionManagerCallback-7690-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1386162 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1386178 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2 [junit4] 2> 1386198 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72241469928046594-dummynode1-n_0000000000 [junit4] 2> 1386218 WARN (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59737)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73bf11d0002. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bf11d0002, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bf11d0002, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1386321 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 1386325 WARN (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59737)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73bf11d0000. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bf11d0000, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bf11d0000, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1386443 WARN (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59737)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73bf11d0001. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bf11d0001, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73bf11d0001, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1386609 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:59737 [junit4] 2> 1386609 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59737 [junit4] 2> 1386609 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59737 [junit4] 2> 1386611 INFO (TEST-LeaderElectionTest.testBasic-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBasic [junit4] 2> 1386671 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testElection [junit4] 2> 1386673 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1386677 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 [junit4] 2> 1386677 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1386688 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. [junit4] 2> 1386786 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer start zk server on port: 59769 [junit4] 2> 1386787 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59769 [junit4] 2> 1386787 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59769 [junit4] 2> 1386787 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59769 [junit4] 2> 1386791 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1386796 WARN (NIOWorkerThread-2) [ ] o.a.z.s.NIOServerCnxn Close of session 0x0 [junit4] 2> => java.io.IOException: ZooKeeperServer not running [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.readLength(NIOServerCnxn.java:544) [junit4] 2> java.io.IOException: ZooKeeperServer not running [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.readLength(NIOServerCnxn.java:544) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:332) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] [junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?] [junit4] 2> 1386798 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn Session 0x0 for sever localhost/127.0.0.1:59769, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1390033 INFO (zkConnectionManagerCallback-7694-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390034 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390063 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390076 INFO (zkConnectionManagerCallback-7696-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390077 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390078 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390083 INFO (zkConnectionManagerCallback-7698-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390084 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390093 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390142 INFO (zkConnectionManagerCallback-7702-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390142 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390146 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390153 INFO (zkConnectionManagerCallback-7706-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390153 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390157 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390167 INFO (zkConnectionManagerCallback-7710-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390167 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390172 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390179 INFO (zkConnectionManagerCallback-7714-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390180 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390190 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390203 INFO (zkConnectionManagerCallback-7718-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390203 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390210 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390227 INFO (zkConnectionManagerCallback-7722-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390228 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390232 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390241 INFO (zkConnectionManagerCallback-7726-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390241 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390244 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390261 INFO (zkConnectionManagerCallback-7730-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390261 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390272 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390297 INFO (zkConnectionManagerCallback-7734-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390299 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390310 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390354 INFO (zkConnectionManagerCallback-7738-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390354 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390358 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390372 INFO (zkConnectionManagerCallback-7742-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390374 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390385 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390412 INFO (zkConnectionManagerCallback-7746-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390412 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390415 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390507 INFO (zkConnectionManagerCallback-7750-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390507 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390511 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390530 INFO (zkConnectionManagerCallback-7754-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390530 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390534 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1390540 INFO (zkConnectionManagerCallback-7758-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1390540 INFO (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1390544 INFO (Thread-shard11) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390545 INFO (Thread-shard10) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390545 INFO (Thread-shard12) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390546 INFO (Thread-shard13) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390550 INFO (Thread-shard14) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390551 INFO (Thread-shard15) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390552 INFO (Thread-shard17) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390553 INFO (Thread-shard16) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390553 INFO (Thread-shard18) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390554 INFO (Thread-shard19) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390557 INFO (Thread-shard110) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390582 INFO (Thread-shard112) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390583 INFO (Thread-shard111) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390583 INFO (Thread-shard113) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390587 INFO (Thread-shard114) [ ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 1390627 INFO (Thread-shard18) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241470622269451-shard18-n_0000000000 [junit4] 2> 1390697 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73c1a7e000b. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e000b, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e000b, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1390699 INFO (zkCallback-7713-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241470622269446-shard13-n_0000000001 [junit4] 2> 1390936 INFO (zkCallback-7701-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241470622269443-shard10-n_0000000002 [junit4] 2> 1391047 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73c1a7e0009. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e0009, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e0009, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1391258 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73c1a7e0003. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e0003, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e0003, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1391259 INFO (zkCallback-7709-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241470622269445-shard12-n_0000000006 [junit4] 2> 1391366 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73c1a7e0005. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e0005, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e0005, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1391368 INFO (zkCallback-7737-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241470622269452-shard19-n_0000000007 [junit4] 2> 1391470 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100a73c1a7e000c. [junit4] 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e000c, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) [junit4] 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100a73c1a7e000c, likely server has closed socket [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2] [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2] [junit4] 2> 1391476 INFO (zkCallback-7729-thread-1) [ ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72241470622269450-shard17-n_0000000008 [junit4] 2> 1391587 WARN (TEST-LeaderElectionTest.testElection-seed#[12172D7A441F7E52]-SendThread(127.0.0.1:59769)) [ ] o.a.z.ClientCnxn An exception was [...truncated too long message...] [email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [junit4] 2> at [email protected]/java.lang.Thread.run(Thread.java:832) [junit4] 2> 17) Thread[id=9464, name=Connector-Scheduler-6fcaa565-1, state=WAITING, group=TGRP-TestJsonFacets] [junit4] 2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method) [junit4] 2> at [email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) [junit4] 2> at [email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:505) [junit4] 2> at [email protected]/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3137) [junit4] 2> at [email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1614) [junit4] 2> at [email protected]/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1170) [junit4] 2> at [email protected]/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) [junit4] 2> at [email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1056) [junit4] 2> at [email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1116) [junit4] 2> at [email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [junit4] 2> at [email protected]/java.lang.Thread.run(Thread.java:832) [junit4] 2> 18) Thread[id=9442, name=qtp1140208751-9442, state=TIMED_WAITING, group=TGRP-TestJsonFacets] [junit4] 2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method) [junit4] 2> at [email protected]/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) [junit4] 2> at [email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1661) [junit4] 2> at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) [junit4] 2> at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:875) [junit4] 2> at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:925) [junit4] 2> at [email protected]/java.lang.Thread.run(Thread.java:832) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene87): {super_s=FST50, cat_sds=PostingsFormat(name=Asserting), where_s_multi_not_uninvert=PostingsFormat(name=Asserting), where_sds=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), book_id_s=PostingsFormat(name=Asserting), super_sds=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), cat_ss=PostingsFormat(name=Asserting), sparse_ss=FST50, book_s=PostingsFormat(name=Asserting), super_sd=PostingsFormat(name=Asserting), where_s=FST50, where_s_multi_not_uninvert_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), sparse_sd=PostingsFormat(name=LuceneFixedGap), id=FST50, multi_ss=PostingsFormat(name=LuceneFixedGap), type_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), where_s_single_not_uninvert_dv=FST50, sparse_sds=FST50, f_sd=PostingsFormat(name=LuceneFixedGap), page_s=FST50, 1_s=PostingsFormat(name=Asserting), 2_s=PostingsFormat(name=LuceneFixedGap), cat_sd=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), 3_s=FST50, super_ss=PostingsFormat(name=LuceneFixedGap), _root_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), val_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), multi_sds=PostingsFormat(name=LuceneFixedGap), cat_s=PostingsFormat(name=LuceneFixedGap), v_t=FST50, where_sd=PostingsFormat(name=Asserting), foo_s=PostingsFormat(name=LuceneFixedGap), make_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), x_t=PostingsFormat(name=Asserting), y_s=PostingsFormat(name=Asserting), z_t=FST50, where_s_single_not_uninvert=PostingsFormat(name=LuceneFixedGap), sparse_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), where_ss=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), model_s=PostingsFormat(name=Asserting)}, docValues:{num_dd=DocValuesFormat(name=Direct), num_lds=DocValuesFormat(name=Lucene80), date_dt=DocValuesFormat(name=Direct), cat_sds=DocValuesFormat(name=Direct), sparse_num_f=DocValuesFormat(name=Asserting), where_sds=DocValuesFormat(name=Lucene80), sparse_num_d=DocValuesFormat(name=Lucene80), Z_num_id=DocValuesFormat(name=Direct), z_ids=DocValuesFormat(name=Lucene80), super_sds=DocValuesFormat(name=Lucene80), Z_long_ld=DocValuesFormat(name=Lucene80), f_ids=DocValuesFormat(name=Lucene80), sparse_num_dd=DocValuesFormat(name=Asserting), super_sd=DocValuesFormat(name=Direct), where_s_multi_not_uninvert_dv=DocValuesFormat(name=Lucene80), Z_num_i=DocValuesFormat(name=Lucene80), Z_long_l=DocValuesFormat(name=Lucene80), sparse_sd=DocValuesFormat(name=Asserting), num_is=DocValuesFormat(name=Lucene80), Z_num_l=DocValuesFormat(name=Asserting), where_s_single_not_uninvert_dv=DocValuesFormat(name=Lucene80), date_dtd=DocValuesFormat(name=Lucene80), sparse_sds=DocValuesFormat(name=Lucene80), f_sd=DocValuesFormat(name=Asserting), cat_sd=DocValuesFormat(name=Lucene80), multi_sds=DocValuesFormat(name=Asserting), num_f=DocValuesFormat(name=Direct), where_sd=DocValuesFormat(name=Direct), num_id=DocValuesFormat(name=Asserting), bar_i=DocValuesFormat(name=Direct), num_d=DocValuesFormat(name=Lucene80), num_ds=DocValuesFormat(name=Asserting), date_dtds=DocValuesFormat(name=Asserting), num_i=DocValuesFormat(name=Lucene80), _version_=DocValuesFormat(name=Lucene80), cost_f=DocValuesFormat(name=Asserting), x_ids=DocValuesFormat(name=Direct), num_l=DocValuesFormat(name=Lucene80), num_ls=DocValuesFormat(name=Asserting), num_dds=DocValuesFormat(name=Lucene80), num_fds=DocValuesFormat(name=Asserting), num_fs=DocValuesFormat(name=Lucene80), num_ids=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=436, maxMBSortInHeap=6.1664333256921005, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=ar-DJ, timezone=America/Jujuy [junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1 (64-bit)/cpus=6,threads=22,free=186636272,total=433180672 [junit4] 2> NOTE: All tests run in this JVM: [SuggesterFSTTest, TestInPlaceUpdateWithRouteField, ResponseBuilderTest, BasicAuthIntegrationTest, HDFSCollectionsAPITest, TestXmlQParser, TestLegacyTerms, TestFacetMethods, TestHalfAndHalfDocValues, HdfsNNFailoverTest, StatsComponentTest, AutoScalingHandlerTest, TestSolrCoreParser, TestRecoveryHdfs, BadComponentTest, TestSimUtils, TestAuthenticationFramework, OutOfBoxZkACLAndCredentialsProvidersTest, TestSchemaNameResource, TestLogWatcher, TestCloudJSONFacetJoinDomain, TestBooleanSimilarityFactory, TestStandardQParsers, MaxScoreCollectorTest, SplitHandlerTest, ChaosMonkeyNothingIsSafeTest, RollingRestartTest, TestDistributedGrouping, CategoryRoutedAliasUpdateProcessorTest, TestUniqueKeyFieldResource, TestNestedUpdateProcessor, TestObjectReleaseTracker, ConjunctionSolrSpellCheckerTest, MaxSizeAutoCommitTest, TestQueryingOnDownCollection, TestComplexPhraseQParserPlugin, HttpPartitionWithTlogReplicasTest, TestSystemIdResolver, ForceLeaderTest, TestWordDelimiterFilterFactory, FacetPivotSmallTest, DOMUtilTest, SpatialFilterTest, SolrIndexMetricsTest, TestCloudPivotFacet, TestQuerySenderNoQuery, SolrCloudExampleTest, AutoscalingHistoryHandlerTest, AnalyticsQueryTest, TestJmxIntegration, TestSimpleQParserPlugin, TestJsonFacets] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestJsonFacets -Dtests.seed=12172D7A441F7E52 -Dtests.slow=true -Dtests.locale=ar-DJ -Dtests.timezone=America/Jujuy -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 0.00s J4 | TestJsonFacets (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). [junit4] > at __randomizedtesting.SeedInfo.seed([12172D7A441F7E52]:0) [junit4] Completed [882/921 (2!)] on J4 in 7213.01s, 162 tests, 1 error <<< FAILURES! [...truncated 44986 lines...] [repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1602/consoleText [repro] Revision: 97551dd644b94390f696c907d94ed602657844db [repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" [repro] Repro line: ant test -Dtestcase=LeaderElectionTest -Dtests.seed=12172D7A441F7E52 -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=America/Argentina/Salta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [repro] Repro line: ant test -Dtestcase=TestJsonFacets -Dtests.seed=12172D7A441F7E52 -Dtests.slow=true -Dtests.locale=ar-DJ -Dtests.timezone=America/Jujuy -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [repro] JUnit rest result XML files will be moved to: ./repro-reports [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] TestJsonFacets [repro] LeaderElectionTest [repro] ant compile-test [...truncated 3455 lines...] [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestJsonFacets|*.LeaderElectionTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=12172D7A441F7E52 -Dtests.slow=true -Dtests.locale=ar-DJ -Dtests.timezone=America/Jujuy -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [...truncated 926 lines...] [repro] Failures w/original seeds: [repro] 0/5 failed: org.apache.solr.cloud.LeaderElectionTest [repro] 0/5 failed: org.apache.solr.search.facet.TestJsonFacets [repro] Exiting with code 0 [...truncated 94 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
