Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1265/

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.overseer.ZkStateWriterTest:     1) Thread[id=5830, 
name=watches-704-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]   
      at sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   1) Thread[id=5830, name=watches-704-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([DEE4D3305641E362]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=5830, name=watches-704-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]         at sun.misc.Unsafe.park(Native Method)    
     at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)  
       at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=5830, name=watches-704-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([DEE4D3305641E362]:0)




Build Log:
[...truncated 11105 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateWriterTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateWriterTest_DEE4D3305641E362-001/init-core-data-001
   [junit4]   2> 627825 INFO  
(SUITE-ZkStateWriterTest-seed#[DEE4D3305641E362]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 627832 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Starting testSingleExternalCollection
   [junit4]   2> 627833 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 627840 INFO  (Thread-2221) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 627840 INFO  (Thread-2221) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 627940 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.ZkTestServer start zk server on port:41693
   [junit4]   2> 627940 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 627972 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 627992 INFO  (zkCallback-697-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7504b71e 
name:ZooKeeperConnection Watcher:127.0.0.1:41693 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 627992 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 627993 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 627994 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628028 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628039 INFO  (zkCallback-698-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@19bc505d 
name:ZooKeeperConnection Watcher:127.0.0.1:41693 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628039 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628040 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628040 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 628050 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628075 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628092 INFO  (zkCallback-699-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3a975367 
name:ZooKeeperConnection Watcher:127.0.0.1:41693/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628092 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628092 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628093 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 628094 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 628095 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 628096 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 628096 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 628097 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 628097 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 628098 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 628099 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 628100 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 628102 ERROR 
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$7/666336058@2791189d
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@23ae88b7[Shutting
 down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 0]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 628109 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41693 41693
   [junit4]   2> 628279 INFO  (Thread-2221) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41693 41693
   [junit4]   2> 628280 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[DEE4D3305641E362]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Ending testSingleExternalCollection
   [junit4]   2> 628285 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToStateFormat2
   [junit4]   2> 628285 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 628293 INFO  (Thread-2222) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 628293 INFO  (Thread-2222) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 628400 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.ZkTestServer start zk server on port:41587
   [junit4]   2> 628400 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628408 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628428 INFO  (zkCallback-701-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@41dff25 name:ZooKeeperConnection 
Watcher:127.0.0.1:41587 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 628430 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628430 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628432 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628464 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628476 INFO  (zkCallback-702-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2d6627d9 
name:ZooKeeperConnection Watcher:127.0.0.1:41587 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628476 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628476 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628477 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 628492 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628493 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628516 INFO  (zkCallback-703-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5b9ffd2c 
name:ZooKeeperConnection Watcher:127.0.0.1:41587/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628516 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628517 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628517 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 628518 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 628519 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 628520 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 628520 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 628521 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 628521 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 628522 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 628528 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 628529 INFO  (zkCallback-703-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 628530 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 628531 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c2/state.json
   [junit4]   2> 628541 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c2
   [junit4]   2> 628541 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Adding lazily-loaded reference for collection c2
   [junit4]   2> 628545 INFO  (zkCallback-703-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 628561 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.o.ZkStateWriterTest Cluster state: live 
nodes:[]collections:{c1=LazyCollectionRef(c1), c2=LazyCollectionRef(c2)}
   [junit4]   2> 628600 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
   [junit4]   2> 628624 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/c2/state.json version: 0
   [junit4]   2> 628653 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x155cb7f16aa0002, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 628657 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41587 41587
   [junit4]   2> 628824 INFO  (Thread-2222) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41587 41587
   [junit4]   2> 628827 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[DEE4D3305641E362])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToStateFormat2
   [junit4]   2> 628830 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testSingleLegacyCollection
   [junit4]   2> 628830 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 628832 INFO  (Thread-2223) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 628832 INFO  (Thread-2223) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 628932 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.ZkTestServer start zk server on port:39755
   [junit4]   2> 628932 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628948 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628956 INFO  (zkCallback-705-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6ba63b0b 
name:ZooKeeperConnection Watcher:127.0.0.1:39755 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628956 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628957 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628978 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 628986 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 628986 INFO  (zkCallback-706-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2cf3c23b 
name:ZooKeeperConnection Watcher:127.0.0.1:39755 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628986 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 628986 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 628986 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 628996 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 629016 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 629062 INFO  (zkCallback-707-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@263d041f 
name:ZooKeeperConnection Watcher:127.0.0.1:39755/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 629062 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 629063 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 629063 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 629070 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 629071 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 629072 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 629073 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 629073 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 629074 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 629074 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 629075 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 629084 ERROR 
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$7/666336058@3dc7658b
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@78c5fc57[Shutting
 down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 0]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 629084 INFO  (zkCallback-707-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 629084 WARN  (zkCallback-707-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 629087 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39755 39755
   [junit4]   2> 629211 INFO  (Thread-2223) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:39755 39755
   [junit4]   2> 629212 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[DEE4D3305641E362]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testSingleLegacyCollection
   [junit4]   2> 629214 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testExternalModificationToSharedClusterState
   [junit4]   2> 629215 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 629232 INFO  (Thread-2224) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 629232 INFO  (Thread-2224) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 629324 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.ZkTestServer start zk server on port:37807
   [junit4]   2> 629324 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 629351 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 629384 INFO  (zkCallback-709-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@67052c0a 
name:ZooKeeperConnection Watcher:127.0.0.1:37807 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 629384 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 629384 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 629385 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 629397 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 629444 INFO  (zkCallback-710-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@62ecfdd3 
name:ZooKeeperConnection Watcher:127.0.0.1:37807 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 629444 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 629444 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 629445 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 629453 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 629481 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 629492 INFO  (zkCallback-711-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@31150245 
name:ZooKeeperConnection Watcher:127.0.0.1:37807/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 629492 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 629492 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 629499 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 629523 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 629524 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 629525 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 629526 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 629527 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 629530 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 629532 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 629533 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 629534 INFO  (zkCallback-711-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 629534 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 629535 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c1
   [junit4]   2> 629553 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c2
   [junit4]   2> 629553 INFO  (zkCallback-711-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 629554 INFO  (zkCallback-711-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 629555 INFO  (zkCallback-711-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 629561 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37807 37807
   [junit4]   2> 629726 INFO  (Thread-2224) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:37807 37807
   [junit4]   2> 629727 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[DEE4D3305641E362])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending 
testExternalModificationToSharedClusterState
   [junit4]   2> 629729 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testZkStateWriterBatching
   [junit4]   2> 629729 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 629823 INFO  (Thread-2225) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 629823 INFO  (Thread-2225) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 629976 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.ZkTestServer start zk server on port:56307
   [junit4]   2> 629976 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 630004 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 630020 INFO  (zkCallback-713-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@e2375d name:ZooKeeperConnection 
Watcher:127.0.0.1:56307 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 630020 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 630021 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 630022 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 630032 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 630048 INFO  (zkCallback-714-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@206b859d 
name:ZooKeeperConnection Watcher:127.0.0.1:56307 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 630048 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 630049 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 630049 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 630051 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 630075 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 630079 INFO  (zkCallback-715-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5b5dc62a 
name:ZooKeeperConnection Watcher:127.0.0.1:56307/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 630079 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 630079 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 630079 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 630080 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 630081 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 630082 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 630083 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 630083 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 630084 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 630084 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 630085 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 630086 INFO  (zkCallback-715-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 630086 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 630087 INFO  (zkCallback-715-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 630088 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 630089 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56307 56307
   [junit4]   2> 630256 INFO  (Thread-2225) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:56307 56307
   [junit4]   2> 630257 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[DEE4D3305641E362]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testZkStateWriterBatching
   [junit4]   2> 630258 INFO  
(SUITE-ZkStateWriterTest-seed#[DEE4D3305641E362]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jul 08, 2016 5:12:33 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> Jul 08, 2016 5:12:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   [junit4]   2>    1) Thread[id=5830, name=watches-704-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jul 08, 2016 5:12:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=5830, name=watches-704-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2> Jul 08, 2016 5:12:56 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=5830, name=watches-704-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {}, 
docValues:{}, maxPointsInLeafNode=753, maxMBSortInHeap=7.254856183924918, 
sim=ClassicSimilarity, locale=et, timezone=Asia/Choibalsan
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=184324008,total=530579456
   [junit4]   2> NOTE: All tests run in this JVM: [HLLUtilTest, 
TestSchemaSimilarityResource, SolrRequestParserTest, MultiThreadedOCPTest, 
TestOmitPositions, TestNumericTerms32, StressHdfsTest, UUIDFieldTest, 
AlternateDirectoryTest, TestAnalyzedSuggestions, TestHighlightDedupGrouping, 
CdcrVersionReplicationTest, TestMergePolicyConfig, TestSolrQueryResponse, 
TestConfigOverlay, UUIDUpdateProcessorFallbackTest, 
TestTolerantUpdateProcessorRandomCloud, TestExpandComponent, 
TestCloudSchemaless, EchoParamsTest, TestFieldCacheVsDocValues, 
HdfsNNFailoverTest, OverseerCollectionConfigSetProcessorTest, BasicZkTest, 
TestRemoteStreaming, TestDFISimilarityFactory, IndexSchemaRuntimeFieldTest, 
DocumentAnalysisRequestHandlerTest, CloudExitableDirectoryReaderTest, 
TestCSVLoader, OutputWriterTest, HdfsChaosMonkeyNothingIsSafeTest, 
TestHashQParserPlugin, JSONWriterTest, ResponseLogComponentTest, 
ForceLeaderTest, TestShortCircuitedRequests, PreAnalyzedUpdateProcessorTest, 
RulesTest, XsltUpdateRequestHandlerTest, CursorMarkTest, 
CoreAdminCreateDiscoverTest, PolyFieldTest, ZkStateWriterTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateWriterTest 
-Dtests.seed=DEE4D3305641E362 -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.locale=et -Dtests.timezone=Asia/Choibalsan -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | ZkStateWriterTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   [junit4]    >    1) Thread[id=5830, name=watches-704-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([DEE4D3305641E362]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=5830, name=watches-704-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([DEE4D3305641E362]:0)
   [junit4] Completed [176/620 (1!)] on J0 in 25.83s, 5 tests, 2 errors <<< 
FAILURES!

[...truncated 1434 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The 
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The 
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The 
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:530:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1443:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:984:
 There were test failures: 620 suites (10 ignored), 2635 tests, 2 suite-level 
errors, 1579 ignored (67 assumptions) [seed: DEE4D3305641E362]

Total time: 54 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to