Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Solaris/353/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.common.cloud.TestCollectionStateWatchers

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.common.cloud.TestCollectionStateWatchers:     1) 
Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.common.cloud.TestCollectionStateWatchers: 
   1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([353AEFC0C4D4966E]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.common.cloud.TestCollectionStateWatchers

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.interrupt0(Native Method)         at 
java.lang.Thread.interrupt(Thread.java:923)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.interrupt0(Native Method)
        at java.lang.Thread.interrupt(Thread.java:923)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([353AEFC0C4D4966E]:0)




Build Log:
[...truncated 13248 lines...]
   [junit4] Suite: org.apache.solr.common.cloud.TestCollectionStateWatchers
   [junit4]   2> Creating dataDir: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/init-core-data-001
   [junit4]   2> 180034 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 180034 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 180034 INFO  (Thread-687) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 180034 INFO  (Thread-687) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 180135 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:64672
   [junit4]   2> 180135 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180135 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180153 INFO  (zkCallback-236-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ccf3c89 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180154 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180154 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180154 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 180162 INFO  (jetty-launcher-235-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 180162 INFO  (jetty-launcher-235-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 180164 INFO  (jetty-launcher-235-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 180167 INFO  (jetty-launcher-235-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1b1d4e6d{/solr,null,AVAILABLE}
   [junit4]   2> 180168 INFO  (jetty-launcher-235-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 180169 INFO  (jetty-launcher-235-thread-1) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@6c4dad8f{HTTP/1.1,[http/1.1]}{127.0.0.1:36065}
   [junit4]   2> 180169 INFO  (jetty-launcher-235-thread-1) [    ] 
o.e.j.s.Server Started @183727ms
   [junit4]   2> 180169 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36065}
   [junit4]   2> 180170 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 180170 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node1'
   [junit4]   2> 180170 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 180170 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 180170 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180170 INFO  (jetty-launcher-235-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@728bb04a{/solr,null,AVAILABLE}
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@7dfc9176{HTTP/1.1,[http/1.1]}{127.0.0.1:35680}
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.e.j.s.Server Started @183729ms
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=35680}
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node4'
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 180171 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180172 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180288 INFO  (jetty-launcher-235-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2508424e{/solr,null,AVAILABLE}
   [junit4]   2> 180288 INFO  (jetty-launcher-235-thread-4) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@290b3aea{HTTP/1.1,[http/1.1]}{127.0.0.1:54928}
   [junit4]   2> 180288 INFO  (jetty-launcher-235-thread-4) [    ] 
o.e.j.s.Server Started @183846ms
   [junit4]   2> 180288 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=54928}
   [junit4]   2> 180288 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 180289 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node2'
   [junit4]   2> 180289 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 180289 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 180289 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180290 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180296 INFO  (jetty-launcher-235-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@46bbf1e7{/solr,null,AVAILABLE}
   [junit4]   2> 180296 INFO  (jetty-launcher-235-thread-3) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@7a27f997{HTTP/1.1,[http/1.1]}{127.0.0.1:52753}
   [junit4]   2> 180296 INFO  (jetty-launcher-235-thread-3) [    ] 
o.e.j.s.Server Started @183855ms
   [junit4]   2> 180297 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=52753}
   [junit4]   2> 180297 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 180297 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3'
   [junit4]   2> 180297 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 180297 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 180297 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180298 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180303 INFO  (zkCallback-239-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6501224b 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180304 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180304 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180309 INFO  (zkCallback-238-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@76f16696 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180309 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180309 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180310 INFO  (zkCallback-237-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@62896731 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180310 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180310 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180311 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 180312 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 180312 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 180313 INFO  (zkCallback-240-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6def0dbd 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180315 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180316 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node4/.
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.CoreContainer New CoreContainer 892687046
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node4]
   [junit4]   2> 180321 WARN  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node4/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node4/lib
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node1/.
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1131346976
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node1]
   [junit4]   2> 180321 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 180321 WARN  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node1/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node1/lib
   [junit4]   2> 180322 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64672/solr
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 180325 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64672/solr
   [junit4]   2> 180326 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 180326 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180326 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180326 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180331 INFO  (zkCallback-246-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1d041b63 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180332 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180333 INFO  (jetty-launcher-235-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180338 INFO  (zkCallback-245-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1216b91a 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180338 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180339 INFO  (jetty-launcher-235-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180339 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 180340 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x156bff0515f0005, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 180344 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$108/712839636@6792af7d
   [junit4]   2> 180344 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node2/.
   [junit4]   2> 180344 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.CoreContainer New CoreContainer 993890630
   [junit4]   2> 180344 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node2]
   [junit4]   2> 180345 WARN  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node2/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node2/lib
   [junit4]   2> 180345 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 180345 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 180346 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 180346 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 180346 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 180347 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64672/solr
   [junit4]   2> 180347 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 180347 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180348 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180401 INFO  
(zkCallback-247-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2979a793 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180402 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x156bff0515f0004, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 180402 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 180403 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/.
   [junit4]   2> 180403 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.CoreContainer New CoreContainer 802773967
   [junit4]   2> 180403 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3]
   [junit4]   2> 180403 INFO  (zkCallback-250-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@33a6a284 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180403 WARN  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/lib
   [junit4]   2> 180403 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180403 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 180403 INFO  (jetty-launcher-235-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180404 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 180405 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 180405 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 180405 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64672/solr
   [junit4]   2> 180405 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 180405 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180406 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180444 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 180450 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$108/712839636@1b895c20
   [junit4]   2> 180452 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 180452 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 180453 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$108/712839636@cbbbb0e
   [junit4]   2> 180454 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 180454 INFO  (zkCallback-253-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ab9a0b6 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180455 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180456 INFO  (jetty-launcher-235-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180458 INFO  
(zkCallback-255-thread-1-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3ca3f748 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180459 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 180462 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$108/712839636@58b1d0f4
   [junit4]   2> 180462 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 180464 INFO  
(zkCallback-254-thread-1-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@675e751e 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180465 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 180465 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 180468 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 180471 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 180475 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 180477 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 180479 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 180481 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 180483 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 180485 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 180486 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 180487 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 180490 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 180492 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 180493 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 180494 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96475480913281031-127.0.0.1:35680_solr-n_0000000000
   [junit4]   2> 180494 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:35680_solr
   [junit4]   2> 180495 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 180496 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer Overseer 
(id=96475480913281031-127.0.0.1:35680_solr-n_0000000000) starting
   [junit4]   2> 180499 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 180505 INFO  
(zkCallback-256-thread-1-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2c1c444b 
name:ZooKeeperConnection Watcher:127.0.0.1:64672/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180505 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 180524 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 180526 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 180527 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 180535 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 180536 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 180537 INFO  
(OverseerCollectionConfigSetProcessor-96475480913281031-127.0.0.1:35680_solr-n_0000000000)
 [n:127.0.0.1:35680_solr    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 180538 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 180538 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 180538 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 180539 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 180540 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96475480913281034-127.0.0.1:54928_solr-n_0000000001
   [junit4]   2> 180541 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 180541 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:35680_solr
   [junit4]   2> 180541 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:35680_solr
   [junit4]   2> 180542 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96475480913281031-127.0.0.1:35680_solr-n_0000000000 to 
know if I could be the leader
   [junit4]   2> 180542 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 180543 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:54928_solr
   [junit4]   2> 180543 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:54928_solr
   [junit4]   2> 180545 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 180547 INFO  
(zkCallback-247-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180547 INFO  
(zkCallback-255-thread-1-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180547 INFO  
(zkCallback-256-thread-1-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180548 INFO  
(zkCallback-254-thread-1-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180555 INFO  
(zkCallback-256-thread-2-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180555 INFO  
(zkCallback-255-thread-2-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180556 INFO  
(zkCallback-247-thread-2-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180565 INFO  
(zkCallback-247-thread-2-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 180571 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 180572 INFO  
(zkCallback-254-thread-2-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 180572 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96475480913281036-127.0.0.1:52753_solr-n_0000000002
   [junit4]   2> 180572 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 180573 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96475480913281035-127.0.0.1:36065_solr-n_0000000003
   [junit4]   2> 180573 INFO  
(zkCallback-254-thread-2-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 180573 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96475480913281034-127.0.0.1:54928_solr-n_0000000001 to 
know if I could be the leader
   [junit4]   2> 180574 INFO  
(zkCallback-255-thread-1-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 180574 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:52753_solr as DOWN
   [junit4]   2> 180574 INFO  
(zkCallback-256-thread-1-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 180576 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96475480913281036-127.0.0.1:52753_solr-n_0000000002 to 
know if I could be the leader
   [junit4]   2> 180576 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:36065_solr as DOWN
   [junit4]   2> 180584 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:52753_solr
   [junit4]   2> 180584 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:52753_solr
   [junit4]   2> 180590 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36065_solr
   [junit4]   2> 180590 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:36065_solr
   [junit4]   2> 180590 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (2)
   [junit4]   2> 180603 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 180603 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 180605 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node4/.
   [junit4]   2> 180605 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 180607 INFO  
(zkCallback-255-thread-2-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 180608 INFO  
(zkCallback-255-thread-2-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (4)
   [junit4]   2> 180617 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 180617 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 180618 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node2/.
   [junit4]   2> 180618 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 180627 INFO  
(zkCallback-254-thread-1-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 180632 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 180632 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 180633 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/.
   [junit4]   2> 180633 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 180634 INFO  
(zkCallback-256-thread-2-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 180635 INFO  
(zkCallback-247-thread-2-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 180635 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1
   [junit4]   2> 180635 INFO  (jetty-launcher-235-thread-2) 
[n:127.0.0.1:35680_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 180636 INFO  
(zkCallback-256-thread-2-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (4)
   [junit4]   2> 180636 INFO  
(zkCallback-254-thread-1-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (4)
   [junit4]   2> 180637 INFO  
(zkCallback-247-thread-2-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (4)
   [junit4]   2> 180637 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1
   [junit4]   2> 180637 INFO  (jetty-launcher-235-thread-3) 
[n:127.0.0.1:52753_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 180639 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1
   [junit4]   2> 180639 INFO  (jetty-launcher-235-thread-4) 
[n:127.0.0.1:54928_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 180639 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:52753_solr"} current state version: 0
   [junit4]   2> 180639 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:52753_solr
   [junit4]   2> 180642 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:36065_solr"} current state version: 0
   [junit4]   2> 180642 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:36065_solr
   [junit4]   2> 180676 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 180676 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 180678 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node1/.
   [junit4]   2> 180678 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 180680 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1
   [junit4]   2> 180680 INFO  (jetty-launcher-235-thread-1) 
[n:127.0.0.1:36065_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 180680 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180680 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180684 INFO  (zkCallback-261-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2f8af23d 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180684 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180684 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180689 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180689 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180695 INFO  (zkCallback-264-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@263cd7b name:ZooKeeperConnection 
Watcher:127.0.0.1:64672/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 180695 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180695 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180695 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 180698 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 180699 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 180719 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/schema.xml
   [junit4]   2> 180724 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/schema-replication1.xml
   [junit4]   2> 180727 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/schema-sql.xml
   [junit4]   2> 180730 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-sql.xml
   [junit4]   2> 180734 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-managed-schema.xml
   [junit4]   2> 180739 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig.xml
   [junit4]   2> 180742 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-slave1.xml
   [junit4]   2> 180867 INFO  
(TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[353AEFC0C4D4966E])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testStateWatcherChecksCurrentStateOnRegister
   [junit4]   2> 180867 INFO  
(TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[353AEFC0C4D4966E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 180867 INFO  
(TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[353AEFC0C4D4966E])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 180886 INFO  (zkCallback-265-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@224acdd0 
name:ZooKeeperConnection Watcher:127.0.0.1:64672 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 180887 INFO  
(TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[353AEFC0C4D4966E])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 180887 INFO  
(TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[353AEFC0C4D4966E])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 180897 INFO  (qtp313799178-1797) [n:127.0.0.1:36065_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
async=2607bd2a-8354-40a1-86aa-4aaa136e4a95&replicationFactor=1&collection.configName=config&name=currentstate&action=CREATE&numShards=1&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 180899 INFO  (qtp313799178-1797) [n:127.0.0.1:36065_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={async=2607bd2a-8354-40a1-86aa-4aaa136e4a95&replicationFactor=1&collection.configName=config&name=currentstate&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=2
   [junit4]   2> 180901 INFO  
(OverseerCollectionConfigSetProcessor-96475480913281031-127.0.0.1:35680_solr-n_0000000000)
 [n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running/mn-2607bd2a-8354-40a1-86aa-4aaa136e4a95
   [junit4]   2> 180905 INFO  
(OverseerCollectionConfigSetProcessor-96475480913281031-127.0.0.1:35680_solr-n_0000000000)
 [n:127.0.0.1:35680_solr    ] o.a.s.c.OverseerTaskProcessor Overseer Collection 
Message Handler: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>   "name":"currentstate",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"config",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "async":"2607bd2a-8354-40a1-86aa-4aaa136e4a95",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 180906 INFO  (qtp313799178-1809) [n:127.0.0.1:36065_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with 
params 
requestid=2607bd2a-8354-40a1-86aa-4aaa136e4a95&action=REQUESTSTATUS&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 180908 INFO  (qtp313799178-1809) [n:127.0.0.1:36065_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={requestid=2607bd2a-8354-40a1-86aa-4aaa136e4a95&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 180909 INFO  
(OverseerThreadFactory-956-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.OverseerCollectionMessageHandler 
OverseerCollectionMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"currentstate",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"config",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "async":"2607bd2a-8354-40a1-86aa-4aaa136e4a95",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 180909 INFO  
(OverseerThreadFactory-956-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
currentstate
   [junit4]   2> 180909 INFO  
(OverseerThreadFactory-956-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating 
collections conf node /collections/currentstate 
   [junit4]   2> 180909 INFO  
(OverseerThreadFactory-956-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/collections/currentstate
   [junit4]   2> 180913 INFO  
(zkCallback-247-thread-2-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.c.ZkStateReader A collections change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], 
has occurred - updating...
   [junit4]   2> 180914 INFO  
(zkCallback-256-thread-2-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader A collections change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], 
has occurred - updating...
   [junit4]   2> 180914 INFO  
(zkCallback-255-thread-2-processing-n:127.0.0.1:36065_solr) 
[n:127.0.0.1:36065_solr    ] o.a.s.c.c.ZkStateReader A collections change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], 
has occurred - updating...
   [junit4]   2> 180914 INFO  
(zkCallback-254-thread-1-processing-n:127.0.0.1:54928_solr) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.c.ZkStateReader A collections change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], 
has occurred - updating...
   [junit4]   2> 180915 INFO  (zkCallback-264-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 180917 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "name":"currentstate",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"config",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "async":"2607bd2a-8354-40a1-86aa-4aaa136e4a95",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 180917 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: currentstate
   [junit4]   2> 180918 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/currentstate/state.json
   [junit4]   2> 181023 INFO  
(OverseerThreadFactory-956-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CreateCollectionCmd Creating SolrCores for 
new collection currentstate, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 181023 INFO  
(OverseerThreadFactory-956-thread-1-processing-n:127.0.0.1:35680_solr) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.CreateCollectionCmd Creating core 
currentstate_shard1_replica1 as part of shard shard1 of collection currentstate 
on 127.0.0.1:52753_solr
   [junit4]   2> 181037 INFO  (qtp404786432-1831) [n:127.0.0.1:52753_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={async=2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981&qt=/admin/cores&collection.configName=config&name=currentstate_shard1_replica1&action=CREATE&numShards=1&collection=currentstate&shard=shard1&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 181038 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr    ] o.a.s.h.a.CoreAdminOperation core create command 
async=2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981&qt=/admin/cores&collection.configName=config&name=currentstate_shard1_replica1&action=CREATE&numShards=1&collection=currentstate&shard=shard1&wt=javabin&version=2
   [junit4]   2> 181038 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{name=currentstate_shard1_replica1, collection.configName=config, 
config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, 
configSetProperties=configsetprops.json, collection=currentstate, numShards=1, 
dataDir=data/, shard=shard1}
   [junit4]   2> 181039 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 181040 INFO  (qtp404786432-1834) [n:127.0.0.1:52753_solr    ] 
o.a.s.h.a.CoreAdminOperation Checking request status for : 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981
   [junit4]   2> 181042 INFO  (qtp404786432-1834) [n:127.0.0.1:52753_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=1
   [junit4]   2> 181042 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ZkController Registering watch for 
collection currentstate
   [junit4]   2> 181043 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.c.ZkStateReader Add data for 
[currentstate] ver [0]
   [junit4]   2> 181043 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 181044 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"currentstate_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:52753/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:52753_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"currentstate",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 181044 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"currentstate_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:52753/solr";,
   [junit4]   2>   "node_name":"127.0.0.1:52753_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"currentstate",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 181149 INFO  
(OverseerStateUpdate-96475480913281031-127.0.0.1:35680_solr-n_0000000000) 
[n:127.0.0.1:35680_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/currentstate/state.json version: 0
   [junit4]   2> 181150 INFO  
(zkCallback-256-thread-2-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/currentstate/state.json] for collection [currentstate] has 
occurred - updating... (live nodes size: [4])
   [junit4]   2> 181151 INFO  
(zkCallback-256-thread-2-processing-n:127.0.0.1:52753_solr) 
[n:127.0.0.1:52753_solr    ] o.a.s.c.c.ZkStateReader Updating data for 
[currentstate] from [0] to [1]
   [junit4]   2> 181913 INFO  (qtp313799178-1810) [n:127.0.0.1:36065_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with 
params 
requestid=2607bd2a-8354-40a1-86aa-4aaa136e4a95&action=REQUESTSTATUS&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 181917 INFO  (qtp313799178-1810) [n:127.0.0.1:36065_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={requestid=2607bd2a-8354-40a1-86aa-4aaa136e4a95&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=3
   [junit4]   2> 182044 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ZkController waiting to find shard id 
in clusterstate for currentstate_shard1_replica1
   [junit4]   2> 182044 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ZkController Check for collection 
zkNode:currentstate
   [junit4]   2> 182045 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 182045 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config 
from: [/collections/currentstate]
   [junit4]   2> 182046 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.c.ZkStateReader 
path=[/collections/currentstate] [configName]=[config] specified config exists 
in ZooKeeper
   [junit4]   2> 182046 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.SolrResourceLoader new 
SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/currentstate_shard1_replica1'
   [junit4]   2> 182047 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.SolrResourceLoader JNDI not configured 
for solr (NoInitialContextEx)
   [junit4]   2> 182047 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.SolrResourceLoader solr home defaulted 
to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 182047 INFO  (qtp404786432-1832) [n:127.0.0.1:52753_solr    ] 
o.a.s.h.a.CoreAdminOperation Checking request status for : 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981
   [junit4]   2> 182047 INFO  (qtp404786432-1832) [n:127.0.0.1:52753_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores 
params={qt=/admin/cores&requestid=2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981&action=REQUESTSTATUS&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 182049 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.Config loaded config solrconfig.xml 
with version 0 
   [junit4]   2> 182054 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.SolrConfig current version of 
requestparams : -1
   [junit4]   2> 182056 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 
6.3.0
   [junit4]   2> 182073 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 182081 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.s.IndexSchema 
[currentstate_shard1_replica1] Schema name=test
   [junit4]   2> 182160 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.s.IndexSchema default search field in 
schema is text
   [junit4]   2> 182160 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 182161 WARN  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not 
multivalued and destination for multiple copyFields (2)
   [junit4]   2> 182161 WARN  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.s.IndexSchema Field text is not 
multivalued and destination for multiple copyFields (3)
   [junit4]   2> 182167 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.ConfigSetProperties Did not find 
ConfigSet properties, assuming default properties: Can't find resource 
'configsetprops.json' in classpath or '/configs/config', 
cwd=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1
   [junit4]   2> 182167 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1  
x:currentstate_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 
'currentstate_shard1_replica1' using configuration from collection currentstate
   [junit4]   2> 182167 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 182167 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore 
[[currentstate_shard1_replica1] ] Opening new SolrCore at 
[/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/currentstate_shard1_replica1],
 
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/]
   [junit4]   2> 182167 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore JMX monitoring not detected 
for core: currentstate_shard1_replica1
   [junit4]   2> 182168 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new 
directory for 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/snapshot_metadata
   [junit4]   2> 182168 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.s.SolrSnapshotMetaDataManager Loading 
from snapshot metadata file...
   [junit4]   2> 182168 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new 
directory for 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data
   [junit4]   2> 182168 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore New index directory detected: 
old=null 
new=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/index/
   [junit4]   2> 182169 WARN  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore [currentstate_shard1_replica1] 
Solr index directory 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 182169 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new 
directory for 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/index
   [junit4]   2> 182170 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@7aa31293 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f2d696),segFN=segments_1,generation=1}
   [junit4]   2> 182170 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit 
generation = 1
   [junit4]   2> 182171 INFO  
(OldIndexDirectoryCleanupThreadForCore-currentstate_shard1_replica1) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore Looking for old index 
directories to cleanup for core currentstate_shard1_replica1 in 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/
   [junit4]   2> 182171 WARN  
(OldIndexDirectoryCleanupThreadForCore-currentstate_shard1_replica1) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.DirectoryFactory 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_353AEFC0C4D4966E-001/tempDir-001/node3/./currentstate_shard1_replica1/data/
 does not point to a valid data directory; skipping clean-up of old index 
directories.
   [junit4]   2> 182172 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore no updateRequestProcessorChain 
defined as default, creating implicit default
   [junit4]   2> 182175 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 182176 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 182178 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 182179 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 182181 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
   [junit4]   2> 182181 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrCore Using default statsCache 
cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 182182 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog 
implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 182182 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: 
dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
numVersionBuckets=65536
   [junit4]   2> 182184 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 182184 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 182184 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@7aa31293 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f2d696),segFN=segments_1,generation=1}
   [junit4]   2> 182184 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit 
generation = 1
   [junit4]   2> 182185 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@35e1cf65[currentstate_shard1_replica1] main]
   [junit4]   2> 182185 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config 
from: [/collections/currentstate]
   [junit4]   2> 182187 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.c.c.ZkStateReader 
path=[/collections/currentstate] [configName]=[config] specified config exists 
in ZooKeeper
   [junit4]   2> 182187 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Setting up 
ZooKeeper-based storage for the RestManager with znodeBase: /configs/config
   [junit4]   2> 182187 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured 
ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 182187 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.RestManager Initializing RestManager 
with initArgs: {}
   [junit4]   2> 182187 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 182189 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.ManagedResourceStorage No data found 
for znode /configs/config/_rest_managed.json
   [junit4]   2> 182190 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 182190 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.r.RestManager Initializing 0 registered 
ManagedResources
   [junit4]   2> 182190 INFO  
(parallelCoreAdminExecutor-961-thread-1-processing-n:127.0.0.1:52753_solr 
2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE) 
[n:127.0.0.1:52753_solr c:currentstate s:shard1 r:core_node1 
x:currentstate_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be 
reserved for  10000
   [junit4]   2> 182190 INFO  
(searcherExecutor-965-thread-1-processing-x:currentstate_shard1_replica1 
r:core_node1 2607bd2a-8354-40a1-86aa-4aaa136e4a951712283850895981 CREATE 
n:127.0.0.1:52753_solr s:shard1 c:currentstate) [n:127.0.0.1:52753_solr 
c:currentstate s:shard1 r:core_node1 x:currentstate_shard1_replica1] 
o.a.s.c.SolrCore [currentstate_shard1_replica1] Registered new searcher 
Searcher@35e1cf65[currentstate_shard1_replica1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1

[...truncated too long message...]

eate(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerNodePrioritizer.prioritizeOverseerNodes(OverseerNodePrioritizer.java:60)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:177)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 209704 INFO  
(OverseerCollectionConfigSetProcessor-96475480913281052-127.0.0.1:54928_solr-n_0000000005)
 [n:127.0.0.1:54928_solr    ] o.a.s.c.OverseerTaskProcessor 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:348)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:384)
   [junit4]   2>        at 
org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:190)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 209703 INFO  
(OverseerStateUpdate-96475480913281052-127.0.0.1:54928_solr-n_0000000005) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.Overseer According to ZK I 
(id=96475480913281052-127.0.0.1:54928_solr-n_0000000005) am no longer a leader.
   [junit4]   2> 209704 INFO  
(OverseerCollectionConfigSetProcessor-96475480913281052-127.0.0.1:54928_solr-n_0000000005)
 [n:127.0.0.1:54928_solr    ] o.a.s.c.OverseerTaskProcessor According to ZK I 
(id=96475480913281052-127.0.0.1:54928_solr-n_0000000005) am no longer a leader.
   [junit4]   2> 209704 INFO  
(OverseerStateUpdate-96475480913281052-127.0.0.1:54928_solr-n_0000000005) 
[n:127.0.0.1:54928_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:54928_solr
   [junit4]   2> 209813 INFO  (Thread-687) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:64672 64672
   [junit4]   2> 209815 WARN  (Thread-687) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        8       /solr/aliases.json
   [junit4]   2>        8       /solr/configs/config
   [junit4]   2>        8       /solr/clusterprops.json
   [junit4]   2>        7       /solr/security.json
   [junit4]   2>        3       /solr/collections/stateformat1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        19      /solr/collections/falsepredicate/state.json
   [junit4]   2>        12      /solr/collections/waitforstate/state.json
   [junit4]   2>        8       /solr/clusterstate.json
   [junit4]   2>        8       /solr/collections/testcollection/state.json
   [junit4]   2>        3       /solr/collections/stateformat1/state.json
   [junit4]   2>        2       /solr/collections/currentstate/state.json
   [junit4]   2>        2       /solr/collections/delayed/state.json
   [junit4]   2>        2       /solr/collections/tobedeleted/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/96475480913281036-127.0.0.1:52753_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        59      /solr/overseer/queue
   [junit4]   2>        19      /solr/overseer/queue-work
   [junit4]   2>        8       /solr/collections
   [junit4]   2>        5       /solr/live_nodes
   [junit4]   2>        5       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 209815 INFO  
(SUITE-TestCollectionStateWatchers-seed#[353AEFC0C4D4966E]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Aug 25, 2016 4:24:02 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> Aug 25, 2016 4:24:22 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.common.cloud.TestCollectionStateWatchers: 
   [junit4]   2>    1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Aug 25, 2016 4:24:22 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2> Aug 25, 2016 4:24:25 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Thread.interrupt0(Native Method)
   [junit4]   2>         at java.lang.Thread.interrupt(Thread.java:923)
   [junit4]   2>         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: 
codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
 chunkSize=4, maxDocsPerChunk=479, blockSize=850), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
chunkSize=4, blockSize=850)), sim=ClassicSimilarity, locale=es-US, 
timezone=Europe/Istanbul
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_102 
(64-bit)/cpus=3,threads=2,free=69766800,total=155648000
   [junit4]   2> NOTE: All tests run in this JVM: [BasicHttpSolrClientTest, 
NoOpResponseParserTest, MergeIndexesEmbeddedTest, SolrExampleBinaryTest, 
ExternalHttpClientTest, TestNamedListCodec, SolrExampleStreamingBinaryTest, 
HttpClientUtilTest, LBHttpSolrClientBuilderTest, SolrParamTest, 
CloudSolrClientMultiConstructorTest, TestCollectionAdminRequest, 
JDBCStreamTest, SolrQueryTest, JdbcDriverTest, LargeVolumeEmbeddedTest, 
SolrExceptionTest, SchemaTest, GetByIdTest, TestLBHttpSolrClient, 
SolrExampleJettyTest, LargeVolumeBinaryJettyTest, TestBatchUpdate, 
TestSpellCheckResponse, LargeVolumeJettyTest, QueryResponseTest, 
TestDocumentObjectBinder, TestHash, ContentStreamTest, TestFastInputStream, 
TestXMLEscaping, DocumentAnalysisResponseTest, SolrDocumentTest, 
TestUpdateRequestCodec, FieldAnalysisResponseTest, ClientUtilsTest, 
NamedListTest, AnlysisResponseBaseTest, FacetFieldTest, 
CollectionAdminRequestRequiredParamsTest, CloudSolrClientBuilderTest, 
CloudSolrClientTest, ConcatOperationTest, OperationsTest, 
TestDelegationTokenRequest, TestClusteringResponse, 
TestDelegationTokenResponse, TestToleratedUpdateError, 
TestCollectionStateWatchers]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestCollectionStateWatchers -Dtests.seed=353AEFC0C4D4966E 
-Dtests.slow=true -Dtests.locale=es-US -Dtests.timezone=Europe/Istanbul 
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestCollectionStateWatchers (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.common.cloud.TestCollectionStateWatchers: 
   [junit4]    >    1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([353AEFC0C4D4966E]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=2133, 
name=OverseerHdfsCoreFailoverThread-96475480913281052-127.0.0.1:54928_solr-n_0000000005,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.interrupt0(Native Method)
   [junit4]    >         at java.lang.Thread.interrupt(Thread.java:923)
   [junit4]    >         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([353AEFC0C4D4966E]:0)
   [junit4] Completed [87/87 (1!)] on J1 in 52.97s, 9 tests, 2 errors <<< 
FAILURES!

[...truncated 59511 lines...]

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to