Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3874/
Java: 32bit/jdk1.8.0 -client -XX:+UseParallelGC

4 tests failed.
REGRESSION:  org.apache.solr.cloud.TestShortCircuitedRequests.testDistribSearch

Error Message:


Stack Trace:
org.apache.solr.common.cloud.ZooKeeperException: 
        at 
__randomizedtesting.SeedInfo.seed([7873BD3329B0256B:F995332B5EEF4557]:0)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:249)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.initCloud(AbstractFullDistribZkTestBase.java:256)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:312)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
        at sun.reflect.GeneratedMethodAccessor90.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
        at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: 
KeeperErrorCode = NoNode for /live_nodes
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
        at 
org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:299)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:242)
        ... 41 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestShortCircuitedRequests

Error Message:
ERROR: SolrZkClient opens=5 closes=4

Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=5 closes=4
        at __randomizedtesting.SeedInfo.seed([7873BD3329B0256B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:435)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
        at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:789)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
        at java.lang.Thread.run(Thread.java:744)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestShortCircuitedRequests

Error Message:
2 threads leaked from SUITE scope at 
org.apache.solr.cloud.TestShortCircuitedRequests:     1) Thread[id=11662, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-EventThread,
 state=WAITING, group=TGRP-TestShortCircuitedRequests]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)    
2) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) 
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE 
scope at org.apache.solr.cloud.TestShortCircuitedRequests: 
   1) Thread[id=11662, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-EventThread,
 state=WAITING, group=TGRP-TestShortCircuitedRequests]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   2) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
        at __randomizedtesting.SeedInfo.seed([7873BD3329B0256B]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestShortCircuitedRequests

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) 
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
        at __randomizedtesting.SeedInfo.seed([7873BD3329B0256B]:0)




Build Log:
[...truncated 20015 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestShortCircuitedRequests
   [junit4]   2> 2912404 T11638 oas.SolrTestCaseJ4.startTrackingSearchers WARN 
startTrackingSearchers: numOpens=5 numCloses=5
   [junit4]   2> 2912405 T11638 oas.SolrTestCaseJ4.buildSSLConfig Randomized 
ssl (true) and clientAuth (true)
   [junit4]   2> 2912406 T11638 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /
   [junit4]   2> 2912411 T11638 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> Creating dataDir: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestShortCircuitedRequests-1395219996612
   [junit4]   2> 2912414 T11638 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2912415 T11639 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 2912538 T11638 oasc.ZkTestServer.run start zk server on 
port:50784
   [junit4]   2> 2912542 T11638 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 2912555 T11645 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@15e190e name:ZooKeeperConnection 
Watcher:127.0.0.1:50784 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2912557 T11638 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2912557 T11638 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2912576 T11638 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 2912583 T11647 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@f640db name:ZooKeeperConnection 
Watcher:127.0.0.1:50784/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2912584 T11638 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2912585 T11638 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 2912596 T11638 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 2912606 T11638 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 2912616 T11638 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 2912625 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 2912625 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 2912642 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 2912644 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 2912656 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2912659 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2912669 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 2912669 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 2912682 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 2912685 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 2912697 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 2912699 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 2912708 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2912713 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 2912727 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2912729 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 2912738 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2912738 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2912751 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2912751 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 2912764 T11638 oasc.AbstractZkTestCase.putConfig put 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 2912767 T11638 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 2912781 T11640 oazs.NIOServerCnxn.doIO WARN caught end of 
stream exception EndOfStreamException: Unable to read additional data from 
client sessionid 0x144d9979fd30001, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2912783 T11638 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 2912790 T11649 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7f39fa name:ZooKeeperConnection 
Watcher:127.0.0.1:50784/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2912792 T11638 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2912799 T11640 oazs.NIOServerCnxn.doIO WARN caught end of 
stream exception EndOfStreamException: Unable to read additional data from 
client sessionid 0x144d9979fd30002, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2915258 T11638 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2915287 T11638 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2915313 T11638 oejs.AbstractConnector.doStart Started 
[email protected]:50794
   [junit4]   2> 2915321 T11638 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 2915324 T11638 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 2915324 T11638 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
.\org.apache.solr.cloud.TestShortCircuitedRequests-controljetty-1395219996996
   [junit4]   2> 2915325 T11638 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'.\org.apache.solr.cloud.TestShortCircuitedRequests-controljetty-1395219996996\'
   [junit4]   2> 2915369 T11638 oass.SolrDispatchFilter.loadConfigSolr Trying 
to read solr.xml from 127.0.0.1:50784/solr
   [junit4]   2> 2915372 T11638 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 2915389 T11660 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@ca0c53 name:ZooKeeperConnection 
Watcher:127.0.0.1:50784/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2915391 T11638 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2915394 T11638 oass.SolrDispatchFilter.init ERROR Could not 
start Solr. Check solr/home property and the logs
   [junit4]   2> 2915395 T11638 oasc.SolrException.log ERROR 
null:org.apache.solr.common.SolrException: Could not load solr.xml from 
zookeeper
   [junit4]   2>                at 
org.apache.solr.servlet.SolrDispatchFilter.loadConfigSolr(SolrDispatchFilter.java:182)
   [junit4]   2>                at 
org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:198)
   [junit4]   2>                at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:147)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.FilterHolder.doStart(FilterHolder.java:119)
   [junit4]   2>                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:719)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1309)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1345)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1085)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:931)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:888)
   [junit4]   2>                at 
org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:340)
   [junit4]   2>                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:325)
   [junit4]   2>                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:174)
   [junit4]   2>                at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:65)
   [junit4]   2>                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:430)
   [junit4]   2>                at 
org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:403)
   [junit4]   2>                at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJetty(AbstractFullDistribZkTestBase.java:490)
   [junit4]   2>                at 
org.apache.solr.BaseDistributedSearchTestCase.createJetty(BaseDistributedSearchTestCase.java:356)
   [junit4]   2>                at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:291)
   [junit4]   2>                at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
   [junit4]   2>                at 
sun.reflect.GeneratedMethodAccessor90.invoke(Unknown Source)
   [junit4]   2>                at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>                at 
java.lang.reflect.Method.invoke(Method.java:483)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
   [junit4]   2>                at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2>                at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2>                at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>                at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
   [junit4]   2>                at java.lang.Thread.run(Thread.java:744)
   [junit4]   2>        Caused by: org.apache.solr.common.SolrException: Could 
not load solr.xml from zookeeper: node not found
   [junit4]   2>                at 
org.apache.solr.servlet.SolrDispatchFilter.loadConfigSolr(SolrDispatchFilter.java:178)
   [junit4]   2>                ... 58 more
   [junit4]   2>        
   [junit4]   2> 2915395 T11638 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 2915411 T11638 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 2915415 T11662 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a8a27d name:ZooKeeperConnection 
Watcher:127.0.0.1:50784/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2915415 T11638 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 2915417 T11638 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 2915421 T11638 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 2915424 T11638 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2915427 T11638 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
50794
   [junit4]   2> 2915441 T11638 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> !!!! WARNING: best effort to remove 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.TestShortCircuitedRequests-1395219996610\zookeeper\server1\data\version-2\log.1
 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.TestShortCircuitedRequests-1395219996610\zookeeper\server1\data\version-2
 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.TestShortCircuitedRequests-1395219996610\zookeeper\server1\data
 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.TestShortCircuitedRequests-1395219996610\zookeeper\server1
 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.TestShortCircuitedRequests-1395219996610\zookeeper
 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.TestShortCircuitedRequests-1395219996610
 FAILED !!!!!
   [junit4]   2> 2915510 T11638 oas.SolrTestCaseJ4.tearDown ###Ending 
testDistribSearch
   [junit4]   2> 2915518 T11638 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:50784 50784
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestShortCircuitedRequests -Dtests.method=testDistribSearch 
-Dtests.seed=7873BD3329B0256B -Dtests.slow=true -Dtests.locale=en_MT 
-Dtests.timezone=Asia/Bishkek -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   5.89s | TestShortCircuitedRequests.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.common.cloud.ZooKeeperException: 
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7873BD3329B0256B:F995332B5EEF4557]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:249)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.initCloud(AbstractFullDistribZkTestBase.java:256)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:312)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
   [junit4]    >        at java.lang.Thread.run(Thread.java:744)
   [junit4]    > Caused by: 
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode 
for /live_nodes
   [junit4]    >        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
   [junit4]    >        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    >        at 
org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:299)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:242)
   [junit4]    >        ... 41 more
   [junit4]   2> 2918291 T11638 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 2918295 T11638 oas.SolrTestCaseJ4.endTrackingZkClients ERROR 
ERROR: SolrZkClient opens=5 closes=4
   [junit4]   2> 5896 T11637 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> 2918381 T11662 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a8a27d name:ZooKeeperConnection 
Watcher:127.0.0.1:50784/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
   [junit4]   2> 2918381 T11662 oascc.ConnectionManager.process zkClient has 
disconnected
   [junit4]   2> 2920847 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2923294 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2926195 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2929041 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2932064 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2934674 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2937612 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 26018 T11637 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 2 
threads leaked from SUITE scope at 
org.apache.solr.cloud.TestShortCircuitedRequests: 
   [junit4]   2>           1) Thread[id=11662, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-EventThread,
 state=WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]   2>                at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>                at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>                at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>                at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   [junit4]   2>           2) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]   2>                at java.lang.Thread.sleep(Native Method)
   [junit4]   2>                at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
   [junit4]   2> 26019 T11637 ccr.ThreadLeakControl.tryToInterruptAll Starting 
to interrupt leaked threads:
   [junit4]   2>           1) Thread[id=11662, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-EventThread,
 state=WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]   2>           2) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]   2> 2938423 T11662 oaz.ClientCnxn$EventThread.run ERROR Event 
thread exiting due to interruption java.lang.InterruptedException
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
   [junit4]   2>        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   [junit4]   2> 
   [junit4]   2> 2938423 T11661 oazc.StaticHostProvider.next WARN Unexpected 
exception java.lang.InterruptedException: sleep interrupted
   [junit4]   2>        at java.lang.Thread.sleep(Native Method)
   [junit4]   2>        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
   [junit4]   2> 
   [junit4]   2> 2939497 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.nio.channels.ClosedByInterruptException
   [junit4]   2>        at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:748)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2939925 T11661 oazc.StaticHostProvider.next WARN Unexpected 
exception java.lang.InterruptedException: sleep interrupted
   [junit4]   2>        at java.lang.Thread.sleep(Native Method)
   [junit4]   2>        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
   [junit4]   2> 
   [junit4]   2> 2940906 T11661 oaz.ClientCnxn$SendThread.run WARN Session 
0x144d9979fd30004 for server null, unexpected error, closing socket connection 
and attempting reconnect java.nio.channels.ClosedByInterruptException
   [junit4]   2>        at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:748)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 2940927 T11661 oaz.ClientCnxn$SendThread.run WARN Unexpected 
exception java.lang.InterruptedException: sleep interrupted
   [junit4]   2>        at java.lang.Thread.sleep(Native Method)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
   [junit4]   2> 
   [junit4]   2> 29026 T11637 ccr.ThreadLeakControl.tryToInterruptAll SEVERE 
There are still zombie threads that couldn't be terminated:
   [junit4]   2>           1) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]   2>                at java.lang.Thread.sleep(Native Method)
   [junit4]   2>                at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
   [junit4]   2>                at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, 
sim=DefaultSimilarity, locale=en_MT, timezone=Asia/Bishkek
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 
(32-bit)/cpus=2,threads=2,free=304523896,total=498597888
   [junit4]   2> NOTE: All tests run in this JVM: 
[OverseerCollectionProcessorTest, PreAnalyzedFieldTest, 
HdfsChaosMonkeySafeLeaderTest, AsyncMigrateRouteKeyTest, 
TestSuggestSpellingConverter, SpellCheckComponentTest, 
TestDynamicFieldCollectionResource, LeaderElectionTest, 
DistributedSuggestComponentTest, TestConfig, TermVectorComponentTest, 
TestNonDefinedSimilarityFactory, MoreLikeThisHandlerTest, JSONWriterTest, 
AliasIntegrationTest, TestFieldResource, SliceStateTest, SynonymTokenizerTest, 
TestSolr4Spatial, DeleteShardTest, QueryFacetTest, HdfsUnloadDistributedZkTest, 
TestSolrXMLSerializer, TestAnalyzedSuggestions, TestCollationField, 
ZkSolrClientTest, FileUtilsTest, SolrInfoMBeanTest, TestJoin, 
TestBM25SimilarityFactory, BlockDirectoryTest, TestComponentsName, 
TestComplexPhraseQParserPlugin, TestReversedWildcardFilterFactory, SOLR749Test, 
TestRandomFaceting, WordBreakSolrSpellCheckerTest, NumericFieldsTest, 
AutoCommitTest, DebugComponentTest, SignatureUpdateProcessorFactoryTest, 
TestValueSourceCache, TestReload, TestNRTOpen, 
TestHighFrequencyDictionaryFactory, TestSerializedLuceneMatchVersion, 
TestCoreDiscovery, BinaryUpdateRequestHandlerTest, UnloadDistributedZkTest, 
ClusterStateTest, TestReloadAndDeleteDocs, TestCopyFieldCollectionResource, 
SpellPossibilityIteratorTest, ExternalFileFieldSortTest, TestFaceting, 
SearchHandlerTest, CopyFieldTest, TestIBSimilarityFactory, ZkControllerTest, 
TestJmxMonitoredMap, TestSolrJ, HdfsDirectoryTest, 
HdfsCollectionsAPIDistributedZkTest, BasicZkTest, RemoteQueryErrorTest, 
TestLMJelinekMercerSimilarityFactory, SolrRequestParserTest, 
TestSolrIndexConfig, PreAnalyzedUpdateProcessorTest, TestStressRecovery, 
TestRealTimeGet, TestPHPSerializedResponseWriter, RangeFacetTest, NoFacetTest, 
QueryEqualityTest, TestMultiCoreConfBootstrap, DefaultValueUpdateProcessorTest, 
TestClassNameShortening, SuggesterWFSTTest, 
UniqFieldsUpdateProcessorFactoryTest, TestDocBasedVersionConstraints, 
TestCSVResponseWriter, ShowFileRequestHandlerTest, DirectUpdateHandlerTest, 
TestRecovery, TestLMDirichletSimilarityFactory, TestStandardQParsers, 
AnalysisAfterCoreReloadTest, XmlUpdateRequestHandlerTest, ConvertedLegacyTest, 
HdfsBasicDistributedZk2Test, TimeZoneUtilsTest, TestCharFilters, 
TestStressReorder, TestExpandComponent, TestAddFieldRealTimeGet, 
TestInitQParser, TestFieldCollectionResource, TestSchemaResource, 
TestDocumentBuilder, TestSolrQueryParser, PrimitiveFieldTypeTest, 
AddSchemaFieldsUpdateProcessorFactoryTest, TestQueryTypes, RequiredFieldsTest, 
TermsComponentTest, ShardSplitTest, TestManagedSchemaFieldResource, 
SuggesterTest, BadComponentTest, HardAutoCommitTest, NotRequiredUniqueKeyTest, 
SolrIndexSplitterTest, DocValuesTest, TestExtendedDismaxParser, 
CoreAdminCreateDiscoverTest, TestPostingsSolrHighlighter, 
ChaosMonkeySafeLeaderTest, SSLMigrationTest, 
CollectionsAPIAsyncDistributedZkTest, ShardRoutingTest, TestCSVLoader, 
SuggestComponentTest, BadIndexSchemaTest, DistributedTermsComponentTest, 
TestSchemaSimilarityResource, NoCacheHeaderTest, TestFastWriter, TestUtils, 
CSVRequestHandlerTest, CoreMergeIndexesAdminHandlerTest, StressHdfsTest, 
MigrateRouteKeyTest, TestRestManager, TestLuceneMatchVersion, 
TestSchemaNameResource, BlockCacheTest, TestCustomSort, 
TestFoldingMultitermQuery, TestMergePolicyConfig, MinimalSchemaTest, 
HdfsSyncSliceTest, TestFieldTypeCollectionResource, TestDynamicFieldResource, 
TestOmitPositions, TestBadConfig, TestUniqueKeyFieldResource, ExpressionTest, 
FieldMutatingUpdateProcessorTest, TestFuzzyAnalyzedSuggestions, 
TestSolrXmlPersistence, TestRangeQuery, TestDistributedMissingSort, 
TestArbitraryIndexDir, TestDFRSimilarityFactory, TestQuerySenderListener, 
PathHierarchyTokenizerFactoryTest, BasicDistributedZkTest, TestXIncludeConfig, 
TestMaxScoreQueryParser, ReturnFieldsTest, TestManagedResourceStorage, 
TestSolrDeletionPolicy1, TestModifyConfFiles, TestAtomicUpdateErrorCases, 
LegacyHTMLStripCharFilterTest, TestCodecSupport, TestRecoveryHdfs, 
DocValuesMultiTest, DirectUpdateHandlerOptimizeTest, 
CollectionsAPIDistributedZkTest, TestRequestStatusCollectionAPI, ZkCLITest, 
TestFiltering, TestIndexingPerformance, HdfsLockFactoryTest, SuggesterTSTTest, 
TestWordDelimiterFilterFactory, TestShardHandlerFactory, 
DirectSolrSpellCheckerTest, TestSearcherReuse, TestPhraseSuggestions, 
CurrencyFieldOpenExchangeTest, RAMDirectoryFactoryTest, MBeansHandlerTest, 
PluginInfoTest, TestSweetSpotSimilarityFactory, 
DistributedSpellCheckComponentTest, TestBinaryResponseWriter, SampleTest, 
BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, 
LeaderElectionIntegrationTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, 
TestReplicationHandler, ClusterStateUpdateTest, TestZkChroot, 
TestRandomDVFaceting, ShardRoutingCustomTest, SliceStateUpdateTest, 
TestDistributedSearch, TestDistributedGrouping, TestHashPartitioner, 
TermVectorComponentDistributedTest, TestStressVersions, TestCoreContainer, 
SimpleFacetsTest, SolrCoreTest, StatsComponentTest, TestGroupingSearch, 
SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, TestSort, 
TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, TestIndexSearcher, 
HighlighterTest, SoftAutoCommitTest, DistributedQueryElevationComponentTest, 
CurrencyFieldXmlFileTest, SimplePostToolTest, SpellCheckCollatorTest, 
SuggesterFSTTest, CoreAdminHandlerTest, TestStressLucene, TestTrie, 
SpatialFilterTest, PolyFieldTest, SchemaVersionSpecificBehaviorTest, 
SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, 
StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, 
TestRemoteStreaming, DistanceFunctionTest, XsltUpdateRequestHandlerTest, 
CacheHeaderTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, 
LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, 
StandardRequestHandlerTest, TestWriterPerf, DocumentAnalysisRequestHandlerTest, 
FileBasedSpellCheckerTest, RequestHandlersTest, DocumentBuilderTest, 
FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, 
IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, 
SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, 
UpdateRequestProcessorFactoryTest, QueryParsingTest, JsonLoaderTest, 
TestPartialUpdateDeduplication, PingRequestHandlerTest, 
CoreContainerCoreInitFailuresTest, TestLFUCache, HighlighterConfigTest, 
UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, 
ResponseLogComponentTest, SolrIndexConfigTest, TestSolrDeletionPolicy2, 
MultiTermTest, TestDocSet, TestBinaryField, TestSearchPerf, 
TestElisionMultitermQuery, OutputWriterTest, TestSolrCoreProperties, 
DirectSolrConnectionTest, EchoParamsTest, TestPerFieldSimilarity, 
TestNumberUtils, TestDefaultSimilarityFactory, ResourceLoaderTest, 
TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, 
URLClassifyProcessorTest, TestFastLRUCache, DateMathParserTest, 
ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, PrimUtilsTest, 
DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, TestLRUCache, 
ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, 
TestRTGBase, CursorPagingTest, SolrTestCaseJ4Test, 
TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, 
AbstractAnalyticsStatsTest, AbstractAnalyticsFacetTest, FieldFacetExtrasTest, 
FunctionTest, AssignTest, ConnectionManagerTest, CustomCollectionTest, 
DeleteInactiveReplicaTest, DeleteReplicaTest, DistribCursorPagingTest, 
OverseerRolesTest, SolrXmlInZkTest, TestDistribDocBasedVersion, 
TestShortCircuitedRequests]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestShortCircuitedRequests -Dtests.seed=7873BD3329B0256B 
-Dtests.slow=true -Dtests.locale=en_MT -Dtests.timezone=Asia/Bishkek 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s | TestShortCircuitedRequests (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient 
opens=5 closes=4
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7873BD3329B0256B]:0)
   [junit4]    >        at 
org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:435)
   [junit4]    >        at 
org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
   [junit4]    >        at java.lang.Thread.run(Thread.java:744)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE 
scope at org.apache.solr.cloud.TestShortCircuitedRequests: 
   [junit4]    >    1) Thread[id=11662, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-EventThread,
 state=WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   [junit4]    >    2) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7873BD3329B0256B]:0)Throwable #3: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=11661, 
name=TEST-TestShortCircuitedRequests.testDistribSearch-seed#[7873BD3329B0256B]-SendThread(127.0.0.1:50784),
 state=TIMED_WAITING, group=TGRP-TestShortCircuitedRequests]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([7873BD3329B0256B]:0)
   [junit4] Completed in 29.10s, 1 test, 1 failure, 3 errors <<< FAILURES!

[...truncated 166 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The 
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The 
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The 
following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: 
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: 
The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490:
 The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275:
 The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907:
 There were test failures: 391 suites, 1645 tests, 3 suite-level errors, 1 
error, 271 ignored (33 assumptions)

Total time: 75 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to