See <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/4961/>

------------------------------------------
[...truncated 14661 lines...]
[junit4:junit4]   2> 284900 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59157
[junit4:junit4]   2> 284900 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=18423897
[junit4:junit4]   2> 284900 T10 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@13136e5
[junit4:junit4]   2> 284900 T10 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 284900 T10 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 284900 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 284900 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 284900 T10 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 284900 T32 oasc.Overseer$ClusterStateUpdater.amILeader 
According to ZK I (id=88564501350711298-127.0.0.1:59157_solr-n_0000000000) am 
no longer a leader.
[junit4:junit4]   2> 285010 T85 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@8aaff4 name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T45 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@176de14 name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T31 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@179d854 name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T85 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285010 T31 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285010 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80002 
closed
[junit4:junit4]   2> 285010 T59 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@106433d name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T98 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e7d12b name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T59 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285010 T45 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285010 T98 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285010 T112 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b72276 name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T71 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1fd9cd5 name:ZooKeeperConnection 
Watcher:127.0.0.1:59142/solr got event WatchedEvent state:Disconnected 
type:None path:null path:null type:None
[junit4:junit4]   2> 285010 T31 oaz.ClientCnxn$EventThread.run EventThread shut 
down
[junit4:junit4]   2> 285010 T71 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285010 T112 oascc.ConnectionManager.process zkClient has 
disconnected
[junit4:junit4]   2> 285011 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 285064 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59174
[junit4:junit4]   2> 285064 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=3946484
[junit4:junit4]   2> 285064 T10 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@113e8f3
[junit4:junit4]   2> 285064 T10 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=2,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 285065 T10 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 285065 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 285065 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 285067 T10 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 286237 T70 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 286331 T97 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 286424 T111 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 286502 T44 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 286705 T58 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 286892 T84 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 287251 T70 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80005 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 287329 T97 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80007 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 287392 T111 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80008 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 287572 T45 oaz.ClientCnxn$EventThread.run EventThread shut 
down
[junit4:junit4]   2> 287572 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80003 
closed
[junit4:junit4]   2> 287582 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 287633 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59180
[junit4:junit4]   2> 287633 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=29087107
[junit4:junit4]   2> 287772 T59 oaz.ClientCnxn$EventThread.run EventThread shut 
down
[junit4:junit4]   2> 287772 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80004 
closed
[junit4:junit4]   2> 287782 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 287833 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59335
[junit4:junit4]   2> 287833 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=845718
[junit4:junit4]   2> 287833 T10 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@455aa8
[junit4:junit4]   2> 287833 T10 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=1,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 287834 T10 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 287834 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 287834 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 287836 T10 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 287862 T84 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80006 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 288734 T70 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 289155 T97 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 289155 T111 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 289280 T84 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 289841 T71 oaz.ClientCnxn$EventThread.run EventThread shut 
down
[junit4:junit4]   2> 289841 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80005 
closed
[junit4:junit4]   2> 289857 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 289908 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59341
[junit4:junit4]   2> 289908 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=7576227
[junit4:junit4]   2> 289908 T10 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@6bb93c
[junit4:junit4]   2> 289908 T10 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=1,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 289924 T10 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 289924 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 289924 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 289939 T10 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 290158 T97 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80007 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 290158 T111 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80008 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 290354 T85 oaz.ClientCnxn$EventThread.run EventThread shut 
down
[junit4:junit4]   2> 290354 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80006 
closed
[junit4:junit4]   2> 290365 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 290416 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59352
[junit4:junit4]   2> 290416 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=17209834
[junit4:junit4]   2> 290416 T10 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@1c634b9
[junit4:junit4]   2> 290416 T10 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=1,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 290417 T10 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 290417 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 290417 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 290419 T10 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 291551 T111 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 291894 T97 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 292550 T111 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa4f1dab80008 for server null, unexpected error, closing socket connection 
and attempting reconnect java.net.ConnectException: Connection refused: no 
further information
[junit4:junit4]   2>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1143)
[junit4:junit4]   2> 
[junit4:junit4]   2> 292962 T98 oaz.ClientCnxn$EventThread.run EventThread shut 
down
[junit4:junit4]   2> 292962 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80007 
closed
[junit4:junit4]   2> 292972 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 293023 T10 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 
59359
[junit4:junit4]   2> 293023 T10 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=15975876
[junit4:junit4]   2> 293023 T10 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@fd981a
[junit4:junit4]   2> 293023 T10 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=1,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 293024 T10 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 293024 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 293024 T10 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 293026 T10 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 294207 T111 oaz.ClientCnxn$SendThread.startConnect Opening 
socket connection to server 127.0.0.1/127.0.0.1:59142
[junit4:junit4]   2> 295315 T112 oaz.ClientCnxn$EventThread.run EventThread 
shut down
[junit4:junit4]   2> 295315 T10 oaz.ZooKeeper.close Session: 0x13aa4f1dab80008 
closed
[junit4:junit4]   2> 295331 T10 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 295584 T10 oas.SolrTestCaseJ4.tearDown ###Ending 
testDistribSearch
[junit4:junit4]   2> 295662 T3 oasu.ConcurrentLRUCache.finalize SEVERE 
ConcurrentLRUCache was not destroyed prior to finalize(), indicates a bug -- 
POSSIBLE RESOURCE LEAK!!!
[junit4:junit4]   2> 295662 T3 oasc.SolrCore.finalize SEVERE REFCOUNT ERROR: 
unreferenced org.apache.solr.core.SolrCore@19deddb (collection1) has a 
reference count of 1
[junit4:junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=CloudSolrServerTest -Dtests.method=testDistribSearch 
-Dtests.seed=C2DB405B59F23CF -Dtests.slow=true -Dtests.locale=fi_FI 
-Dtests.timezone=America/Argentina/Catamarca -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE  295s J0 | CloudSolrServerTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still 
nodes recoverying
[junit4:junit4]    >    at 
__randomizedtesting.SeedInfo.seed([C2DB405B59F23CF:8DCB3A1DC2C043F3]:0)
[junit4:junit4]    >    at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    >    at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
[junit4:junit4]    >    at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:558)
[junit4:junit4]    >    at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1133)
[junit4:junit4]    >    at 
org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:95)
[junit4:junit4]    >    at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:695)
[junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
[junit4:junit4]    >    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    >    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    >    at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    >    at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    >    at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 295709 T10 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 418403 T10 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE 
ERROR: SolrIndexSearcher opens=12 closes=11
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {}, 
sim=DefaultSimilarity, locale=fi_FI, timezone=America/Argentina/Catamarca
[junit4:junit4]   2> NOTE: Windows Vista 6.0 x86/Sun Microsystems Inc. 1.6.0_23 
(32-bit)/cpus=4,threads=1,free=7622096,total=16318464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CloudSolrServerTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=CloudSolrServerTest -Dtests.seed=C2DB405B59F23CF -Dtests.slow=true 
-Dtests.locale=fi_FI -Dtests.timezone=America/Argentina/Catamarca 
-Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s J0 | CloudSolrServerTest (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: 
SolrIndexSearcher opens=12 closes=11
[junit4:junit4]    >    at 
__randomizedtesting.SeedInfo.seed([C2DB405B59F23CF]:0)
[junit4:junit4]    >    at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    >    at 
org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:242)
[junit4:junit4]    >    at 
org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
[junit4:junit4]    >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
[junit4:junit4]    >    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    >    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    >    at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    >    at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    >    at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    >    at java.lang.Thread.run(Thread.java:662)
[junit4:junit4] Completed on J0 in 421.45s, 1 test, 2 failures <<< FAILURES!
[junit4:junit4] 
[junit4:junit4] 
[junit4:junit4] Tests with failures:
[junit4:junit4]   - 
org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch
[junit4:junit4]   - org.apache.solr.client.solrj.impl.CloudSolrServerTest 
(suite)
[junit4:junit4] 
[junit4:junit4] 
[junit4:junit4] JVM J0:     2.95 ..   426.34 =   423.39s
[junit4:junit4] JVM J1:     2.17 ..    48.93 =    46.76s
[junit4:junit4] JVM J2:     2.42 ..    50.86 =    48.44s
[junit4:junit4] JVM J3:     4.54 ..    48.98 =    44.44s
[junit4:junit4] JVM J4:     2.95 ..    76.14 =    73.19s
[junit4:junit4] JVM J5:     2.96 ..    49.18 =    46.22s
[junit4:junit4] JVM J6:     2.95 ..    49.88 =    46.94s
[junit4:junit4] JVM J7:     4.27 ..    48.92 =    44.64s
[junit4:junit4] Execution time total: 7 minutes 6 seconds
[junit4:junit4] Tests summary: 43 suites, 239 tests, 1 suite-level error, 1 
failure

BUILD FAILED
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/build.xml>:39: 
The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/solr/build.xml>:185:
 The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/module-build.xml>:61:
 The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/common-build.xml>:1159:
 The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/common-build.xml>:827:
 There were test failures: 43 suites, 239 tests, 1 suite-level error, 1 failure

Total time: 20 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to