See <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/4918/>

------------------------------------------
[...truncated 15305 lines...]
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:317)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:150)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:155)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:265)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ZkController.joinElection(ZkController.java:733)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ZkController.register(ZkController.java:566)
[junit4:junit4]   2>            ... 46 more
[junit4:junit4]   2>    
[junit4:junit4]   2> 7220217 T190 oazs.NIOServerCnxn.closeSock Closed socket 
connection for client /127.0.0.1:60354 which had sessionid 0x13aa19684620007
[junit4:junit4]   2> 7220217 T149 oaz.ZooKeeper.<init> Initiating client 
connection, connectString=127.0.0.1:60264/solr sessionTimeout=10000 
watcher=org.apache.solr.common.cloud.ConnectionManager@18f61b
[junit4:junit4]   2> 7220217 T213 oaz.ClientCnxn$EventThread.run EventThread 
shut down
[junit4:junit4]   2> 7220217 T149 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=32632782
[junit4:junit4]   2> 7220217 T149 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@11c661c
[junit4:junit4]   2> 7220217 T149 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 7220217 T149 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 7220217 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 7220217 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 7220217 T149 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 7220216 T210 oaz.ClientCnxn$EventThread.run EventThread 
shut down
[junit4:junit4]   2> 7220216 T207 oaz.ClientCnxn$EventThread.run SEVERE Event 
thread exiting due to interruption java.lang.InterruptedException
[junit4:junit4]   2>    at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
[junit4:junit4]   2>    at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1996)
[junit4:junit4]   2>    at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220216 T191 oazs.SessionTrackerImpl.run SEVERE Unexpected 
interruption java.lang.InterruptedException
[junit4:junit4]   2>    at java.lang.Object.wait(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:145)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220217 T207 oaz.ClientCnxn$EventThread.run EventThread 
shut down
[junit4:junit4]   2> 7220216 T199 oaz.ClientCnxn$EventThread.run SEVERE Event 
thread exiting due to interruption java.lang.InterruptedException
[junit4:junit4]   2>    at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
[junit4:junit4]   2>    at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1996)
[junit4:junit4]   2>    at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220217 T199 oaz.ClientCnxn$EventThread.run EventThread 
shut down
[junit4:junit4]   2> 7220217 T191 oazs.SessionTrackerImpl.run 
SessionTrackerImpl exited loop!
[junit4:junit4]   2> 7220217 T149 oaz.ZooKeeper.close Session: 
0x13aa19684620004 closed
[junit4:junit4]   2> 7220217 T190 oazs.NIOServerCnxn.doIO WARNING Exception 
causing close of session 0x13aa19684620004 due to 
java.nio.channels.ClosedByInterruptException
[junit4:junit4]   2> 7220217 T190 oazs.NIOServerCnxn.closeSock Closed socket 
connection for client /127.0.0.1:60314 which had sessionid 0x13aa19684620004
[junit4:junit4]   2> 7220217 T149 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=4424441
[junit4:junit4]   2> 7220217 T149 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@7be75d
[junit4:junit4]   2> 7220217 T204 oaz.ClientCnxn$EventThread.run EventThread 
shut down
[junit4:junit4]   2> 7220218 T149 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 7220219 T149 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 7220219 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 7220219 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 7220220 T149 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 7220220 T190 oazs.NIOServerCnxn.doIO WARNING Exception 
causing close of session 0x13aa19684620005 due to 
java.nio.channels.ClosedByInterruptException
[junit4:junit4]   2> 7220220 T149 oaz.ZooKeeper.close Session: 
0x13aa19684620005 closed
[junit4:junit4]   2> 7220221 T190 oazs.NIOServerCnxn.closeSock Closed socket 
connection for client /127.0.0.1:60323 which had sessionid 0x13aa19684620005
[junit4:junit4]   2> 7220221 T149 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=4196716
[junit4:junit4]   2> 7220221 T149 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@7c42fe
[junit4:junit4]   2> 7220224 T149 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 7220224 T149 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 7220224 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 7220225 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 7220225 T149 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 7220708 T198 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1038)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220708 T149 oaz.ZooKeeper.close Session: 
0x13aa19684620002 closed
[junit4:junit4]   2> 7220708 T215 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1045)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220708 T149 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=30505467
[junit4:junit4]   2> 7220723 T215 oaz.ClientCnxn$SendThread.startConnect 
Opening socket connection to server 127.0.0.1/127.0.0.1:60264
[junit4:junit4]   2> 7220723 T149 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@1e79c77
[junit4:junit4]   2> 7220723 T215 oaz.ClientCnxn$SendThread.primeConnection 
Socket connection established to 127.0.0.1/127.0.0.1:60264, initiating session
[junit4:junit4]   2> 7220723 T190 oazs.NIOServerCnxn$Factory.run WARNING 
Ignoring exception java.nio.channels.ClosedByInterruptException
[junit4:junit4]   2>    at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:184)
[junit4:junit4]   2>    at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:159)
[junit4:junit4]   2>    at 
org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:242)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220739 T190 oazs.NIOServerCnxn.closeSock Closed socket 
connection for client /127.0.0.1:60309 which had sessionid 0x13aa19684620003
[junit4:junit4]   2> 7220739 T190 oazs.NIOServerCnxn.closeSock Closed socket 
connection for client /127.0.0.1:60330 which had sessionid 0x13aa19684620006
[junit4:junit4]   2> 7220739 T190 oazs.NIOServerCnxn$Factory.run NIOServerCnxn 
factory exited run method
[junit4:junit4]   2> 7220739 T203 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa19684620003 for server 127.0.0.1/127.0.0.1:60264, unexpected error, 
closing socket connection and attempting reconnect 
java.nio.channels.ClosedByInterruptException
[junit4:junit4]   2>    at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:184)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:270)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:856)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1154)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220739 T212 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa19684620006 for server 127.0.0.1/127.0.0.1:60264, unexpected error, 
closing socket connection and attempting reconnect 
java.nio.channels.ClosedByInterruptException
[junit4:junit4]   2>    at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:184)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:270)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:856)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1154)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7220739 T149 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 7220739 T149 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 7220739 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 7220739 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 7220739 T149 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 7220744 T215 oaz.ClientCnxn$SendThread.run WARNING Session 
0x13aa19684620007 for server 127.0.0.1/127.0.0.1:60264, unexpected error, 
closing socket connection and attempting reconnect java.io.IOException: An 
existing connection was forcibly closed by the remote host
[junit4:junit4]   2>    at sun.nio.ch.SocketDispatcher.read0(Native Method)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:25)
[junit4:junit4]   2>    at 
sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202)
[junit4:junit4]   2>    at sun.nio.ch.IOUtil.read(IOUtil.java:169)
[junit4:junit4]   2>    at 
sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:856)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1154)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221214 T215 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1038)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221214 T198 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1045)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221214 T212 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1045)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221214 T198 oaz.ClientCnxn$SendThread.startConnect 
Opening socket connection to server 127.0.0.1/127.0.0.1:60264
[junit4:junit4]   2> 7221214 T203 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1038)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221214 T212 oaz.ClientCnxn$SendThread.startConnect 
Opening socket connection to server 127.0.0.1/127.0.0.1:60264
[junit4:junit4]   2> 7221214 T149 oaz.ZooKeeper.close Session: 
0x13aa19684620003 closed
[junit4:junit4]   2> 7221230 T149 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=30074543
[junit4:junit4]   2> 7221230 T149 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@3337df
[junit4:junit4]   2> 7221245 T149 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 7221245 T149 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 7221245 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 7221245 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 7221245 T149 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 7221807 T215 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1045)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221807 T203 oaz.ClientCnxn$SendThread.startConnect 
WARNING Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2>    at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1045)
[junit4:junit4]   2>    at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1101)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7221807 T215 oaz.ClientCnxn$SendThread.startConnect 
Opening socket connection to server 127.0.0.1/127.0.0.1:60264
[junit4:junit4]   2> 7221807 T149 oaz.ZooKeeper.close Session: 
0x13aa19684620006 closed
[junit4:junit4]   2> 7221807 T203 oaz.ClientCnxn$SendThread.startConnect 
Opening socket connection to server 127.0.0.1/127.0.0.1:60264
[junit4:junit4]   2> 7221807 T149 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=30165554
[junit4:junit4]   2> 7221807 T149 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@a4480d
[junit4:junit4]   2> 7221807 T149 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 7221807 T149 oasc.SolrCore.decrefSolrCoreState Closing 
SolrCoreState
[junit4:junit4]   2> 7221807 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 7221807 T149 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 7221807 T149 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
[junit4:junit4]   2> 7222353 T149 oaz.ZooKeeper.close Session: 
0x13aa19684620007 closed
[junit4:junit4]   2> 7222353 T192 oazs.SyncRequestProcessor.run 
SyncRequestProcessor exited!
[junit4:junit4]   2> 7222353 T149 oazs.FinalRequestProcessor.shutdown shutdown 
of request processor complete
[junit4:junit4]   2> 7224646 T148 ccr.ThreadLeakControl.tryToInterruptAll 
SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4]   2>       1) Thread[id=149, 
name=TEST-LeaderElectionIntegrationTest.testLeaderElectionAfterClientTimeout-seed#[9D164BD3CB65BB7B],
 state=RUNNABLE, group=TGRP-LeaderElectionIntegrationTest]
[junit4:junit4]   2>            at java.net.PlainSocketImpl.socketCreate(Native 
Method)
[junit4:junit4]   2>            at 
java.net.PlainSocketImpl.create(PlainSocketImpl.java:107)
[junit4:junit4]   2>            at java.net.Socket.createImpl(Socket.java:394)
[junit4:junit4]   2>            at java.net.Socket.<init>(Socket.java:371)
[junit4:junit4]   2>            at java.net.Socket.<init>(Socket.java:189)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ZkTestServer.send4LetterWord(ZkTestServer.java:296)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ZkTestServer.waitForServerDown(ZkTestServer.java:258)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.shutdown(ZkTestServer.java:122)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.ZkTestServer.shutdown(ZkTestServer.java:249)
[junit4:junit4]   2>            at 
org.apache.solr.cloud.LeaderElectionIntegrationTest.tearDown(LeaderElectionIntegrationTest.java:292)
[junit4:junit4]   2>            at 
sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
[junit4:junit4]   2>            at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]   2>            at 
java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:795)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]   2>            at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2>            at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2>            at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2>            at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2>            at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 7224646 T149 oazs.FinalRequestProcessor.shutdown shutdown 
of request processor complete
[junit4:junit4]   2> 7224646 T149 oas.SolrTestCaseJ4.tearDown ###Ending 
testLeaderElectionAfterClientTimeout
[junit4:junit4]   2> 7224646 T149 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {}, 
sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=mt_MT, 
timezone=America/Fortaleza
[junit4:junit4]   2> NOTE: Windows Vista 6.0 x86/Sun Microsystems Inc. 1.6.0_23 
(32-bit)/cpus=4,threads=2,free=14922760,total=50110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SortByFunctionTest, 
SearchHandlerTest, MinimalSchemaTest, TestWriterPerf, TestRealTimeGet, 
IndexSchemaRuntimeFieldTest, PolyFieldTest, HighlighterConfigTest, 
UniqFieldsUpdateProcessorFactoryTest, TimeZoneUtilsTest, TestSolr4Spatial, 
TestNumberUtils, FileUtilsTest, SoftAutoCommitTest, TestPluginEnable, 
SolrCoreTest, CSVRequestHandlerTest, LeaderElectionIntegrationTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=LeaderElectionIntegrationTest -Dtests.seed=9D164BD3CB65BB7B 
-Dtests.slow=true -Dtests.locale=mt_MT -Dtests.timezone=America/Fortaleza 
-Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s J6 | LeaderElectionIntegrationTest (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded 
(>= 7200000 msec).
[junit4:junit4]    >    at 
__randomizedtesting.SeedInfo.seed([9D164BD3CB65BB7B]:0)
[junit4:junit4] Completed on J6 in 7224.66s, 2 tests, 2 errors <<< FAILURES!
[junit4:junit4] 
[junit4:junit4] 
[junit4:junit4] Tests with failures:
[junit4:junit4]   - 
org.apache.solr.cloud.LeaderElectionIntegrationTest.testLeaderElectionAfterClientTimeout
[junit4:junit4]   - org.apache.solr.cloud.LeaderElectionIntegrationTest (suite)
[junit4:junit4] 
[junit4:junit4] 
[junit4:junit4] JVM J0:     2.62 ..   273.27 =   270.65s
[junit4:junit4] JVM J1:     2.37 ..   291.32 =   288.95s
[junit4:junit4] JVM J2:     3.42 ..   280.06 =   276.64s
[junit4:junit4] JVM J3:     2.90 ..   331.73 =   328.83s
[junit4:junit4] JVM J4:     2.62 ..   279.87 =   277.25s
[junit4:junit4] JVM J5:     2.62 ..   281.60 =   278.98s
[junit4:junit4] JVM J6:     2.89 ..  7360.66 =  7357.77s
[junit4:junit4] JVM J7:     2.62 ..   273.02 =   270.40s
[junit4:junit4] Execution time total: 2 hours 2 minutes 40 seconds
[junit4:junit4] Tests summary: 233 suites, 965 tests, 1 suite-level error, 1 
error, 12 ignored (7 assumptions)

BUILD FAILED
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/build.xml>:39: 
The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/solr/build.xml>:178:
 The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/module-build.xml>:61:
 The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/common-build.xml>:1159:
 The following error occurred while executing this line:
<http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/common-build.xml>:827:
 There were test failures: 233 suites, 965 tests, 1 suite-level error, 1 error, 
12 ignored (7 assumptions)

Total time: 131 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to