Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.4/6/

12 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54676, name=collection4, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54676, name=collection4, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46521/_/uz: collection already exists: 
awholynewstresscollection_collection4_3
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54674, name=collection2, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54674, name=collection2, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46521/_/uz: collection already exists: 
awholynewstresscollection_collection2_4
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54673, name=collection1, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54673, name=collection1, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46521/_/uz: collection already exists: 
awholynewstresscollection_collection1_3
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54675, name=collection3, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54675, name=collection3, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live 
SolrServers available to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: http://127.0.0.1:48824/_/uz
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:584)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        ... 5 more
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:479)
        ... 9 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54672, name=collection0, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54672, name=collection0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live 
SolrServers available to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:883)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: http://127.0.0.1:48824/_/uz
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:584)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        ... 5 more
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:479)
        ... 9 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54677, name=collection5, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54677, name=collection5, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live 
SolrServers available to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: http://127.0.0.1:48824/_/uz
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:584)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        ... 7 more
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:479)
        ... 11 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=56721, 
name=RecoveryThread-awholynewstresscollection_collection1_3_shard9_replica4, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=56721, 
name=RecoveryThread-awholynewstresscollection_collection1_3_shard9_replica4, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54342, name=SyncThread:0, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54342, name=SyncThread:0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.SecurityException: java.lang.System#exit(11) calls are not 
allowed because they terminate the test runner's JVM.
        at __randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
        at 
org.apache.lucene.util.TestSecurityManager$1.run(TestSecurityManager.java:86)
        at 
org.apache.lucene.util.TestSecurityManager$1.run(TestSecurityManager.java:53)
        at java.security.AccessController.doPrivileged(Native Method)
        at 
org.apache.lucene.util.TestSecurityManager.checkExit(TestSecurityManager.java:53)
        at java.lang.Runtime.exit(Runtime.java:107)
        at java.lang.System.exit(System.java:962)
        at 
org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:185)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Captured an uncaught exception in thread: Thread[id=54340, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54340, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD:46E940E0EC3E8025]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:227)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:108)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11351 lines...]
   [junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/init-core-data-001
   [junit4]   2> 2930050 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 2930128 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 2930145 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2930148 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 2930165 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_46692_hdfs____341l13/webapp
   [junit4]   2> 2930358 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2930674 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46692
   [junit4]   2> 2930761 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2930762 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 2930778 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_53062_datanode____lcn14l/webapp
   [junit4]   2> 2930896 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2931160 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53062
   [junit4]   2> 2931214 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2931215 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 2931230 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_60041_datanode____jlt1y2/webapp
   [junit4]   2> 2931316 INFO  (IPC Server handler 3 on 51379) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-f6cb1ef5-0718-4b5c-a55a-77b0a0d18717 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=f6f97a03-a238-4d96-a282-8fdfee296b60, infoPort=53062, 
ipcPort=40984, storageInfo=lv=-56;cid=testClusterID;nsid=1212023321;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 2931316 INFO  (IPC Server handler 3 on 51379) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-200db3a7-0d9d-4b7c-852d-7ebd86598071 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=f6f97a03-a238-4d96-a282-8fdfee296b60, infoPort=53062, 
ipcPort=40984, storageInfo=lv=-56;cid=testClusterID;nsid=1212023321;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2931357 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2931669 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[CEBD7F3A42C2EDDD]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60041
   [junit4]   2> 2931837 INFO  (IPC Server handler 3 on 51379) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-43c3f510-ba75-4021-bb18-153d52a6f72e node DatanodeRegistration(127.0.0.1, 
datanodeUuid=05099b2d-f68c-407e-be52-39a3424f1ad3, infoPort=60041, 
ipcPort=33060, storageInfo=lv=-56;cid=testClusterID;nsid=1212023321;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 2931837 INFO  (IPC Server handler 3 on 51379) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-1f0bb0d3-50f0-4143-851a-c1fb35b8544c node DatanodeRegistration(127.0.0.1, 
datanodeUuid=05099b2d-f68c-407e-be52-39a3424f1ad3, infoPort=60041, 
ipcPort=33060, storageInfo=lv=-56;cid=testClusterID;nsid=1212023321;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2932078 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2932079 INFO  (Thread-60026) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2932079 INFO  (Thread-60026) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2932178 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:60249
   [junit4]   2> 2932178 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2932179 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2932188 INFO  (zkCallback-1487-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@145a793 name:ZooKeeperConnection 
Watcher:127.0.0.1:60249 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2932189 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2932189 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2932189 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2932191 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2932194 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2932195 INFO  (zkCallback-1488-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7bb58e96 
name:ZooKeeperConnection Watcher:127.0.0.1:60249/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2932195 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2932195 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2932195 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 2932197 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 2932199 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 2932200 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 2932201 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 2932201 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2932203 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 2932204 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 2932205 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2932205 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2932215 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 2932215 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2932218 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 2932218 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2932220 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 2932220 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 2932221 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2932221 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2932222 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2932222 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2932223 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2932223 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2932224 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2932225 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2932226 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 2932226 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2932639 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores/collection1
   [junit4]   2> 2932640 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 2932649 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@688aab74{/,null,AVAILABLE}
   [junit4]   2> 2932649 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@67fe824a{HTTP/1.1}{127.0.0.1:56594}
   [junit4]   2> 2932649 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.e.j.s.Server Started @2935184ms
   [junit4]   2> 2932649 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostPort=56594, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores,
 hostContext=/}
   [junit4]   2> 2932649 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4dfd245f
   [junit4]   2> 2932649 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001'
   [junit4]   2> 2932650 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2932650 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 2932650 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2932650 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2932652 INFO  (zkCallback-1489-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@288faa27 
name:ZooKeeperConnection Watcher:127.0.0.1:60249/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2932652 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2932652 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2932653 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 2932653 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/solr.xml
   [junit4]   2> 2932669 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores
   [junit4]   2> 2932670 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 831132922
   [junit4]   2> 2932670 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001]
   [junit4]   2> 2932670 WARN  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/lib
   [junit4]   2> 2932670 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2932671 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 2932672 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2932672 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2932672 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60249/solr
   [junit4]   2> 2932672 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 2932672 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2932673 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2932674 INFO  (zkCallback-1491-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3c3d3adb 
name:ZooKeeperConnection Watcher:127.0.0.1:60249 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2932674 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2932675 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2932680 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2932682 INFO  
(zkCallback-1492-thread-1-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@13d17b9 name:ZooKeeperConnection 
Watcher:127.0.0.1:60249/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 2932682 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2932687 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2932691 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 2932694 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 2932696 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 2932698 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 2932700 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2932703 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2932704 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2932705 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2932706 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:56594_
   [junit4]   2> 2932707 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:56594_
   [junit4]   2> 2932708 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2932710 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 2932711 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2932712 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/94960283470725124-127.0.0.1:56594_-n_0000000000
   [junit4]   2> 2932712 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:56594_
   [junit4]   2> 2932713 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 2932714 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.Overseer Overseer 
(id=94960283470725124-127.0.0.1:56594_-n_0000000000) starting
   [junit4]   2> 2932717 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 2932723 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2932725 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2932725 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 2932726 INFO  
(OverseerCollectionConfigSetProcessor-94960283470725124-127.0.0.1:56594_-n_0000000000)
 [n:127.0.0.1:56594_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 2932733 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 2932768 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 2932769 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 2932769 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.CoresLocator Looking for core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores
   [junit4]   2> 2932770 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{transient=false, configSetProperties=configsetprops.json, name=collection1, 
collection=control_collection, config=solrconfig.xml, shard=, coreNodeName=, 
schema=schema.xml, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores/collection1/,
 dataDir=data/, loadOnStartup=true, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores/collection1}
   [junit4]   2> 2932770 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores/collection1/
   [junit4]   2> 2932770 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 2932772 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0
   [junit4]   2> 2932772 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[CEBD7F3A42C2EDDD]) 
[n:127.0.0.1:56594_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 2932772 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 2932772 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 2932775 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "shard":null,
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://127.0.0.1:56594";,
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:56594_"} current state version: 0
   [junit4]   2> 2932775 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 2932775 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "shard":null,
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "base_url":"http://127.0.0.1:56594";,
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "node_name":"127.0.0.1:56594_"}
   [junit4]   2> 2932776 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 2932777 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 2932779 INFO  
(zkCallback-1492-thread-1-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 2932779 INFO  
(zkCallback-1492-thread-2-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 2933776 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2933776 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 2933776 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 2933776 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 2933777 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 2933777 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores/collection1'
   [junit4]   2> 2933777 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2933777 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 2933779 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.Config loaded 
config solrconfig.xml with version 0 
   [junit4]   2> 2933787 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
current version of requestparams : -1
   [junit4]   2> 2933823 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 5.4.0
   [junit4]   2> 2933860 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.Config Loaded 
SolrConfig: solrconfig.xml
   [junit4]   2> 2933870 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 2934194 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2934200 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
default search field in schema is text
   [junit4]   2> 2934202 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
unique key field: id
   [junit4]   2> 2934210 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 2934212 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 2934215 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 2934215 WARN  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 2934215 WARN  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 2934215 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 2934216 WARN  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 2934216 WARN  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:51379/solr_hdfs_home
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J0/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_CEBD7F3A42C2EDDD-001/control-001/cores/collection1],
 dataDir=[null]
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@10b17a36
   [junit4]   2> 2934217 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:51379/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 2934233 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:51379/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 2934234 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:51379/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 2934244 WARN  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:51379/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 2934244 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:51379/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 2934251 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 2934251 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 2934251 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 2934258 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2934258 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:51379/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 2934258 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: 
minMergeSize=0, mergeFactor=10, maxMergeSize=1728429400, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.1]
   [junit4]   2> 2934273 INFO  (IPC Server handler 2 on 51379) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37942 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-43c3f510-ba75-4021-bb18-153d52a6f72e:NORMAL:127.0.0.1:44132|RBW],
 
ReplicaUnderConstruction[[DISK]DS-f6cb1ef5-0718-4b5c-a55a-77b0a0d18717:NORMAL:127.0.0.1:37942|FINALIZED]]}
 size 0
   [junit4]   2> 2934280 INFO  (IPC Server handler 3 on 51379) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44132 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-f6cb1ef5-0718-4b5c-a55a-77b0a0d18717:NORMAL:127.0.0.1:37942|FINALIZED],
 
ReplicaUnderConstruction[[DISK]DS-1f0bb0d3-50f0-4143-851a-c1fb35b8544c:NORMAL:127.0.0.1:44132|FINALIZED]]}
 size 0
   [junit4]   2> 2934285 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b8214b3d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@304818d0); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 2934285 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 2934289 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:51379/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 2934291 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"nodistrib"
   [junit4]   2> 2934291 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 2934291 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2934291 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 2934292 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2934292 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-explicit"
   [junit4]   2> 2934292 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 2934292 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 2934292 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 2934292 WARN  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 2934296 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2934297 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2934299 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2934302 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2934306 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/get,/schema,/admin/mbeans,/admin/threads,/admin/file,/admin/logging,/admin/segments,/config,/admin/luke,/admin/properties,/update/json/docs,/dump,/admin/ping,/replication,standard,/update/json,/update/csv,/admin/system,/update,/admin/plugins
   [junit4]   2> 2934310 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 2934310 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 2934310 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 2934334 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 2934334 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 2934335 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@112f761
   [junit4]   2> 2934359 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b8214b3d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@304818d0); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 2934359 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 2934359 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening Searcher@34e31c0[collection1] main
   [junit4]   2> 2934359 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 2934361 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 2934361 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the 
RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2934362 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 2934363 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 2934363 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2934363 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 2934363 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2934363 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 2934363 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2934364 INFO  
(searcherExecutor-5528-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@34e31c0[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2934366 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 2934366 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version 
buckets from index
   [junit4]   2> 2934366 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket 
highest value from index
   [junit4]   2> 2934366 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1519364537925500928
   [junit4]   2> 2934366 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 
1519364537925500928
   [junit4]   2> 2934366 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 2934367 INFO  
(coreLoadExecutor-5527-thread-1-processing-n:127.0.0.1:56594_) 
[n:127.0.0.1:56594_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 2934374 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:56594 
collection:control_collection shard:shard1
   [junit4]   2> 2934376 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2934380 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/94960283470725124-core_node1-n_0000000000
   [junit4]   2> 2934380 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 2934384 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 2934385 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2934385 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2934385 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:56594/collection1/
   [junit4]   2> 2934385 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 2934385 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:56594/collection1/ has no replicas
   [junit4]   2> 2934386 INFO  
(zkCallback-1492-thread-1-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 2934386 INFO  
(zkCallback-1492-thread-2-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 2934388 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2934393 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 2934397 INFO  
(OverseerStateUpdate-94960283470725124-127.0.0.1:56594_-n_0000000000) 
[n:127.0.0.1:56594_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:56594";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 2934397 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:56594/collection1/ shard1
   [junit4]   2> 2934500 INFO  
(zkCallback-1492-thread-1-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 2934500 INFO  
(zkCallback-1492-thread-2-processing-n:127.0.0.1:56594_) [n:127.0.0.1:56594_    
] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 2934548 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:56594/collection1/ and leader is 
http://127.0.0.1:56594/collection1/
   [junit4]   2> 2934549 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56594
   [junit4]   2> 2934549 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.1:56594_) [n:127.0.0.1:56594_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 2934549 INFO  
(coreZkRegister-5521-thread-1-processing-s:shard1 x:collection1 r:core_node1 
c:control_collection n:127.0.0.

[...truncated too long message...]

n.java:251)
   [junit4]    >        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    >        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:479)
   [junit4]    >        ... 9 moreThrowable #7: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54677, name=collection5, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:50807/_/uz, 
http://127.0.0.1:48824/_/uz, http://127.0.0.1:46521/_/uz, 
http://127.0.0.1:39579/_/uz, http://127.0.0.1:60397/_/uz]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
No live SolrServers available to handle this 
request:[http://127.0.0.1:50807/_/uz, http://127.0.0.1:48824/_/uz, 
http://127.0.0.1:46521/_/uz, http://127.0.0.1:39579/_/uz, 
http://127.0.0.1:60397/_/uz]
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1573)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:876)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
Timeout occured while waiting response from server at: 
http://127.0.0.1:48824/_/uz
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:584)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    >        ... 7 more
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    >        at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    >        at 
java.net.SocketInputStream.read(SocketInputStream.java:152)
   [junit4]    >        at 
java.net.SocketInputStream.read(SocketInputStream.java:122)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    >        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    >        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    >        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    >        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:479)
   [junit4]    >        ... 11 moreThrowable #8: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=56721, 
name=RecoveryThread-awholynewstresscollection_collection1_3_shard9_replica4, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceededThrowable #9: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=54342, name=SyncThread:0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.SecurityException: 
java.lang.System#exit(11) calls are not allowed because they terminate the test 
runner's JVM.
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([CEBD7F3A42C2EDDD]:0)
   [junit4]    >        at 
org.apache.lucene.util.TestSecurityManager$1.run(TestSecurityManager.java:86)
   [junit4]    >        at 
org.apache.lucene.util.TestSecurityManager$1.run(TestSecurityManager.java:53)
   [junit4]    >        at java.security.AccessController.doPrivileged(Native 
Method)
   [junit4]    >        at 
org.apache.lucene.util.TestSecurityManager.checkExit(TestSecurityManager.java:53)
   [junit4]    >        at java.lang.Runtime.exit(Runtime.java:107)
   [junit4]    >        at java.lang.System.exit(System.java:962)
   [junit4]    >        at 
org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:185)Throwable
 #10: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=54340, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit 
exceeded
   [junit4] Completed [529/551] on J1 in 7240.92s, 1 test, 11 errors <<< 
FAILURES!

[...truncated 67 lines...]
   [junit4] JVM J1: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/temp/junit4-J1-20151201_132000_082.sysout
   [junit4] >>> JVM J1: stdout (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/heapdumps/java_pid17766.hprof
 ...
   [junit4] Heap dump file created [611659848 bytes in 11.321 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:792: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:729: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/common-build.xml:526:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/lucene/common-build.xml:1452:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/lucene/common-build.xml:1006:
 There were test failures: 551 suites (7 ignored), 2177 tests, 10 suite-level 
errors, 1 error, 1 failure, 95 ignored (18 assumptions) [seed: CEBD7F3A42C2EDDD]

Total time: 297 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to