Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/1/

3 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:60245

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: https://127.0.0.1:60245
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:382)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:498)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
        at sun.security.ssl.InputRecord.read(InputRecord.java:503)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
        ... 47 more


FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:
Timeout waiting for all live and active

Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
        at 
__randomizedtesting.SeedInfo.seed([EBBF8DF5DF2C6D8B:63EBB22F71D00073]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:193)
        at 
org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:107)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=84264, name=collection3, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=84264, name=collection3, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at https://127.0.0.1:36045/c: collection already exists: 
awholynewstresscollection_collection3_0
        at __randomizedtesting.SeedInfo.seed([EBBF8DF5DF2C6D8B]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)




Build Log:
[...truncated 11245 lines...]
   [junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/init-core-data-001
   [junit4]   2> 123274 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 126916 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your 
platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 130076 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 130927 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via 
org.mortbay.log.Slf4jLog
   [junit4]   2> 130948 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 131279 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 131448 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_40832_hdfs____lebhhh/webapp
   [junit4]   2> 132721 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 134218 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40832
   [junit4]   2> 137661 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 137672 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 137694 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_34546_datanode____j35pwd/webapp
   [junit4]   2> 137831 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 138437 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34546
   [junit4]   2> 139722 WARN  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 139723 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 139748 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_41478_datanode____72uezj/webapp
   [junit4]   2> 140007 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 140892 INFO  
(SUITE-SharedFSAutoReplicaFailoverTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41478
   [junit4]   2> 142388 INFO  (IPC Server handler 6 on 33269) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-2392f6fc-6505-4265-ba9f-3972eef0e73d node DatanodeRegistration(127.0.0.1, 
datanodeUuid=9acf277c-728b-46b1-b508-39656cf722f4, infoPort=34546, 
ipcPort=48097, storageInfo=lv=-56;cid=testClusterID;nsid=551372057;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 2 msecs
   [junit4]   2> 142388 INFO  (IPC Server handler 6 on 33269) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-80dd7d92-e4ed-4d39-b912-12bdb331c8a0 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=9acf277c-728b-46b1-b508-39656cf722f4, infoPort=34546, 
ipcPort=48097, storageInfo=lv=-56;cid=testClusterID;nsid=551372057;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 142424 INFO  (IPC Server handler 3 on 33269) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-defbe6b3-aaeb-4bf9-bc13-f3e34f472591 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=12993bf2-b4dc-4376-b111-99b46c5c6641, infoPort=41478, 
ipcPort=46707, storageInfo=lv=-56;cid=testClusterID;nsid=551372057;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 20 msecs
   [junit4]   2> 142436 INFO  (IPC Server handler 3 on 33269) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-e5b575b7-0dc2-460b-94b9-bbd10f0f93d6 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=12993bf2-b4dc-4376-b111-99b46c5c6641, infoPort=41478, 
ipcPort=46707, storageInfo=lv=-56;cid=testClusterID;nsid=551372057;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 143333 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 143333 INFO  (Thread-241) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 143333 INFO  (Thread-241) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 143436 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:56379
   [junit4]   2> 143436 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 143492 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 143580 INFO  (zkCallback-49-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ad49ee8 
name:ZooKeeperConnection Watcher:127.0.0.1:56379 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 143580 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 143580 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 143580 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 143632 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 143636 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 143637 INFO  (zkCallback-50-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@a39cf18 name:ZooKeeperConnection 
Watcher:127.0.0.1:56379/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 143637 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 143638 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 143638 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 143646 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 143651 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 143653 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 143655 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 143655 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 143658 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 143658 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 143659 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 143659 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 143833 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 143833 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 143835 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 143835 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 143838 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 143838 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 143841 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 143841 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 143844 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 143844 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 143849 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 143849 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 143850 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 143850 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 143852 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 143852 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 144146 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores/collection1
   [junit4]   2> 144160 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 144332 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6add23a2{/,null,AVAILABLE}
   [junit4]   2> 144334 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@c72b761{HTTP/1.1,[http/1.1]}{127.0.0.1:45739}
   [junit4]   2> 144334 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.Server Started @149161ms
   [junit4]   2> 144334 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=45739, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores}
   [junit4]   2> 144334 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 144404 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001'
   [junit4]   2> 144404 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 144404 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 144404 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 144424 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 144480 INFO  (zkCallback-51-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@64b93637 
name:ZooKeeperConnection Watcher:127.0.0.1:56379/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 144480 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 144480 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 144488 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 144488 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/solr.xml
   [junit4]   2> 144507 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores
   [junit4]   2> 144507 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 260157534
   [junit4]   2> 144507 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001]
   [junit4]   2> 144507 WARN  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/lib
   [junit4]   2> 144507 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 144509 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 144509 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 144509 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 144509 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56379/solr
   [junit4]   2> 144509 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 144509 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 144541 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 144567 INFO  (zkCallback-54-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5cec414c 
name:ZooKeeperConnection Watcher:127.0.0.1:56379 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 144567 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 144568 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 144573 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 144581 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@10aba066 
name:ZooKeeperConnection Watcher:127.0.0.1:56379/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 144581 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 144582 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 144583 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 144585 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 144586 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 144588 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 144589 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 144590 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 144591 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 144591 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 144592 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 144592 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 144593 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 144594 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 144594 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 144594 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/95640088090705924-127.0.0.1:45739_-n_0000000000
   [junit4]   2> 144594 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:45739_
   [junit4]   2> 144595 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 144596 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer Overseer 
(id=95640088090705924-127.0.0.1:45739_-n_0000000000) starting
   [junit4]   2> 144597 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 144600 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 144600 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 144601 INFO  
(OverseerCollectionConfigSetProcessor-95640088090705924-127.0.0.1:45739_-n_0000000000)
 [n:127.0.0.1:45739_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 144609 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45739_
   [junit4]   2> 144609 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:45739_
   [junit4]   2> 144609 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 144610 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live 
nodes size: [0])
   [junit4]   2> 144610 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 144663 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 144663 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 144663 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores
   [junit4]   2> 144664 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 144664 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.CorePropertiesLocator Found core collection1 
in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores/collection1
   [junit4]   2> 144664 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 144828 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 144828 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:45739_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 144829 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 144829 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 144840 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45739";,
   [junit4]   2>   "node_name":"127.0.0.1:45739_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 144840 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45739";,
   [junit4]   2>   "node_name":"127.0.0.1:45739_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 144840 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 144841 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 144841 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 144842 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 145841 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 145841 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 145841 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 145841 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 145842 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 145842 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores/collection1'
   [junit4]   2> 145842 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 145842 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 145845 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.Config loaded 
config solrconfig.xml with version 0 
   [junit4]   2> 145856 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
current version of requestparams : -1
   [junit4]   2> 145859 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 145874 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 145881 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 146442 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 146454 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
default search field in schema is text
   [junit4]   2> 146460 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
unique key field: id
   [junit4]   2> 146485 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 146489 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 146494 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 146494 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 146495 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 146495 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 146496 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 146520 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:33269/solr_hdfs_home
   [junit4]   2> 146520 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 146520 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/control-001/cores/collection1],
 
dataDir=[hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 146520 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24253f3a
   [junit4]   2> 146521 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 146667 WARN  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds 
and try again.
   [junit4]   2> 151931 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 151975 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 152057 WARN  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:33269/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 152057 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 152078 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 152078 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 152078 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
   [junit4]   2> 157146 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 157147 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 157147 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=42, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=94.568359375, 
floorSegmentMB=1.4091796875, forceMergeDeletesPctAllowed=5.387444063845032, 
segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5130405635468048
   [junit4]   2> 158041 INFO  (IPC Server handler 4 on 33269) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49989 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-e5b575b7-0dc2-460b-94b9-bbd10f0f93d6:NORMAL:127.0.0.1:49989|RBW],
 
ReplicaUnderConstruction[[DISK]DS-2392f6fc-6505-4265-ba9f-3972eef0e73d:NORMAL:127.0.0.1:44986|RBW]]}
 size 0
   [junit4]   2> 158082 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/index
 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@48f42c47); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 158082 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 158086 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"nodistrib"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-explicit"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 158087 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 158088 WARN  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 158094 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 158104 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 158105 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 158105 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 158106 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 158113 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 158113 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 158128 INFO  (IPC Server handler 0 on 33269) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44986 is 
added to blk_1073741825_1001 size 71
   [junit4]   2> 158139 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 158140 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
tlogDfsReplication=2
   [junit4]   2> 158177 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 158177 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 158180 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=7, maxMergeAtOnceExplicit=6, maxMergedSegmentMB=48.0244140625, 
floorSegmentMB=1.2177734375, forceMergeDeletesPctAllowed=18.002118818995367, 
segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.2943679903515293
   [junit4]   2> 158355 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        
commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:33269/solr_hdfs_home/control_collection/core_node1/data/index
 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@48f42c47); 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 158355 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 158355 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@2cc60e5f[collection1] main]
   [junit4]   2> 158355 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the 
RestManager with znodeBase: /configs/conf1
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 158358 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 158360 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 158361 INFO  
(searcherExecutor-205-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@2cc60e5f[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 158368 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 158368 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version 
buckets from index
   [junit4]   2> 158368 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket 
highest value from index
   [junit4]   2> 158368 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1530241425215586304
   [junit4]   2> 158368 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 
1530241425215586304
   [junit4]   2> 158369 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 158399 INFO  
(coreLoadExecutor-204-thread-1-processing-n:127.0.0.1:45739_) 
[n:127.0.0.1:45739_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 158435 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:45739 
collection:control_collection shard:shard1
   [junit4]   2> 158436 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 158458 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/95640088090705924-core_node1-n_0000000000
   [junit4]   2> 158459 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 
and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 158461 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 158461 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 158463 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 158463 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 158463 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:45739/collection1/
   [junit4]   2> 158463 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 158463 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:45739/collection1/ has no replicas
   [junit4]   2> 158463 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 158464 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/control_collection/leaders/shard1/leader after winning as 
/collections/control_collection/leader_elect/shard1/election/95640088090705924-core_node1-n_0000000000
   [junit4]   2> 158466 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:45739";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 158466 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:45739/collection1/ shard1
   [junit4]   2> 158548 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 158556 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 158572 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 158583 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@56568ac name:ZooKeeperConnection 
Watcher:127.0.0.1:56379/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 158583 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 158583 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 158583 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 158662 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 158663 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 158718 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:45739/collection1/ and leader is 
http://127.0.0.1:45739/collection1/
   [junit4]   2> 158718 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45739
   [junit4]   2> 158718 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 158718 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
publishing state=active
   [junit4]   2> 158718 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 158721 INFO  
(coreZkRegister-198-thread-1-processing-n:127.0.0.1:45739_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45739_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 158736 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45739";,
   [junit4]   2>   "node_name":"127.0.0.1:45739_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 158736 INFO  
(OverseerStateUpdate-95640088090705924-127.0.0.1:45739_-n_0000000000) 
[n:127.0.0.1:45739_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45739";,
   [junit4]   2>   "node_name":"127.0.0.1:45739_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 158948 INFO  
(zkCallback-55-thread-1-processing-n:127.0.0.1:45739_) [n:127.0.0.1:45739_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 158992 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [1])
   [junit4]   2> 159167 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001/cores/collection1
   [junit4]   2> 159178 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001
   [junit4]   2> 159181 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 159205 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6dff1fd8{/,null,AVAILABLE}
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@687178c6{HTTP/1.1,[http/1.1]}{127.0.0.1:38334}
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.e.j.s.Server Started @164033ms
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, 
hostContext=/, hostPort=38334, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001/cores}
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001'
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 159206 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 159207 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 159452 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 159556 INFO  (zkCallback-58-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7ec2a9e2 
name:ZooKeeperConnection Watcher:127.0.0.1:56379/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 159556 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 159556 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 159577 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 159577 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001/solr.xml
   [junit4]   2> 159601 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001/cores
   [junit4]   2> 159601 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 2131608901
   [junit4]   2> 159601 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001]
   [junit4]   2> 159601 WARN  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EBBF8DF5DF2C6D8B-001/shard-1-001/lib
   [junit4]   2> 159612 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 159613 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 159613 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 159613 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 159613 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56379/solr
   [junit4]   2> 159613 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 159613 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 159698 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 159940 INFO  (zkCallback-61-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1669bd07 
name:ZooKeeperConnection Watcher:127.0.0.1:56379 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 159944 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 159944 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 159964 INFO  
(TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EBBF8DF5DF2C6D8B]) 
[n:127.0.0.1:38334_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 160004 INFO  
(zkCallback-62-thread-1-processing-n:127.0.0.1:38334_) [n:127.0.0.1:38334_    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1375d460 
name:ZooKeeperConnection Watcher:127.0.0.1:56379/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   

[...truncated too long message...]

r.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2>        at 
com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2>        at 
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2>        at 
org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
   [junit4]   2>        at 
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:52)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2>        at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2>        ... 54 more
   [junit4]   2> 5201635 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[EBBF8DF5DF2C6D8B]-worker) [    
] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Mar 30, 2016 4:56:30 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): 
{other_tl1=BlockTreeOrds(blocksize=128), 
range_facet_l_dv=PostingsFormat(name=Asserting), 
_version_=BlockTreeOrds(blocksize=128), 
multiDefault=PostingsFormat(name=LuceneFixedGap), 
a_t=PostingsFormat(name=LuceneFixedGap), 
intDefault=BlockTreeOrds(blocksize=128), 
a_i1=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=Asserting), 
range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), 
text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 range_facet_l=PostingsFormat(name=LuceneFixedGap), 
timestamp=PostingsFormat(name=LuceneFixedGap)}, 
docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), 
range_facet_i_dv=DocValuesFormat(name=Lucene54), 
timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=72, 
maxMBSortInHeap=4.46969598029105, sim=ClassicSimilarity, locale=es-MX, 
timezone=Asia/Kathmandu
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=149697288,total=529530880
   [junit4]   2> NOTE: All tests run in this JVM: [CopyFieldTest, 
PrimUtilsTest, DistribCursorPagingTest, TestRealTimeGet, SimpleMLTQParserTest, 
TestCryptoKeys, OverseerRolesTest, DisMaxRequestHandlerTest, QueryEqualityTest, 
HLLSerializationTest, TestLRUCache, TestAtomicUpdateErrorCases, 
TestCloudManagedSchema, TestSolrQueryParserDefaultOperatorResource, 
ReturnFieldsTest, CollectionTooManyReplicasTest, HdfsSyncSliceTest, 
ZkNodePropsTest, TestBadConfig, TestConfigReload, 
TlogReplayBufferedWhileIndexingTest, URLClassifyProcessorTest, 
DeleteReplicaTest, TestConfig, BlockJoinFacetSimpleTest, CustomCollectionTest, 
TestQueryWrapperFilter, TestRandomFaceting, CachingDirectoryFactoryTest, 
TestBlendedInfixSuggestions, PathHierarchyTokenizerFactoryTest, TestCSVLoader, 
BasicZkTest, TestMergePolicyConfig, CursorPagingTest, TestShardHandlerFactory, 
TestChildDocTransformer, TestRawTransformer, TestPKIAuthenticationPlugin, 
ResponseHeaderTest, TestFoldingMultitermQuery, TestDynamicLoading, 
TestRangeQuery, TestConfigSetsAPI, SolrCoreTest, QueryElevationComponentTest, 
TestConfigSetImmutable, TestCloudInspectUtil, 
OutOfBoxZkACLAndCredentialsProvidersTest, TestTrackingShardHandlerFactory, 
CdcrReplicationDistributedZkTest, AsyncCallRequestStatusResponseTest, 
TestMiniSolrCloudClusterSSL, TestDistributedStatsComponentCardinality, 
IgnoreCommitOptimizeUpdateProcessorFactoryTest, 
CoreMergeIndexesAdminHandlerTest, CdcrVersionReplicationTest, 
TestRandomDVFaceting, SolrRequestParserTest, HdfsDirectoryFactoryTest, 
TestDistributedSearch, TestExactSharedStatsCache, OutputWriterTest, 
TestHighFrequencyDictionaryFactory, TestSolrConfigHandlerConcurrent, 
SynonymTokenizerTest, DefaultValueUpdateProcessorTest, 
BasicAuthIntegrationTest, TestLazyCores, TestStressLucene, EchoParamsTest, 
HttpPartitionTest, TestTestInjection, PeerSyncTest, TestCrossCoreJoin, 
TestJoin, TestAnalyzedSuggestions, TestReRankQParserPlugin, 
DistributedSpellCheckComponentTest, TestBinaryField, 
SegmentsInfoRequestHandlerTest, TestManagedResource, TestFaceting, 
DistributedQueueTest, TestOmitPositions, TestSchemaSimilarityResource, 
TestMinMaxOnMultiValuedField, SyncSliceTest, BJQParserTest, TestFunctionQuery, 
DataDrivenBlockJoinTest, AnalyticsQueryTest, BasicDistributedZkTest, 
DocumentAnalysisRequestHandlerTest, TestShortCircuitedRequests, 
VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, 
HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [467/579 (3!)] on J0 in 356.48s, 1 test, 1 error <<< 
FAILURES!

[...truncated 373 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014:
 There were test failures: 579 suites (10 ignored), 2313 tests, 2 errors, 1 
failure, 32 ignored (16 assumptions) [seed: EBBF8DF5DF2C6D8B]

Total time: 335 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to