Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.2/5/

9 tests failed.
FAILED:  
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart

Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1

Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete 
@source_collection:shard1
        at 
__randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B:E250D4353C9A7CBD]:0)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:794)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart(CdcrReplicationDistributedZkTest.java:264)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [HdfsTransactionLog]
        at __randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:258)
        at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest

Error Message:
3 threads leaked from SUITE scope at 
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest:     1) 
Thread[id=49970, name=searcherExecutor-13159-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=49845, 
name=searcherExecutor-13126-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=49955, 
name=searcherExecutor-13147-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE 
scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest: 
   1) Thread[id=49970, name=searcherExecutor-13159-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=49845, name=searcherExecutor-13126-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=49955, name=searcherExecutor-13147-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=49970, name=searcherExecutor-13159-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=49845, 
name=searcherExecutor-13126-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=49955, 
name=searcherExecutor-13147-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=49970, name=searcherExecutor-13159-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=49845, name=searcherExecutor-13126-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=49955, name=searcherExecutor-13147-thread-1, state=WAITING, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)


FAILED:  org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:35623: Error CREATEing SolrCore 
'test_unload_shard_and_collection_1': Unable to create core 
[test_unload_shard_and_collection_1] Caused by: Direct buffer memory

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:35623: Error CREATEing SolrCore 
'test_unload_shard_and_collection_1': Unable to create core 
[test_unload_shard_and_collection_1] Caused by: Direct buffer memory
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:592)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:261)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:250)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:129)
        at 
org.apache.solr.cloud.UnloadDistributedZkTest.test(UnloadDistributedZkTest.java:70)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, 
NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not 
released!!! [NRTCachingDirectory, NRTCachingDirectory]
        at __randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:258)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.TestManagedSchemaAPI

Error Message:
ObjectTracker found 2 object(s) that were not released!!! 
[MockDirectoryWrapper, RawDirectoryWrapper]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not 
released!!! [MockDirectoryWrapper, RawDirectoryWrapper]
        at __randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:258)
        at sun.reflect.GeneratedMethodAccessor81.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: 
https://127.0.0.1:41755/t_wi

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: https://127.0.0.1:41755/t_wi
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:603)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:261)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:250)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:399)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:457)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
        at sun.security.ssl.InputRecord.read(InputRecord.java:503)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:497)
        ... 47 more


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=23100, name=collection1, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=23100, name=collection1, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: https://127.0.0.1:42793
        at __randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: https://127.0.0.1:42793
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:603)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:261)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:250)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:405)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:357)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1280)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1050)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:992)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1620)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:987)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
        at sun.security.ssl.InputRecord.read(InputRecord.java:503)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:497)
        ... 11 more




Build Log:
[...truncated 11498 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/init-core-data-001
   [junit4]   2> 48685 INFO  
(SUITE-TestReplicationHandler-seed#[BE4D33B4F2BAC88B]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 48696 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestIndexFetchWithMasterUrl
   [junit4]   2> 48697 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1
   [junit4]   2> 49632 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 49944 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4175738c{/solr,null,AVAILABLE}
   [junit4]   2> 50268 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.ServerConnector Started 
ServerConnector@46a2776b{HTTP/1.1,[http/1.1]}{127.0.0.1:37982}
   [junit4]   2> 50268 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.Server Started @60244ms
   [junit4]   2> 50269 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1/data,
 hostContext=/solr, hostPort=37982}
   [junit4]   2> 50343 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 50357 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001'
   [junit4]   2> 50360 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr 
(NoInitialContextEx)
   [junit4]   2> 50360 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not 
find system property or JNDI)
   [junit4]   2> 50366 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/solr.xml
   [junit4]   2> 50476 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/.
   [junit4]   2> 50484 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer New CoreContainer 82622631
   [junit4]   2> 50484 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001]
   [junit4]   2> 50484 WARN  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/lib
   [junit4]   2> 50512 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 
20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 
2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : 
false,useRetries : false,connectionsEvictorSleepDelay : 
5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 50620 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 50651 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 50660 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 50661 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 50661 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 50662 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/.
   [junit4]   2> 50666 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 50667 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1
   [junit4]   2> 50667 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 50716 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0
   [junit4]   2> 50716 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 50729 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1'
   [junit4]   2> 50731 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 50731 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 50775 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 50835 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.1
   [junit4]   2> 51377 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 51419 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 51435 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 51457 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1'
   [junit4]   2> 51458 INFO  (coreLoadExecutor-22-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1
   [junit4]   2> 51458 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 51458 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 51458 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 51470 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data/snapshot_metadata
   [junit4]   2> 51470 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.s.SolrSnapshotMetaDataManager Loading from snapshot metadata file...
   [junit4]   2> 51484 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data
   [junit4]   2> 51485 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data/index/
   [junit4]   2> 51485 WARN  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 51485 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 51485 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=49, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=74.154296875, 
floorSegmentMB=1.587890625, forceMergeDeletesPctAllowed=4.175297584319163, 
segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 51487 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@393f7ca3 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7684f5d8),segFN=segments_1,generation=1}
   [junit4]   2> 51487 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 51490 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 51494 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/./collection1/data/
   [junit4]   2> 51521 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 51696 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 51721 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 51728 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 51763 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 51763 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
   [junit4]   2> 51763 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 51773 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 51773 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 51776 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=44, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=89.498046875, 
floorSegmentMB=0.3837890625, forceMergeDeletesPctAllowed=26.208431535041925, 
segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.35739256378637896
   [junit4]   2> 51776 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@393f7ca3 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7684f5d8),segFN=segments_1,generation=1}
   [junit4]   2> 51777 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 51777 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@53192101[collection1] main]
   [junit4]   2> 51778 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1/conf
   [junit4]   2> 51778 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: 
{storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1/conf}
   [junit4]   2> 51778 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-001/collection1/conf
   [junit4]   2> 51778 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 51778 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.h.ReplicationHandler Replication enabled for following config files: 
schema.xml,xslt/dummy.xsl
   [junit4]   2> 51778 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 51779 INFO  (coreLoadExecutor-22-thread-1) [    x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 51793 INFO  
(searcherExecutor-23-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@53192101[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 52348 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1
   [junit4]   2> 52363 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 52478 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4bdf6e6e{/solr,null,AVAILABLE}
   [junit4]   2> 52478 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.ServerConnector Started 
ServerConnector@17b92d72{HTTP/1.1,[http/1.1]}{127.0.0.1:55329}
   [junit4]   2> 52478 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.Server Started @62453ms
   [junit4]   2> 52478 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1/data,
 hostContext=/solr, hostPort=55329}
   [junit4]   2> 52479 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 52479 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002'
   [junit4]   2> 52479 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr 
(NoInitialContextEx)
   [junit4]   2> 52479 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not 
find system property or JNDI)
   [junit4]   2> 52487 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/solr.xml
   [junit4]   2> 52514 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/.
   [junit4]   2> 52514 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer New CoreContainer 1597686243
   [junit4]   2> 52514 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002]
   [junit4]   2> 52514 WARN  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/lib
   [junit4]   2> 52764 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 
20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 
2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : 
false,useRetries : false,connectionsEvictorSleepDelay : 
5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 52820 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 52822 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 52822 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 52822 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 52822 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 52823 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/.
   [junit4]   2> 52824 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 52824 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1
   [junit4]   2> 52824 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 52896 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0
   [junit4]   2> 52896 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 52905 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1'
   [junit4]   2> 52906 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 52906 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 52928 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 52944 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.1
   [junit4]   2> 52998 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 53012 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 53021 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 53023 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1'
   [junit4]   2> 53023 INFO  (coreLoadExecutor-32-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1
   [junit4]   2> 53024 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 53028 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 53028 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 53029 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/snapshot_metadata
   [junit4]   2> 53029 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.s.SolrSnapshotMetaDataManager Loading from snapshot metadata file...
   [junit4]   2> 53034 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data
   [junit4]   2> 53034 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 53034 WARN  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 53036 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 53037 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=49, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=74.154296875, 
floorSegmentMB=1.587890625, forceMergeDeletesPctAllowed=4.175297584319163, 
segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 53086 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@36c947db 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e3a5358),segFN=segments_1,generation=1}
   [junit4]   2> 53086 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 53104 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 53105 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/
   [junit4]   2> 53111 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 53117 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 53119 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 53139 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 53155 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 53159 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
   [junit4]   2> 53159 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 53167 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 53167 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 53168 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=44, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=89.498046875, 
floorSegmentMB=0.3837890625, forceMergeDeletesPctAllowed=26.208431535041925, 
segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.35739256378637896
   [junit4]   2> 53169 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@36c947db 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e3a5358),segFN=segments_1,generation=1}
   [junit4]   2> 53169 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 53169 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@d0e5b0f[collection1] main]
   [junit4]   2> 53170 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1/conf
   [junit4]   2> 53170 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: 
{storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1/conf}
   [junit4]   2> 53170 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1/conf
   [junit4]   2> 53170 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 53609 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 53610 INFO  
(searcherExecutor-33-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@d0e5b0f[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 53617 INFO  (coreLoadExecutor-32-thread-1) [    x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 55437 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.ServerConnector Stopped 
ServerConnector@17b92d72{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 55438 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1597686243
   [junit4]   2> 55445 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@792f829b
   [junit4]   2> 55446 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.u.DirectUpdateHandler2 closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 55448 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 55453 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 
0 - closing IndexWriter
   [junit4]   2> 55466 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with 
IndexWriterCloser
   [junit4]   2> 55498 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 3 
directories currently being tracked
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data;done=false>>]
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, 
CoreContainer#isShutdown=true
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/snapshot_metadata
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/snapshot_metadata;done=false>>]
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, 
CoreContainer#isShutdown=true
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/snapshot_metadata
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/index
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/index;done=false>>]
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, 
CoreContainer#isShutdown=true
   [junit4]   2> 55499 INFO  (coreCloseExecutor-38-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 55510 INFO  (indexFetcher-37-thread-1) [    x:collection1] 
o.a.h.i.c.DefaultHttpClient I/O exception 
(org.apache.http.NoHttpResponseException) caught when processing request to 
{}->http://127.0.0.1:37982: The target server failed to respond
   [junit4]   2> 55510 INFO  (indexFetcher-37-thread-1) [    x:collection1] 
o.a.h.i.c.DefaultHttpClient Retrying request to {}->http://127.0.0.1:37982
   [junit4]   2> 55514 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@4bdf6e6e{/solr,null,UNAVAILABLE}
   [junit4]   2> 56050 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 56117 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5d1fee82{/solr,null,AVAILABLE}
   [junit4]   2> 56118 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.ServerConnector Started 
ServerConnector@1ca94406{HTTP/1.1,[http/1.1]}{127.0.0.1:36372}
   [junit4]   2> 56118 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.e.j.s.Server Started @66093ms
   [junit4]   2> 56118 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/collection1/data,
 hostContext=/solr, hostPort=36372}
   [junit4]   2> 56118 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 56119 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002'
   [junit4]   2> 56119 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr 
(NoInitialContextEx)
   [junit4]   2> 56119 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not 
find system property or JNDI)
   [junit4]   2> 56126 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/solr.xml
   [junit4]   2> 56409 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/.
   [junit4]   2> 56409 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer New CoreContainer 2132731390
   [junit4]   2> 56409 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002]
   [junit4]   2> 56409 WARN  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/lib
   [junit4]   2> 56413 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 
20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 
2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : 
false,useRetries : false,connectionsEvictorSleepDelay : 
5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 56422 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 56428 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 56428 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 56428 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 56428 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 56429 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/.
   [junit4]   2> 56431 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 56431 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_BE4D33B4F2BAC88B-001/solr-instance-002/./collection1
   [junit4]   2> 56431 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 56488 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/J0
   [junit4]   2> 56489 INFO  
(TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[BE4D33B4F2BAC88B])
 [    ] o.a.s

[...truncated too long message...]

erTest, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, 
HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, 
TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, 
ResponseLogComponentTest, TestStressRecovery, TestMergePolicyConfig, 
MultiTermTest, MinimalSchemaTest, TestConfig, OutputWriterTest, 
TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, 
SpellPossibilityIteratorTest, TestCodecSupport, EchoParamsTest, 
TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestJmxMonitoredMap, 
TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, PluginInfoTest, 
DateMathParserTest, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, 
PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, 
RAMDirectoryFactoryTest, ClusterStateTest, TestLRUCache, TestDocumentBuilder, 
SystemInfoHandlerTest, FileUtilsTest, TestRTGBase, 
DistributedIntervalFacetingTest, SolrTestCaseJ4Test, 
TestHighlightDedupGrouping, TestTolerantSearch, TestJettySolrRunner, 
ActionThrottleTest, AsyncMigrateRouteKeyTest, BaseCdcrDistributedZkTest, 
CdcrRequestHandlerTest, CdcrVersionReplicationTest, CleanupOldIndexTest, 
CloudExitableDirectoryReaderTest, CollectionReloadTest, 
CollectionStateFormat2Test, CollectionTooManyReplicasTest, 
CollectionsAPIAsyncDistributedZkTest, CollectionsAPISolrJTest, 
ConfigSetsAPITest, CreateCollectionCleanupTest, CustomCollectionTest, 
DeleteInactiveReplicaTest, LeaderInitiatedRecoveryOnShardRestartTest, 
MigrateRouteKeyTest, OverriddenZkACLAndCredentialsProvidersTest, 
OverseerModifyCollectionTest, OverseerStatusTest, OverseerTaskQueueTest, 
RecoveryAfterSoftCommitTest, SSLMigrationTest, 
SharedFSAutoReplicaFailoverUtilsTest, SolrCLIZkUtilsTest, SolrXmlInZkTest, 
TestAuthenticationFramework, TestCloudInspectUtil, TestConfigSetsAPI, 
TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, 
TestLeaderInitiatedRecoveryThread, TestMiniSolrCloudCluster, 
TestMiniSolrCloudClusterBase, TestRandomFlRTGCloud, 
HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=HdfsCollectionsAPIDistributedZkTest -Dtests.seed=BE4D33B4F2BAC88B 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/test-data/enwiki.random.lines.txt
 -Dtests.locale=pl-PL -Dtests.timezone=Etc/GMT-5 -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J2 | HdfsCollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE 
scope at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest: 
   [junit4]    >    1) Thread[id=49970, name=searcherExecutor-13159-thread-1, 
state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=49845, name=searcherExecutor-13126-thread-1, 
state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=49955, name=searcherExecutor-13147-thread-1, 
state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=49970, name=searcherExecutor-13159-thread-1, 
state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=49845, name=searcherExecutor-13126-thread-1, 
state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=49955, name=searcherExecutor-13147-thread-1, 
state=WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([BE4D33B4F2BAC88B]:0)
   [junit4] Completed [629/629 (7!)] on J2 in 1641.55s, 1 test, 3 errors <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J2: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/solr/build/solr-core/test/temp/junit4-J2-20160915_184038_581.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/heapdumps/java_pid27592.hprof
 ...
   [junit4] Heap dump file created [607450072 bytes in 13.365 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 11040 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/build.xml:771:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.2/checkout/build.xml:715:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid27592.hprof

Total time: 415 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to