[JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 92 - Still Failing

[Apache Jenkins Server]

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/92/

4 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
3 threads leaked from SUITE scope at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=17183, 
name=searcherExecutor-7588-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=17205, 
name=searcherExecutor-7595-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=17185, 
name=searcherExecutor-7587-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE 
scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=17183, name=searcherExecutor-7588-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=17205, name=searcherExecutor-7595-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=17185, name=searcherExecutor-7587-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([1FFBB8E7E55C78D]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=17183, name=searcherExecutor-7588-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=17205, 
name=searcherExecutor-7595-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=17185, 
name=searcherExecutor-7587-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=17183, name=searcherExecutor-7588-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=17205, name=searcherExecutor-7595-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=17185, name=searcherExecutor-7587-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([1FFBB8E7E55C78D]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 3 object(s) that were not released!!! [NRTCachingDirectory, 
NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not 
released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
        at __randomizedtesting.SeedInfo.seed([1FFBB8E7E55C78D]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:257)
        at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: 
http://127.0.0.1:33505/yo_/m

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: http://127.0.0.1:33505/yo_/m
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:601)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:399)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:515)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:495)
        ... 47 more




Build Log:
[...truncated 11909 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/init-core-data-001
   [junit4]   2> 1528162 INFO  
(SUITE-TestReplicationHandler-seed#[1FFBB8E7E55C78D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 1528164 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting doTestDetails
   [junit4]   2> 1528164 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1
   [junit4]   2> 1528166 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1528190 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@84792de{/solr,null,AVAILABLE}
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@4e846cab{HTTP/1.1,[http/1.1]}{127.0.0.1:51560}
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.Server Started @1530951ms
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1/data,
 hostContext=/solr, hostPort=51560}
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001'
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 1528191 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/solr.xml
   [junit4]   2> 1528195 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/.
   [junit4]   2> 1528195 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 2137107621
   [junit4]   2> 1528195 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001]
   [junit4]   2> 1528195 WARN  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/lib
   [junit4]   2> 1528195 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1528196 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1528196 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1528196 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1528196 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 1528196 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1528197 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Looking for core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/.
   [junit4]   2> 1528221 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1528221 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1
   [junit4]   2> 1528222 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1528229 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1'
   [junit4]   2> 1528231 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1528231 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 1528236 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1528238 WARN  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use 
<mergePolicyFactory> instead.
   [junit4]   2> 1528238 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
   [junit4]   2> 1528257 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0
   [junit4]   2> 1528257 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1528288 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1528290 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1528291 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1528292 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1'
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: 
collection1
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1/data
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1/data/index/
   [junit4]   2> 1528293 WARN  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1528293 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 1528294 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=25, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=35.166015625, 
floorSegmentMB=1.0859375, forceMergeDeletesPctAllowed=6.536182373246441, 
segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.31723272551154114
   [junit4]   2> 1528301 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_1,generation=1}
   [junit4]   2> 1528301 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1528303 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 1528305 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1528306 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1528306 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1528307 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1528307 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with 
startup=lazy 
   [junit4]   2> 1528307 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1528307 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1528307 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/./collection1/data/
   [junit4]   2> 1528309 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1528309 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1528309 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=42, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=57.4521484375, 
floorSegmentMB=1.6123046875, forceMergeDeletesPctAllowed=16.011373366428593, 
segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1528309 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_1,generation=1}
   [junit4]   2> 1528309 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1528309 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2d22bafd[collection1] main]
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to 
use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1/conf
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: 
{storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1/conf}
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-001/collection1/conf
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following 
config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1528310 INFO  (coreLoadExecutor-3385-thread-1) [    
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1528310 INFO  
(searcherExecutor-3386-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@2d22bafd[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1528789 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1
   [junit4]   2> 1528791 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1528799 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@22eb2ce8{/solr,null,AVAILABLE}
   [junit4]   2> 1528799 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@123c7800{HTTP/1.1,[http/1.1]}{127.0.0.1:55946}
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.Server Started @1531560ms
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1/data,
 hostContext=/solr, hostPort=55946}
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002'
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 1528800 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/solr.xml
   [junit4]   2> 1528812 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/.
   [junit4]   2> 1528813 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1833238006
   [junit4]   2> 1528813 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002]
   [junit4]   2> 1528813 WARN  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/lib
   [junit4]   2> 1528825 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1528825 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1528826 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1528826 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1528826 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 1528826 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1528826 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Looking for core definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/.
   [junit4]   2> 1528827 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1528827 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1
   [junit4]   2> 1528827 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1528827 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1'
   [junit4]   2> 1528830 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0
   [junit4]   2> 1528883 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1528883 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1528883 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 1529025 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1529028 WARN  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use 
<mergePolicyFactory> instead.
   [junit4]   2> 1529029 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
   [junit4]   2> 1529078 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1529081 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1529083 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1529084 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1'
   [junit4]   2> 1529084 INFO  (coreLoadExecutor-3395-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1
   [junit4]   2> 1529085 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1529085 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 1529085 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: 
collection1
   [junit4]   2> 1529085 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data
   [junit4]   2> 1529085 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 1529085 WARN  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1529085 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 1529086 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=25, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=35.166015625, 
floorSegmentMB=1.0859375, forceMergeDeletesPctAllowed=6.536182373246441, 
segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.31723272551154114
   [junit4]   2> 1529086 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_1,generation=1}
   [junit4]   2> 1529086 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1529087 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 1529088 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1529088 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1529089 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1529089 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1529090 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with 
startup=lazy 
   [junit4]   2> 1529090 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1529090 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1529090 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1529090 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1529091 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1529091 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=42, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=57.4521484375, 
floorSegmentMB=1.6123046875, forceMergeDeletesPctAllowed=16.011373366428593, 
segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1529097 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_1,generation=1}
   [junit4]   2> 1529097 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1529097 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@6c7b93c2[collection1] main]
   [junit4]   2> 1529097 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to 
use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1/conf
   [junit4]   2> 1529097 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: 
{storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1/conf}
   [junit4]   2> 1529098 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/collection1/conf
   [junit4]   2> 1529098 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1529099 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 
1000ms
   [junit4]   2> 1529099 INFO  (coreLoadExecutor-3395-thread-1) [    
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1529099 INFO  
(searcherExecutor-3396-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@6c7b93c2[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1529390 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/select 
params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1529396 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=0
   [junit4]   2> 1529401 INFO  (qtp1088703905-57139) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={slave=false&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=0
   [junit4]   2> 1529401 INFO  (qtp429975874-57152) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=1
   [junit4]   2> 1529404 INFO  (qtp1088703905-57138) [    x:collection1] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[0]} 0 0
   [junit4]   2> 1529405 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1529411 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_1,generation=1}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_2,generation=2}
   [junit4]   2> 1529412 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 1529412 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@1020205a[collection1] main]
   [junit4]   2> 1529412 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1529412 INFO  
(searcherExecutor-3386-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@1020205a[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.0):c1)))}
   [junit4]   2> 1529412 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update 
params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 7
   [junit4]   2> 1529421 WARN  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication 
suffix
   [junit4]   2> 1529433 INFO  (qtp1088703905-57133) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 1529433 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 1529433 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1529433 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1529436 INFO  (qtp1088703905-57133) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} 
status=0 QTime=1
   [junit4]   2> 1529436 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Number of files in latest index in master: 4
   [junit4]   2> 1529437 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426364
   [junit4]   2> 1529437 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
   [junit4]   2> 1529437 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=30, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=14.9169921875, 
floorSegmentMB=0.2939453125, forceMergeDeletesPctAllowed=10.550046291928554, 
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_1,generation=1}
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_1,generation=1}
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
   [junit4]   2> 1529438 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Starting download (fullCopy=false) to 
RawDirectoryWrapper(RAMDirectory@233131fd 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b132e28)
   [junit4]   2> 1529440 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.cfe&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529442 INFO  (qtp1088703905-57139) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529451 INFO  (qtp1088703905-57138) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=_0.cfs&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529457 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529460 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Total time taken for download 
(fullCopy=false,bytesDownloaded=1892) : 0 secs (null bytes/sec) to 
RawDirectoryWrapper(RAMDirectory@233131fd 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b132e28)
   [junit4]   2> 1529465 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=91.087890625, 
floorSegmentMB=0.3193359375, forceMergeDeletesPctAllowed=12.151053059635057, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5269699564380959
   [junit4]   2> 1529466 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_1,generation=1}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_2,generation=2}
   [junit4]   2> 1529466 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 1529466 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1529466 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@568bb55a[collection1] main]
   [junit4]   2> 1529466 INFO  
(searcherExecutor-3396-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@568bb55a[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.0):c1)))}
   [junit4]   2> 1529469 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426364
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426364;done=true>>]
   [junit4]   2> 1529469 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory Closing directory, 
CoreContainer#isShutdown=false
   [junit4]   2> 1529469 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426364
   [junit4]   2> 1529469 INFO  (qtp429975874-57150) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={wait=true&masterUrl=http://127.0.0.1:51560/solr/collection1/replication&command=fetchindex}
 status=0 QTime=55
   [junit4]   2> 1529473 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={slave=false&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=0
   [junit4]   2> 1529473 INFO  (qtp429975874-57153) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=2
   [junit4]   2> 1529475 INFO  (qtp1088703905-57137) [    x:collection1] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 1529477 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1529478 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_2,generation=2}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_3,generation=3}
   [junit4]   2> 1529478 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 3
   [junit4]   2> 1529478 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@5833e34c[collection1] main]
   [junit4]   2> 1529479 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1529479 INFO  
(searcherExecutor-3386-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@5833e34c[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.0):c1)
 Uninverting(_1(6.2.0):c1)))}
   [junit4]   2> 1529479 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update 
params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 1
   [junit4]   2> 1529581 WARN  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication 
suffix
   [junit4]   2> 1529583 INFO  (qtp1088703905-57133) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 1529583 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Master's generation: 3
   [junit4]   2> 1529583 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1529583 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1529585 INFO  (qtp1088703905-57133) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=3&qt=/replication&wt=javabin&version=2&command=filelist} 
status=0 QTime=0
   [junit4]   2> 1529585 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Number of files in latest index in master: 7
   [junit4]   2> 1529585 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426513
   [junit4]   2> 1529585 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
   [junit4]   2> 1529586 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=30, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=14.9169921875, 
floorSegmentMB=0.2939453125, forceMergeDeletesPctAllowed=10.550046291928554, 
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_2,generation=2}
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_2,generation=2}
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Starting download (fullCopy=false) to 
RawDirectoryWrapper(RAMDirectory@21e201df 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@152d7215)
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _0.cfe because it already exists
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _0.si because it already exists
   [junit4]   2> 1529587 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _0.cfs because it already exists
   [junit4]   2> 1529589 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=3&qt=/replication&file=_1.cfs&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529728 INFO  (qtp1088703905-57132) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=3&qt=/replication&file=_1.cfe&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529731 INFO  (qtp1088703905-57137) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=3&qt=/replication&file=_1.si&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529733 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=3&qt=/replication&file=segments_3&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529734 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Total time taken for download 
(fullCopy=false,bytesDownloaded=1955) : 0 secs (null bytes/sec) to 
RawDirectoryWrapper(RAMDirectory@21e201df 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@152d7215)
   [junit4]   2> 1529735 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=91.087890625, 
floorSegmentMB=0.3193359375, forceMergeDeletesPctAllowed=12.151053059635057, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5269699564380959
   [junit4]   2> 1529739 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_2,generation=2}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_3,generation=3}
   [junit4]   2> 1529739 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 3
   [junit4]   2> 1529739 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1529740 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@70e592be[collection1] main]
   [junit4]   2> 1529740 INFO  
(searcherExecutor-3396-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@70e592be[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.0):c1)
 Uninverting(_1(6.2.0):c1)))}
   [junit4]   2> 1529740 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426513
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426513;done=true>>]
   [junit4]   2> 1529740 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory Closing directory, 
CoreContainer#isShutdown=false
   [junit4]   2> 1529740 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426513
   [junit4]   2> 1529740 INFO  (qtp429975874-57155) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={wait=true&masterUrl=http://127.0.0.1:51560/solr/collection1/replication&command=fetchindex}
 status=0 QTime=261
   [junit4]   2> 1529744 INFO  (qtp1088703905-57138) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={slave=false&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=0
   [junit4]   2> 1529744 INFO  (qtp429975874-57156) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} 
status=0 QTime=1
   [junit4]   2> 1529746 INFO  (qtp1088703905-57139) [    x:collection1] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 1529749 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.u.DirectUpdateHandler2 start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1529754 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=3
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_2,generation=2}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_3,generation=3}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3829574b 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b09f379),segFN=segments_4,generation=4}
   [junit4]   2> 1529754 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 4
   [junit4]   2> 1529754 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@1a4140c1[collection1] main]
   [junit4]   2> 1529754 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1529754 INFO  
(searcherExecutor-3386-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@1a4140c1[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.0):c1)
 Uninverting(_1(6.2.0):c1) Uninverting(_2(6.2.0):c1)))}
   [junit4]   2> 1529754 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update 
params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 5
   [junit4]   2> 1529769 WARN  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication 
suffix
   [junit4]   2> 1529773 INFO  (qtp1088703905-57133) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 
QTime=0
   [junit4]   2> 1529774 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Master's generation: 4
   [junit4]   2> 1529774 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Slave's generation: 3
   [junit4]   2> 1529774 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1529776 INFO  (qtp1088703905-57133) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=4&qt=/replication&wt=javabin&version=2&command=filelist} 
status=0 QTime=0
   [junit4]   2> 1529776 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Number of files in latest index in master: 10
   [junit4]   2> 1529776 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426704
   [junit4]   2> 1529776 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
   [junit4]   2> 1529776 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=30, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=14.9169921875, 
floorSegmentMB=0.2939453125, forceMergeDeletesPctAllowed=10.550046291928554, 
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_3,generation=3}
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 3
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_3,generation=3}
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 3
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState Rollback old IndexWriter... core=collection1
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Starting download (fullCopy=false) to 
RawDirectoryWrapper(RAMDirectory@266557b2 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7578938e)
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _0.cfe because it already exists
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _0.si because it already exists
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _0.cfs because it already exists
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _1.cfs because it already exists
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _1.cfe because it already exists
   [junit4]   2> 1529777 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Skipping download for _1.si because it already exists
   [junit4]   2> 1529779 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=4&qt=/replication&file=_2.si&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529798 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=4&qt=/replication&file=_2.cfe&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529800 INFO  (qtp1088703905-57134) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=4&qt=/replication&file=_2.cfs&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529802 INFO  (qtp1088703905-57136) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={generation=4&qt=/replication&file=segments_4&checksum=true&wt=filestream&command=filecontent}
 status=0 QTime=0
   [junit4]   2> 1529802 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.h.IndexFetcher Total time taken for download 
(fullCopy=false,bytesDownloaded=2018) : 0 secs (null bytes/sec) to 
RawDirectoryWrapper(RAMDirectory@266557b2 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7578938e)
   [junit4]   2> 1529803 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=21, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=91.087890625, 
floorSegmentMB=0.3193359375, forceMergeDeletesPctAllowed=12.151053059635057, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.5269699564380959
   [junit4]   2> 1529803 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_3,generation=3}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@502f413d 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2904dae1),segFN=segments_4,generation=4}
   [junit4]   2> 1529803 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.SolrDeletionPolicy newest commit generation = 4
   [junit4]   2> 1529803 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1529804 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@7906da3[collection1] main]
   [junit4]   2> 1529804 INFO  
(searcherExecutor-3396-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@7906da3[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.0):c1)
 Uninverting(_1(6.2.0):c1) Uninverting(_2(6.2.0):c1)))}
   [junit4]   2> 1529804 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory looking to close 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426704
 
[CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426704;done=true>>]
   [junit4]   2> 1529804 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory Closing directory, 
CoreContainer#isShutdown=false
   [junit4]   2> 1529804 INFO  (explicit-fetchindex-cmd) [    x:collection1] 
o.a.s.c.CachingDirectoryFactory Closing directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-002/./collection1/data/index.20160614022426704
   [junit4]   2> 1529804 INFO  (qtp429975874-57149) [    x:collection1] 
o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication 
params={wait=true&masterUrl=http://127.0.0.1:51560/solr/collection1/replication&command=fetchindex}
 status=0 QTime=49
   [junit4]   2> 1529805 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-003/collection1
   [junit4]   2> 1529807 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1529849 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2780f39e{/solr,null,AVAILABLE}
   [junit4]   2> 1529849 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@254f128a{HTTP/1.1,[http/1.1]}{127.0.0.1:39344}
   [junit4]   2> 1529849 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.e.j.s.Server Started @1532610ms
   [junit4]   2> 1529849 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-003/collection1/data,
 hostContext=/solr, hostPort=39344}
   [junit4]   2> 1529850 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1529850 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_1FFBB8E7E55C78D-001/solr-instance-003'
   [junit4]   2> 1529850 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1529850 INFO  
(TEST-TestReplicationHandler.doTestDetails-seed#[1FFBB8E7E55C78D]) [ 

[...truncated too long message...]

assicSimilarityFactory, SliceStateTest, PluginInfoTest, 
DirectSolrConnectionTest, BadCopyFieldTest, NoCacheHeaderTest, 
CollectionsAPISolrJTest, SuggesterWFSTTest, ShardSplitTest, 
PrimitiveFieldTypeTest, DocValuesMultiTest, TestSweetSpotSimilarityFactory, 
QueryParsingTest, ShowFileRequestHandlerTest, CoreMergeIndexesAdminHandlerTest, 
TestSchemaResource, TestExtendedDismaxParser, TestFuzzyAnalyzedSuggestions, 
TestSmileRequest, BinaryUpdateRequestHandlerTest, TestRecovery, 
CollectionStateFormat2Test, TestStandardQParsers, TestCloudInspectUtil, 
BlockJoinFacetDistribTest, XmlUpdateRequestHandlerTest, ScriptEngineTest, 
TestSolrQueryParser, HdfsDirectoryFactoryTest, TestInitParams, 
FullSolrCloudDistribCmdsTest, TestNamedUpdateProcessors, 
TestSerializedLuceneMatchVersion, DistributedFacetPivotLargeTest, 
TestCustomSort, TestDefaultStatsCache, DistributedFacetPivotSmallTest, 
SampleTest, DistributedVersionInfoTest, TestUseDocValuesAsStored, 
RecoveryZkTest, TestExactStatsCache, TestUniqueKeyFieldResource, 
SpatialHeatmapFacetsTest, DebugComponentTest, DeleteInactiveReplicaTest, 
StatsComponentTest, TestReversedWildcardFilterFactory, 
TestAuthenticationFramework, TestFieldTypeCollectionResource, TestSolrJ, 
FieldAnalysisRequestHandlerTest, TestGroupingSearch, 
BigEndianAscendingWordSerializerTest, TestPostingsSolrHighlighter, 
GraphQueryTest, TestSort, TestIndexingPerformance, CdcrRequestHandlerTest, 
SparseHLLTest, TestConfigReload, TestCoreDiscovery, SuggesterTSTTest, 
TestSolrXml, LeaderFailoverAfterPartitionTest, ConnectionManagerTest, 
SpatialRPTFieldTypeTest, TermVectorComponentDistributedTest, 
HardAutoCommitTest, RemoteQueryErrorTest, SegmentsInfoRequestHandlerTest, 
TestRuleBasedAuthorizationPlugin, TestJmxMonitoredMap, 
ConjunctionSolrSpellCheckerTest, TestExclusionRuleCollectionAccess, 
BlockCacheTest, TestZkChroot, TestJettySolrRunner, UnloadDistributedZkTest, 
CollectionsAPIDistributedZkTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=CollectionsAPIDistributedZkTest -Dtests.seed=1FFBB8E7E55C78D 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=es-VE -Dtests.timezone=Arctic/Longyearbyen -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | CollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE 
scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   [junit4]    >    1) Thread[id=17183, name=searcherExecutor-7588-thread-1, 
state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=17205, name=searcherExecutor-7595-thread-1, 
state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=17185, name=searcherExecutor-7587-thread-1, 
state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([1FFBB8E7E55C78D]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=17183, name=searcherExecutor-7588-thread-1, 
state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=17205, name=searcherExecutor-7595-thread-1, 
state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=17185, name=searcherExecutor-7587-thread-1, 
state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([1FFBB8E7E55C78D]:0)
   [junit4] Completed [298/615 (2!)] on J2 in 446.67s, 1 test, 3 errors <<< 
FAILURES!

[...truncated 976 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:531:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1427:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:984:
 There were test failures: 615 suites (10 ignored), 2590 tests, 3 suite-level 
errors, 1 error, 1206 ignored (12 assumptions) [seed: 1FFBB8E7E55C78D]

Total time: 238 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org