Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/947/

4 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=20741, name=collection1, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=20741, name=collection1, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:55762/qs_yfn: collection already exists: 
awholynewstresscollection_collection1_0
        at __randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)


FAILED:  
org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR

Error Message:
We just added 2 docs, we should be able to find them expected:<2> but was:<0>

Stack Trace:
java.lang.AssertionError: We just added 2 docs, we should be able to find them 
expected:<2> but was:<0>
        at 
__randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A:520E721F86664C69]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at 
org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:118)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
timed out waiting for collection1 startAt time to exceed: Mon Feb 29 10:52:20 
IST 2016

Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to 
exceed: Mon Feb 29 10:52:20 IST 2016
        at 
__randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A:572F1CA4B8EC4729]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1419)
        at 
org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:771)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.handler.TestReplicationHandler.testRateLimitedReplication

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A:A106997B276AF77]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at 
org.apache.solr.handler.TestReplicationHandler.testRateLimitedReplication(TestReplicationHandler.java:1319)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10931 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/init-core-data-001
   [junit4]   2> 240246 INFO  
(SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[8C841C62BDC42E9A]-worker)
 [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system 
property: /ppjcd/
   [junit4]   2> 240249 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 240249 INFO  (Thread-632) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 240249 INFO  (Thread-632) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 240349 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ZkTestServer start zk server on port:47526
   [junit4]   2> 240350 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 240350 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 240353 INFO  (zkCallback-234-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@34b5632d 
name:ZooKeeperConnection Watcher:127.0.0.1:47526 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 240353 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 240354 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 240354 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 240356 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 240357 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 240358 INFO  (zkCallback-235-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b6d23d7 
name:ZooKeeperConnection Watcher:127.0.0.1:47526/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 240358 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 240358 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 240358 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 240360 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 240361 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 240362 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 240364 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 240364 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 240366 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 240366 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 240368 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 240368 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 240370 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 240370 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 240371 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 240372 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 240373 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 240373 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 240375 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 240375 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 240376 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 240377 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 240378 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 240378 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 240380 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 240380 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 240381 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 240382 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 240478 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1
   [junit4]   2> 240480 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 240483 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@62ea4908{/ppjcd,null,AVAILABLE}
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.ServerConnector Started 
ServerConnector@33a19c94{HTTP/1.1,[http/1.1]}{127.0.0.1:43524}
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.Server Started @243626ms
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/tempDir-001/control/data,
 hostContext=/ppjcd, hostPort=43524, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores}
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001'
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr 
(NoInitialContextEx)
   [junit4]   2> 240488 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not 
find system property or JNDI)
   [junit4]   2> 240489 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 240489 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 240491 INFO  (zkCallback-236-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@38d5dab2 
name:ZooKeeperConnection Watcher:127.0.0.1:47526/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 240491 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 240491 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 240492 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 240492 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/solr.xml
   [junit4]   2> 240498 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores
   [junit4]   2> 240498 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CoreContainer New CoreContainer 1103288690
   [junit4]   2> 240498 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001]
   [junit4]   2> 240499 WARN  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/lib
   [junit4]   2> 240499 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 
20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 
2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : 
false,useRetries : false,
   [junit4]   2> 240500 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 240501 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 240501 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 240501 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47526/solr
   [junit4]   2> 240501 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 240501 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 240501 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 240503 INFO  (zkCallback-239-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@182c3b97 
name:ZooKeeperConnection Watcher:127.0.0.1:47526 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 240503 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 240504 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 240505 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ConnectionManager Waiting for client 
to connect to ZooKeeper
   [junit4]   2> 240509 INFO  
(zkCallback-240-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1218501c 
name:ZooKeeperConnection Watcher:127.0.0.1:47526/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 240509 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 240510 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 240512 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 240522 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 240523 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 240525 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 240527 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 240528 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 240530 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/clusterstate.json
   [junit4]   2> 240531 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 240532 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 240535 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 240536 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 240537 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000
   [junit4]   2> 240537 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:43524_ppjcd
   [junit4]   2> 240537 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 240549 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer Overseer 
(id=95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) starting
   [junit4]   2> 240551 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 240557 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 240557 INFO  
(OverseerCollectionConfigSetProcessor-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000)
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 240557 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 240557 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer Starting to work on the main 
queue
   [junit4]   2> 240559 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 240561 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:43524_ppjcd
   [junit4]   2> 240561 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:43524_ppjcd
   [junit4]   2> 240562 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 240562 INFO  
(zkCallback-240-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 240563 INFO  
(zkCallback-240-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 240572 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 240572 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 240573 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores
   [junit4]   2> 240575 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 240575 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.CorePropertiesLocator Found core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1
   [junit4]   2> 240575 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.c.CorePropertiesLocator Found 1 core 
definitions
   [junit4]   2> 240576 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 240576 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:43524_ppjcd    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 240576 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 240576 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 240578 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ZkController look for our core node name
   [junit4]   2> 240578 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43524/ppjcd";,
   [junit4]   2>   "node_name":"127.0.0.1:43524_ppjcd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 240579 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43524/ppjcd";,
   [junit4]   2>   "node_name":"127.0.0.1:43524_ppjcd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 240579 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: control_collection
   [junit4]   2> 240580 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 240581 INFO  
(zkCallback-240-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 241579 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 241579 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 241579 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 241580 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 241580 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 241580 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1'
   [junit4]   2> 241581 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 241581 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 241582 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] o.a.s.c.Config 
loaded config solrconfig.xml with version 0 
   [junit4]   2> 241593 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 241596 WARN  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] o.a.s.c.Config 
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> 
instead.
   [junit4]   2> 241597 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 241606 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 241624 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 241707 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 241714 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 241715 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 241732 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 241734 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 241736 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 241737 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 241739 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 241739 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 241739 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
   [junit4]   2> 241745 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/]
   [junit4]   2> 241745 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@64e8ca08
   [junit4]   2> 241746 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data
   [junit4]   2> 241746 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/index/
   [junit4]   2> 241747 WARN  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 241747 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/index
   [junit4]   2> 241747 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=25, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=81.15234375, 
floorSegmentMB=0.5986328125, forceMergeDeletesPctAllowed=23.06874419921687, 
segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 241763 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: 
num=1
   [junit4]   2>        
commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 241763 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 241763 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/
   [junit4]   2> 241767 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 241767 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 241767 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 241767 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 241768 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 241768 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 241768 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 241768 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 241768 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 241768 WARN  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler 
{type = requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 241770 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 241771 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 241772 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 241773 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 241777 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 241778 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 241778 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 241778 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
numVersionBuckets=65536
   [junit4]   2> 241779 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 241779 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 241779 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.2878960390172626]
   [junit4]   2> 241780 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: 
num=1
   [junit4]   2>        
commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 241780 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 241780 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@4e36f1bf[collection1] main]
   [junit4]   2> 241781 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 241782 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 241782 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based 
storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 241782 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO 
with znodeBase: /configs/conf1
   [junit4]   2> 241782 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 241782 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 241783 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 241783 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 241783 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 241783 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 241784 INFO  
(searcherExecutor-635-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@4e36f1bf[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 241784 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed 
version buckets
   [junit4]   2> 241784 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 
65536 version buckets from index
   [junit4]   2> 241784 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed 
version bucket highest value from index
   [junit4]   2> 241784 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent 
updates, using new clock 1527497727234015232
   [junit4]   2> 241786 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with 
highest version 1527497727234015232
   [junit4]   2> 241787 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 241787 INFO  
(coreLoadExecutor-634-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 241788 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:43524/ppjcd 
collection:control_collection shard:shard1
   [junit4]   2> 241788 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 241791 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/95468607851659268-core_node1-n_0000000000
   [junit4]   2> 241792 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 
and weAreReplacement=false and leaderVoteWait=300000
   [junit4]   2> 241793 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 241793 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 241793 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:43524/ppjcd/collection1/
   [junit4]   2> 241793 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 241793 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:43524/ppjcd/collection1/ has no replicas
   [junit4]   2> 241794 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 241794 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 241796 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/control_collection/leaders/shard1/leader after winning as 
/collections/control_collection/leader_elect/shard1/election/95468607851659268-core_node1-n_0000000000
   [junit4]   2> 241798 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:43524/ppjcd/collection1/ shard1
   [junit4]   2> 241799 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:43524/ppjcd";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 241901 INFO  
(zkCallback-240-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 241949 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:43524/ppjcd/collection1/ and leader is 
http://127.0.0.1:43524/ppjcd/collection1/
   [junit4]   2> 241949 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43524/ppjcd
   [junit4]   2> 241950 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 241950 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
publishing state=active
   [junit4]   2> 241950 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 241951 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43524/ppjcd";,
   [junit4]   2>   "node_name":"127.0.0.1:43524_ppjcd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 241952 INFO  
(coreZkRegister-628-thread-1-processing-n:127.0.0.1:43524_ppjcd x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43524_ppjcd 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 241952 INFO  
(OverseerStateUpdate-95468607851659268-127.0.0.1:43524_ppjcd-n_0000000000) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43524/ppjcd";,
   [junit4]   2>   "node_name":"127.0.0.1:43524_ppjcd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 242054 INFO  
(zkCallback-240-thread-1-processing-n:127.0.0.1:43524_ppjcd) 
[n:127.0.0.1:43524_ppjcd    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 242077 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 242078 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 242079 INFO  (zkCallback-242-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@bf18309 name:ZooKeeperConnection 
Watcher:127.0.0.1:47526/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 242080 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 242080 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 242080 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 242081 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 242082 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause 
connection loss:false
   [junit4]   2> 242179 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001/cores/collection1
   [junit4]   2> 242180 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001
   [junit4]   2> 242182 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 242184 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6b244119{/ppjcd,null,AVAILABLE}
   [junit4]   2> 242185 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.ServerConnector Started 
ServerConnector@59e7ce11{HTTP/1.1,[http/1.1]}{127.0.0.1:36052}
   [junit4]   2> 242186 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.e.j.s.Server Started @245324ms
   [junit4]   2> 242186 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/tempDir-001/jetty1,
 solrconfig=solrconfig.xml, hostContext=/ppjcd, hostPort=36052, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001/cores}
   [junit4]   2> 242186 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 242186 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001'
   [junit4]   2> 242186 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr 
(NoInitialContextEx)
   [junit4]   2> 242186 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not 
find system property or JNDI)
   [junit4]   2> 242187 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 242187 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 242197 INFO  (zkCallback-243-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1cd416d8 
name:ZooKeeperConnection Watcher:127.0.0.1:47526/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 242198 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 242198 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 242199 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 242199 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001/solr.xml
   [junit4]   2> 242208 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001/cores
   [junit4]   2> 242208 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CoreContainer New CoreContainer 1997859431
   [junit4]   2> 242208 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001]
   [junit4]   2> 242208 WARN  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_8C841C62BDC42E9A-001/shard-1-001/lib
   [junit4]   2> 242209 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 
20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 
2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : 
false,useRetries : false,
   [junit4]   2> 242210 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 242211 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 242211 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 242211 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47526/solr
   [junit4]   2> 242211 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 242211 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 242211 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 242213 INFO  (zkCallback-246-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3b0894be 
name:ZooKeeperConnection Watcher:127.0.0.1:47526 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 242213 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 242214 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 242216 INFO  
(TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[8C841C62BDC42E9A])
 [n:127.0.0.1:36052_ppjcd    ] o.a.s.c.c.ConnectionManager Waiting for client 
to connect to ZooKeeper
   [junit4]   2> 242220 INFO  
(zkCallback-247-thread-1-processing-n:127.0.0.1:36052_ppjcd) 
[n:127.0.0.1:36052_ppjcd    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@49f795d2 
name:ZooKeeperConnection Watcher:127.0.0.1:47526/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 242221 INFO  (TEST-LeaderInitiatedRecoveryOnS

[...truncated too long message...]

aught exception in thread: Thread[id=20745, name=collection5, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:55762/qs_yfn: collection already exists: 
awholynewstresscollection_collection5_0
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable
 #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=20744, name=collection4, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:55762/qs_yfn: collection already exists: 
awholynewstresscollection_collection4_0
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable
 #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=20740, name=collection0, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:55762/qs_yfn: Could not find collection : 
awholynewstresscollection_collection0_0
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([8C841C62BDC42E9A]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
   [junit4]   2> 2181991 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[8C841C62BDC42E9A]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Feb 29, 2016 9:14:51 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: 
codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
 chunkSize=10, maxDocsPerChunk=7, blockSize=377), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
chunkSize=10, blockSize=377)), 
sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=da-DK, 
timezone=Etc/GMT+2
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_66 (64-bit)/cpus=4,threads=1,free=130724832,total=499646464
   [junit4]   2> NOTE: All tests run in this JVM: [MultiThreadedOCPTest, 
DistributedTermsComponentTest, TestSolrDeletionPolicy2, 
TestLMJelinekMercerSimilarityFactory, TermsComponentTest, 
TestSolrCoreProperties, SuggesterFSTTest, ShardRoutingTest, 
DocValuesMissingTest, TestMiniSolrCloudClusterSSL, 
LeaderInitiatedRecoveryOnCommitTest, TestShardHandlerFactory, 
TermVectorComponentTest, FileUtilsTest, DeleteStatusTest, 
SpellCheckCollatorTest, ConnectionManagerTest, LoggingHandlerTest, 
TestSortByMinMaxFunction, HdfsLockFactoryTest, HdfsUnloadDistributedZkTest, 
SSLMigrationTest, MoreLikeThisHandlerTest, TestExclusionRuleCollectionAccess, 
TestPartialUpdateDeduplication, ChaosMonkeySafeLeaderTest, 
TestSurroundQueryParser, SharedFSAutoReplicaFailoverTest, TestFastLRUCache, 
SmileWriterTest, TestQuerySenderListener, AliasIntegrationTest, 
CollectionsAPIAsyncDistributedZkTest, DirectSolrSpellCheckerTest, 
TestManagedSchemaFieldTypeResource, MultiTermTest, CachingDirectoryFactoryTest, 
ForceLeaderTest, SolrIndexConfigTest, HdfsChaosMonkeySafeLeaderTest, 
FastVectorHighlighterTest, DeleteLastCustomShardedReplicaTest, 
TestStressUserVersions, TestDistribIDF, BadCopyFieldTest, 
WrapperMergePolicyFactoryTest, TestDynamicLoading, TestFieldTypeResource, 
HdfsRecoverLeaseTest, CSVRequestHandlerTest, 
AddSchemaFieldsUpdateProcessorFactoryTest, TestQueryTypes, TestLRUStatsCache, 
ZkControllerTest, HighlighterTest, OpenExchangeRatesOrgProviderTest, 
MinimalSchemaTest, SolrIndexSplitterTest, TestBulkSchemaAPI, 
TestFilteredDocIdSet, TestSha256AuthenticationProvider, 
DistribJoinFromCollectionTest, HdfsSyncSliceTest, TestCodecSupport, 
TestPerFieldSimilarityWithDefaultOverride, TestConfigReload, 
ChaosMonkeyNothingIsSafeTest, CloudMLTQParserTest, TestBulkSchemaConcurrent, 
MergeStrategyTest, TestCloudInspectUtil, SolrPluginUtilsTest, 
TestQuerySenderNoQuery, SparseHLLTest, TestUniqueKeyFieldResource, 
TestTrackingShardHandlerFactory, TestStressVersions, ZkSolrClientTest, 
SpatialHeatmapFacetsTest, TestSerializedLuceneMatchVersion, SimplePostToolTest, 
DistributedIntervalFacetingTest, BigEndianAscendingWordSerializerTest, 
TestSimpleTrackingShardHandler, PreAnalyzedUpdateProcessorTest, TestSolrXml, 
TestCryptoKeys, TestScoreJoinQPNoScore, AnalyticsMergeStrategyTest, 
ConvertedLegacyTest, TestDFISimilarityFactory, OverseerTaskQueueTest, 
UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [237/581 (3!)] on J1 in 341.67s, 1 test, 1 error <<< 
FAILURES!

[...truncated 1106 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:747:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:684:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:524:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1457:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1014:
 There were test failures: 581 suites (8 ignored), 2349 tests, 1 error, 3 
failures, 33 ignored (17 assumptions) [seed: 8C841C62BDC42E9A]

Total time: 202 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to