Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.4/19/
2 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=57588, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=57588, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45004: collection already exists: awholynewstresscollection_collection1_0 at __randomizedtesting.SeedInfo.seed([4A69FD110D0318D]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881) FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR Error Message: There are still nodes recoverying - waited for 330 seconds Stack Trace: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds at __randomizedtesting.SeedInfo.seed([4A69FD110D0318D:DA2CF1AC2B72537E]:0) at org.junit.Assert.fail(Assert.java:93) at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175) at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:136) at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:831) at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:964) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:939) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 10575 lines...] [junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/init-core-data-001 [junit4] 2> 810505 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[4A69FD110D0318D]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /o_pbh/bk [junit4] 2> 810510 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 810510 INFO (Thread-2212) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 810510 INFO (Thread-2212) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 810610 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ZkTestServer start zk server on port:34174 [junit4] 2> 810610 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 810611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 810615 INFO (zkCallback-297-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1858957f name:ZooKeeperConnection Watcher:127.0.0.1:34174 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 810615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 810615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 810616 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 810619 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 810620 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 810622 INFO (zkCallback-298-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@429e89ff name:ZooKeeperConnection Watcher:127.0.0.1:34174/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 810622 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 810622 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 810622 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 810625 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 810627 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 810628 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 810630 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 810630 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 810633 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 810633 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 810635 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 810635 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 810637 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 810638 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 810639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 810639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 810641 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 810641 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 810643 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 810643 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 810645 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 810645 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 810647 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 810647 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 810648 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 810649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 810650 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 810650 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 810747 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1 [junit4] 2> 810748 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730 [junit4] 2> 810750 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@61eda475{/o_pbh/bk,null,AVAILABLE} [junit4] 2> 810754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5ea9ef1a{HTTP/1.1}{127.0.0.1:58201} [junit4] 2> 810754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.Server Started @814300ms [junit4] 2> 810754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/tempDir-001/control/data, hostPort=58201, hostContext=/o_pbh/bk, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores} [junit4] 2> 810755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641 [junit4] 2> 810755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001' [junit4] 2> 810755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 810755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 810755 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 810756 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 810757 INFO (zkCallback-299-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c45da4f name:ZooKeeperConnection Watcher:127.0.0.1:34174/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 810757 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 810758 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 810759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 810759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/solr.xml [junit4] 2> 810774 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores [junit4] 2> 810775 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CoreContainer New CoreContainer 813601407 [junit4] 2> 810775 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001] [junit4] 2> 810775 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/lib [junit4] 2> 810775 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 810776 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 810777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 810777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 810777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34174/solr [junit4] 2> 810777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 810777 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 810778 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 810779 INFO (zkCallback-301-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4af6ea8f name:ZooKeeperConnection Watcher:127.0.0.1:34174 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 810780 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 810780 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 810782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 810784 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40183543 name:ZooKeeperConnection Watcher:127.0.0.1:34174/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 810785 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 810786 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 810788 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 810791 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 810793 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 810795 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 810797 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 810799 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 810800 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 810801 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 810802 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58201_o_pbh%2Fbk [junit4] 2> 810802 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58201_o_pbh%2Fbk [junit4] 2> 810804 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 810806 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 810807 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 810808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000 [junit4] 2> 810808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58201_o_pbh%2Fbk [junit4] 2> 810808 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 810809 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer Overseer (id=95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) starting [junit4] 2> 810811 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 810818 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 810819 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 810819 INFO (OverseerCollectionConfigSetProcessor-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations [junit4] 2> 810819 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 810842 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 810842 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 810843 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores [junit4] 2> 810844 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {configSetProperties=configsetprops.json, dataDir=data/, shard=, name=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/, collection=control_collection, schema=schema.xml, config=solrconfig.xml, transient=false, loadOnStartup=true, coreNodeName=, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1} [junit4] 2> 810844 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/ [junit4] 2> 810844 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.CorePropertiesLocator Found 1 core definitions [junit4] 2> 810845 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2 [junit4] 2> 810845 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 810846 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 810846 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 810848 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:58201_o_pbh%2Fbk", [junit4] 2> "base_url":"http://127.0.0.1:58201/o_pbh/bk";, [junit4] 2> "numShards":"1", [junit4] 2> "collection":"control_collection", [junit4] 2> "core":"collection1"} current state version: 0 [junit4] 2> 810848 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:58201_o_pbh%2Fbk", [junit4] 2> "base_url":"http://127.0.0.1:58201/o_pbh/bk";, [junit4] 2> "numShards":"1", [junit4] 2> "collection":"control_collection", [junit4] 2> "core":"collection1"} [junit4] 2> 810849 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 810849 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 810849 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 810851 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 811849 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 811849 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 811850 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 811850 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 811851 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 811851 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1' [junit4] 2> 811851 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 811851 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 811853 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 811865 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 811880 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.4.1 [junit4] 2> 811921 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml [junit4] 2> 811929 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 812175 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 812182 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 812184 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 812193 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 812196 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 812201 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 812202 WARN (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 812202 WARN (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 812202 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 812203 WARN (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 812203 WARN (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 812204 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2 [junit4] 2> 812204 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 812205 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory [junit4] 2> 812205 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1], dataDir=[null] [junit4] 2> 812205 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@74e6cbcd [junit4] 2> 812206 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/data [junit4] 2> 812206 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/data/index/ [junit4] 2> 812206 WARN (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index... [junit4] 2> 812206 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/data/index [junit4] 2> 812206 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=5, maxMergedSegmentMB=90.5849609375, floorSegmentMB=0.525390625, forceMergeDeletesPctAllowed=13.990931011606547, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4311583666984832 [junit4] 2> 812207 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@f28f07b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@48c42303),segFN=segments_1,generation=1} [junit4] 2> 812207 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 [junit4] 2> 812207 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/data/ [junit4] 2> 812208 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories. [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 812212 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 812213 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 812213 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 812213 WARN (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 812216 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 812217 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 812218 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 812219 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 812223 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/logging,/admin/ping,/admin/segments,/admin/plugins,standard,/admin/file,/replication,/admin/system,/config,/admin/mbeans,/dump,/update/json,/update,/update/csv,/schema,/update/json/docs,/get,/admin/threads,/admin/luke,/admin/properties [junit4] 2> 812225 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 812225 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 812225 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 812226 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 812226 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 812226 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1648139133, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1] [junit4] 2> 812227 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@f28f07b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@48c42303),segFN=segments_1,generation=1} [junit4] 2> 812227 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 [junit4] 2> 812227 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@633f647d[collection1] main [junit4] 2> 812227 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 812228 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 812228 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 812228 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 812228 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 812228 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 812229 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 812229 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 812229 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 812229 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 812230 INFO (searcherExecutor-1497-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@633f647d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 812230 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 812230 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index [junit4] 2> 812230 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 812230 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523756610396094464 [junit4] 2> 812232 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1523756610396094464 [junit4] 2> 812232 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 812233 INFO (coreLoadExecutor-1496-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 812233 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:58201/o_pbh/bk collection:control_collection shard:shard1 [junit4] 2> 812234 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 812237 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95234788037099524-core_node1-n_0000000000 [junit4] 2> 812237 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 [junit4] 2> 812239 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 812239 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 812239 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58201/o_pbh/bk/collection1/ [junit4] 2> 812239 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 812239 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:58201/o_pbh/bk/collection1/ has no replicas [junit4] 2> 812239 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 812240 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 812243 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node [junit4] 2> 812245 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58201/o_pbh/bk/collection1/ shard1 [junit4] 2> 812245 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:58201/o_pbh/bk";, [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 1 [junit4] 2> 812347 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 812348 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 812349 INFO (zkCallback-302-thread-1-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 812350 INFO (zkCallback-304-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11f8d9eb name:ZooKeeperConnection Watcher:127.0.0.1:34174/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 812350 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 812350 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 812350 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 812353 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 812396 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:58201/o_pbh/bk/collection1/ and leader is http://127.0.0.1:58201/o_pbh/bk/collection1/ [junit4] 2> 812396 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58201/o_pbh/bk [junit4] 2> 812396 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 812396 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 812396 INFO (coreZkRegister-1490-thread-1-processing-r:core_node1 s:shard1 n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection x:collection1) [n:127.0.0.1:58201_o_pbh%2Fbk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 812399 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "shard":"shard1", [junit4] 2> "state":"active", [junit4] 2> "node_name":"127.0.0.1:58201_o_pbh%2Fbk", [junit4] 2> "base_url":"http://127.0.0.1:58201/o_pbh/bk";, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "numShards":"1", [junit4] 2> "collection":"control_collection", [junit4] 2> "core":"collection1"} current state version: 2 [junit4] 2> 812399 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "shard":"shard1", [junit4] 2> "state":"active", [junit4] 2> "node_name":"127.0.0.1:58201_o_pbh%2Fbk", [junit4] 2> "base_url":"http://127.0.0.1:58201/o_pbh/bk";, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "numShards":"1", [junit4] 2> "collection":"control_collection", [junit4] 2> "core":"collection1"} [junit4] 2> 812451 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores/collection1 [junit4] 2> 812452 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001 [junit4] 2> 812452 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730 [junit4] 2> 812454 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ec5f7c1{/o_pbh/bk,null,AVAILABLE} [junit4] 2> 812455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5c681ba5{HTTP/1.1}{127.0.0.1:44359} [junit4] 2> 812455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.e.j.s.Server Started @816001ms [junit4] 2> 812455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/o_pbh/bk, solrconfig=solrconfig.xml, hostPort=44359, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/tempDir-001/jetty1} [junit4] 2> 812455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641 [junit4] 2> 812455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001' [junit4] 2> 812456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 812456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 812456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 812457 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 812458 INFO (zkCallback-305-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@645c661b name:ZooKeeperConnection Watcher:127.0.0.1:34174/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 812458 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 812459 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 812460 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 812460 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/solr.xml [junit4] 2> 812476 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores [junit4] 2> 812476 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CoreContainer New CoreContainer 667384420 [junit4] 2> 812476 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001] [junit4] 2> 812476 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/lib [junit4] 2> 812476 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 812478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 812478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 812478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 812478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34174/solr [junit4] 2> 812478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 812478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 812479 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 812480 INFO (zkCallback-307-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@26c49e74 name:ZooKeeperConnection Watcher:127.0.0.1:34174 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 812481 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 812481 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 812484 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 812485 INFO (zkCallback-308-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@51fff0c0 name:ZooKeeperConnection Watcher:127.0.0.1:34174/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 812485 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 812490 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 812502 INFO (zkCallback-304-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 812502 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 812502 INFO (zkCallback-308-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 813496 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44359_o_pbh%2Fbk [junit4] 2> 813497 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44359_o_pbh%2Fbk [junit4] 2> 813498 INFO (zkCallback-304-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 813498 INFO (zkCallback-302-thread-2-processing-n:127.0.0.1:58201_o_pbh%2Fbk) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 813498 INFO (zkCallback-308-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 813500 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 813500 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95234788037099528-127.0.0.1:44359_o_pbh%2Fbk-n_0000000001 [junit4] 2> 813501 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000 to know if I could be the leader [junit4] 2> 813523 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 813523 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 813525 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores [junit4] 2> 813526 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {loadOnStartup=true, name=collection1, configSetProperties=configsetprops.json, dataDir=data/, config=solrconfig.xml, shard=, collection=collection1, transient=false, coreNodeName=, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores/collection1, schema=schema.xml, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores/collection1/} [junit4] 2> 813526 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_4A69FD110D0318D-001/shard-1-001/cores/collection1/ [junit4] 2> 813527 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.CorePropertiesLocator Found 1 core definitions [junit4] 2> 813529 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build/solr-core/test/J2 [junit4] 2> 813530 INFO (coreLoadExecutor-1507-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 813530 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[4A69FD110D0318D]) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 813530 INFO (coreLoadExecutor-1507-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 813532 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:44359_o_pbh%2Fbk", [junit4] 2> "base_url":"http://127.0.0.1:44359/o_pbh/bk";, [junit4] 2> "numShards":"1", [junit4] 2> "collection":"collection1", [junit4] 2> "core":"collection1"} current state version: 3 [junit4] 2> 813532 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "operation":"state", [junit4] 2> "roles":null, [junit4] 2> "shard":null, [junit4] 2> "state":"down", [junit4] 2> "node_name":"127.0.0.1:44359_o_pbh%2Fbk", [junit4] 2> "base_url":"http://127.0.0.1:44359/o_pbh/bk";, [junit4] 2> "numShards":"1", [junit4] 2> "collection":"collection1", [junit4] 2> "core":"collection1"} [junit4] 2> 813533 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 813533 INFO (OverseerStateUpdate-95234788037099524-127.0.0.1:58201_o_pbh%2Fbk-n_0000000000) [n:127.0.0.1:58201_o_pbh%2Fbk ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 813534 INFO (coreLoadExecutor-1507-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 813636 INFO (zkCallback-304-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 813636 INFO (zkCallback-308-thread-1-processing-n:127.0.0.1:44359_o_pbh%2Fbk) [n:127.0.0.1:44359_o_pbh%2Fbk ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged [...truncated too long message...] collection already exists: awholynewstresscollection_collection2_0 [junit4] > at __randomizedtesting.SeedInfo.seed([4A69FD110D0318D]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807) [junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=57587, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45004: collection already exists: awholynewstresscollection_collection0_0 [junit4] > at __randomizedtesting.SeedInfo.seed([4A69FD110D0318D]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807) [junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=57591, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45004: Could not find collection : awholynewstresscollection_collection4_0 [junit4] > at __randomizedtesting.SeedInfo.seed([4A69FD110D0318D]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807) [junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888) [junit4] 2> 3492316 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4A69FD110D0318D]-worker) [n:127.0.0.1:56469_ c:addReplicaColl s:shard1 r:core_node2 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: test params are: codec=Asserting(Lucene54): {a_i1=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), range_facet_l=PostingsFormat(name=Direct), text=PostingsFormat(name=MockRandom), range_facet_i_dv=PostingsFormat(name=Direct), range_facet_l_dv=FST50, other_tl1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), _version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), timestamp=PostingsFormat(name=Direct), intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=FST50}, docValues:{range_facet_i_dv=DocValuesFormat(name=Lucene54), range_facet_l_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Lucene54)}, sim=DefaultSimilarity, locale=sr_RS_#Latn, timezone=Iceland [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=1,free=226692200,total=482344960 [junit4] 2> NOTE: All tests run in this JVM: [TestSolr4Spatial, TestIBSimilarityFactory, DocumentAnalysisRequestHandlerTest, DeleteLastCustomShardedReplicaTest, TestSchemaManager, FileBasedSpellCheckerTest, TestSmileRequest, TestSimpleTrackingShardHandler, DefaultValueUpdateProcessorTest, ChangedSchemaMergeTest, ConnectionManagerTest, VMParamsZkACLAndCredentialsProvidersTest, StandardRequestHandlerTest, ExitableDirectoryReaderTest, AnalyticsMergeStrategyTest, DeleteShardTest, PeerSyncTest, DeleteInactiveReplicaTest, ReplicationFactorTest, EnumFieldTest, TestOmitPositions, AlternateDirectoryTest, TestSortByMinMaxFunction, TestRTGBase, TestFieldSortValues, QueryElevationComponentTest, DistributedFacetPivotSmallAdvancedTest, TestConfigSetsAPIExclusivity, PrimUtilsTest, OverseerCollectionConfigSetProcessorTest, TestCustomSort, TestDistributedSearch, TestReloadAndDeleteDocs, JsonLoaderTest, TestLRUCache, HdfsRecoveryZkTest, ParsingFieldUpdateProcessorsTest, TestEmbeddedSolrServerConstructors, TestSolrConfigHandler, TestShortCircuitedRequests, TestMacros, AnalysisAfterCoreReloadTest, IndexSchemaTest, DocValuesMissingTest, PolyFieldTest, IndexSchemaRuntimeFieldTest, QueryEqualityTest, TestPivotHelperCode, TestRawResponseWriter, DistribJoinFromCollectionTest, TestRandomFaceting, HdfsDirectoryFactoryTest, TestDynamicLoading, TestDocBasedVersionConstraints, URLClassifyProcessorTest, HdfsWriteToMultipleCollectionsTest, CachingDirectoryFactoryTest, XsltUpdateRequestHandlerTest, TestRangeQuery, ZkStateReaderTest, TestSchemaSimilarityResource, PingRequestHandlerTest, TestLMDirichletSimilarityFactory, TestRandomDVFaceting, ZkStateWriterTest, SolrRequestParserTest, TestRandomMergePolicy, TestBinaryField, TestFaceting, TestCSVLoader, TestValueSourceCache, TestInitParams, PreAnalyzedFieldTest, SynonymTokenizerTest, SignatureUpdateProcessorFactoryTest, TestLazyCores, TestManagedSynonymFilterFactory, SegmentsInfoRequestHandlerTest, CollectionReloadTest, TestExceedMaxTermLength, TestNRTOpen, TestShardHandlerFactory, TestReqParamsAPI, HdfsDirectoryTest, TestUniqueKeyFieldResource, RAMDirectoryFactoryTest, TestDynamicFieldCollectionResource, TestPseudoReturnFields, TestComponentsName, TestAuthorizationFramework, DistributedSpellCheckComponentTest, CollectionsAPIDistributedZkTest] [junit4] Completed [253/551] on J0 in 385.39s, 1 test, 1 error <<< FAILURES! [...truncated 1016 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:799: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:736: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/build.xml:233: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/solr/common-build.xml:526: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/lucene/common-build.xml:1452: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.4/lucene/common-build.xml:1006: There were test failures: 551 suites (7 ignored), 2179 tests, 1 error, 1 failure, 32 ignored (18 assumptions) [seed: 4A69FD110D0318D] Total time: 264 minutes 31 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
