Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/838/
2 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=44642, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=44642, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51980/iz: collection already exists: awholynewstresscollection_collection1_0 at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888) FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR Error Message: Captured an uncaught exception in thread: Thread[id=5349, name=coreZkRegister-1081-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5349, name=coreZkRegister-1081-thread-2, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] Caused by: java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0) at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2126) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:433) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113) at org.apache.solr.cloud.ZkController.register(ZkController.java:926) at org.apache.solr.cloud.ZkController.register(ZkController.java:881) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 10100 lines...] [junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/init-core-data-001 [junit4] 2> 379168 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[FADE41E91FCC5B43]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /lsql/n [junit4] 2> 379182 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 379185 INFO (Thread-3890) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 379186 INFO (Thread-3890) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 379285 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkTestServer start zk server on port:49195 [junit4] 2> 379286 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 379286 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 379295 INFO (zkCallback-233-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@fa5904 name:ZooKeeperConnection Watcher:127.0.0.1:49195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 379295 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 379296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 379296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 379299 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 379320 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 379321 INFO (zkCallback-234-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56a9664b name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 379322 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 379322 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 379322 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 379324 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 379325 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 379326 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 379327 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 379327 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 379341 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 379341 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 379358 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 379358 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 379359 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 379359 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 379360 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 379361 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 379362 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 379362 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 379363 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 379363 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 379365 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 379365 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 379367 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 379367 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 379369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 379369 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 379371 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 379372 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 379694 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1 [junit4] 2> 379695 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730 [junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20db55db{/lsql/n,null,AVAILABLE} [junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.ServerConnector Started ServerConnector@59f16bb9{HTTP/1.1}{127.0.0.1:54768} [junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server Started @382913ms [junit4] 2> 379697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/tempDir-001/control/data, hostContext=/lsql/n, hostPort=54768, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores} [junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a [junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/' [junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 379698 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 379713 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 379714 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 379719 INFO (zkCallback-235-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@721e0a44 name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 379719 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 379720 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 379720 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 379721 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/solr.xml [junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores [junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer New CoreContainer 1540021142 [junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/] [junit4] 2> 379725 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/lib [junit4] 2> 379726 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/lib). [junit4] 2> 379733 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49195/solr [junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 379734 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 379735 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 379736 INFO (zkCallback-237-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7061b95c name:ZooKeeperConnection Watcher:127.0.0.1:49195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 379737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 379737 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 379738 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 379739 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c6cb3dc name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 379739 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 379740 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 379742 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 379744 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 379746 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 379748 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 379749 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 379751 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 379752 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 379753 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 379753 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54768_lsql%2Fn [junit4] 2> 379754 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54768_lsql%2Fn [junit4] 2> 379756 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 379757 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 379758 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 379759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000 [junit4] 2> 379759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54768_lsql%2Fn [junit4] 2> 379759 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 379760 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer Overseer (id=94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) starting [junit4] 2> 379761 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 379766 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 379767 INFO (OverseerCollectionConfigSetProcessor-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations [junit4] 2> 379767 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 379767 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 379782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 379782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 379782 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores [junit4] 2> 379783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 379783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/ [junit4] 2> 379783 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 379785 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 379785 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 379788 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 379792 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 379792 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 379793 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n";, [junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 379793 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n";, [junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 379794 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 379794 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 379795 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 380788 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 380788 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 380789 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/' [junit4] 2> 380790 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 380790 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 380804 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 380809 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 380813 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0 [junit4] 2> 380821 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml [junit4] 2> 380821 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 380826 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 380915 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 380920 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 380921 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 380929 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 380931 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 380933 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 380934 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 380934 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 380934 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 380935 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 380935 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 380935 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory [junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/], dataDir=[null] [junit4] 2> 380936 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@64d74c9 [junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data [junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/index/ [junit4] 2> 380937 WARN (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index... [junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/index [junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@d1fe2b9 [junit4] 2> 380937 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@251aef8f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ce8f959),segFN=segments_1,generation=1} [junit4] 2> 380938 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 380938 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/ [junit4] 2> 380938 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories. [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 380942 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 380943 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 380945 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 380945 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 380946 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 380947 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 380950 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file [junit4] 2> 380950 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 380951 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 380951 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 380951 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled [junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled [junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=6, maxMergedSegmentMB=21.3740234375, floorSegmentMB=1.0869140625, forceMergeDeletesPctAllowed=23.03199811859806, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.865220202192173 [junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@251aef8f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ce8f959),segFN=segments_1,generation=1} [junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@160f8825[collection1] main [junit4] 2> 380952 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 380953 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 380954 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 380955 INFO (searcherExecutor-1044-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@160f8825[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index [junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 380955 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516543503236071424 [junit4] 2> 380957 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1516543503236071424 [junit4] 2> 380957 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 380957 INFO (coreLoadExecutor-1043-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 380958 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:54768/lsql/n collection:control_collection shard:shard1 [junit4] 2> 380959 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 380962 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94783968837107716-core_node1-n_0000000000 [junit4] 2> 380962 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 [junit4] 2> 380963 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 380964 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54768/lsql/n/collection1/ [junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54768/lsql/n/collection1/ has no replicas [junit4] 2> 380964 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54768/lsql/n/collection1/ shard1 [junit4] 2> 380965 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 380967 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node [junit4] 2> 380969 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n";, [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 1 [junit4] 2> 381071 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:54768/lsql/n/collection1/ and leader is http://127.0.0.1:54768/lsql/n/collection1/ [junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54768/lsql/n [junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 381120 INFO (coreZkRegister-1037-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54768_lsql%2Fn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 381122 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n";, [junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 2 [junit4] 2> 381122 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:54768/lsql/n";, [junit4] 2> "node_name":"127.0.0.1:54768_lsql%2Fn", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 381225 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 381294 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 381295 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 381296 INFO (zkCallback-240-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@643a1b36 name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 381296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 381296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 381296 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 381298 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 381606 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1 [junit4] 2> 381607 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001 [junit4] 2> 381609 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730 [junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ccebf9d{/lsql/n,null,AVAILABLE} [junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4921b96f{HTTP/1.1}{127.0.0.1:43086} [junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.e.j.s.Server Started @384827ms [junit4] 2> 381611 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/lsql/n, hostPort=43086, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores} [junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a [junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/' [junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 381615 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 381630 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 381632 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 381633 INFO (zkCallback-241-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5fc5117d name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 381633 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 381633 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 381634 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 381634 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/solr.xml [junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores [junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer New CoreContainer 1008133124 [junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/] [junit4] 2> 381639 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/lib [junit4] 2> 381640 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/lib). [junit4] 2> 381647 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 381648 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 381648 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49195/solr [junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 381649 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 381651 INFO (zkCallback-243-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7cd58078 name:ZooKeeperConnection Watcher:127.0.0.1:49195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 381651 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 381652 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 381653 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 381654 INFO (zkCallback-244-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e3d041 name:ZooKeeperConnection Watcher:127.0.0.1:49195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 381654 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 381659 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 382665 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43086_lsql%2Fn [junit4] 2> 382665 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43086_lsql%2Fn [junit4] 2> 382667 INFO (zkCallback-244-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 382667 INFO (zkCallback-240-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 382667 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1) [junit4] 2> 382668 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 382669 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94783968837107720-127.0.0.1:43086_lsql%2Fn-n_0000000001 [junit4] 2> 382670 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000 to know if I could be the leader [junit4] 2> 382694 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 382694 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 382695 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores [junit4] 2> 382696 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 382696 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_FADE41E91FCC5B43-001/shard-1-001/cores/collection1/ [junit4] 2> 382696 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 382697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 382697 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[FADE41E91FCC5B43]) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 382697 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 382697 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 382699 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 382699 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:43086/lsql/n";, [junit4] 2> "node_name":"127.0.0.1:43086_lsql%2Fn", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} current state version: 3 [junit4] 2> 382700 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:43086/lsql/n";, [junit4] 2> "node_name":"127.0.0.1:43086_lsql%2Fn", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 382700 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 382700 INFO (OverseerStateUpdate-94783968837107716-127.0.0.1:54768_lsql%2Fn-n_0000000000) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 382803 INFO (zkCallback-240-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 382803 INFO (zkCallback-244-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 382803 INFO (zkCallback-238-thread-1-processing-n:127.0.0.1:54768_lsql%2Fn) [n:127.0.0.1:54768_lsql%2Fn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 383699 INFO (coreLoadExecutor-1054-thread-1-processing-n:127.0.0.1:43086_lsql%2Fn) [n:127.0.0.1:43086_lsql%2Fn c:collection1 x:collection1] o.a.s [...truncated too long message...] .0.0.1:51980/iz: collection already exists: awholynewstresscollection_collection0_0 [junit4] > at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806) [junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=44645, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49270/iz: Could not find collection : awholynewstresscollection_collection4_0 [junit4] > at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806) [junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=44646, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51980/iz: collection already exists: awholynewstresscollection_collection5_0 [junit4] > at __randomizedtesting.SeedInfo.seed([FADE41E91FCC5B43]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806) [junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574) [junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595) [junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888) [junit4] 2> 1780402 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[FADE41E91FCC5B43]-worker) [n:127.0.0.1:53065_iz c:addReplicaColl s:shard1 r:core_node4 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: test params are: codec=Asserting(Lucene54): {other_tl1=PostingsFormat(name=Memory doPackFST= false), range_facet_l_dv=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=LuceneFixedGap), intDefault=PostingsFormat(name=Memory doPackFST= false), a_i1=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=Memory doPackFST= true), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), text=FST50, range_facet_l=PostingsFormat(name=LuceneFixedGap), timestamp=PostingsFormat(name=LuceneFixedGap)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ru_RU, timezone=Europe/Kiev [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=156264376,total=500695040 [junit4] 2> NOTE: All tests run in this JVM: [TestLRUStatsCache, DeleteShardTest, TestTrieFacet, DocValuesMissingTest, FieldAnalysisRequestHandlerTest, TestPHPSerializedResponseWriter, HighlighterConfigTest, HdfsDirectoryFactoryTest, TestStressReorder, PluginInfoTest, FacetPivotSmallTest, TestCharFilters, BinaryUpdateRequestHandlerTest, TestQueryWrapperFilter, AnalyticsQueryTest, TestGroupingSearch, TestScoreJoinQPScore, MultiThreadedOCPTest, SampleTest, DirectUpdateHandlerOptimizeTest, HdfsNNFailoverTest, SolrCoreCheckLockOnStartupTest, DistribCursorPagingTest, StatsComponentTest, TestFieldTypeCollectionResource, HdfsBasicDistributedZkTest, TestReqParamsAPI, CoreAdminHandlerTest, CloudExitableDirectoryReaderTest, DebugComponentTest, TestHashQParserPlugin, LukeRequestHandlerTest, TestConfigSetsAPIExclusivity, TestFieldResource, SystemInfoHandlerTest, TestMiniSolrCloudClusterBase, SearchHandlerTest, SharedFSAutoReplicaFailoverUtilsTest, TestSha256AuthenticationProvider, SimpleMLTQParserTest, SuggesterTest, ClusterStateTest, RAMDirectoryFactoryTest, TestPostingsSolrHighlighter, TestBulkSchemaAPI, DocValuesMultiTest, ConcurrentDeleteAndCreateCollectionTest, BadIndexSchemaTest, TermVectorComponentDistributedTest, TestLeaderInitiatedRecoveryThread, TestDownShardTolerantSearch, UUIDFieldTest, TestFastWriter, MergeStrategyTest, TestCSVResponseWriter, DistributedFacetPivotSmallAdvancedTest, TestWriterPerf, TestCollationField, CursorMarkTest, LeaderElectionTest, TestSchemaNameResource, TestStressRecovery, TestCursorMarkWithoutUniqueKey, TestFieldSortValues, TestCustomSort, TestOverriddenPrefixQueryForCustomFieldType, TestDynamicFieldCollectionResource, DirectSolrConnectionTest, ResponseHeaderTest, TestXIncludeConfig, TestManagedSchemaDynamicFieldResource, BlockCacheTest, TestConfigReload, HLLSerializationTest, TestSearcherReuse, TestSolrQueryParser, OverseerCollectionConfigSetProcessorTest, OverseerTest, DirectUpdateHandlerTest, TestReloadAndDeleteDocs, TestBulkSchemaConcurrent, HdfsSyncSliceTest, AutoCommitTest, AsyncCallRequestStatusResponseTest, TestShardHandlerFactory, FieldMutatingUpdateProcessorTest, TestRecovery, ShowFileRequestHandlerTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest] [junit4] Completed [238/553] on J2 in 412.50s, 1 test, 1 error <<< FAILURES! [...truncated 1040 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:516: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 553 suites (8 ignored), 2176 tests, 2 errors, 31 ignored (18 assumptions) [seed: FADE41E91FCC5B43] Total time: 192 minutes 42 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
