Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/726/
3 tests failed. REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test Error Message: shard1 is not consistent. Got 1242 from http://127.0.0.1:51611/i/collection1lastClient and got 874 from http://127.0.0.1:33316/i/collection1 Stack Trace: java.lang.AssertionError: shard1 is not consistent. Got 1242 from http://127.0.0.1:51611/i/collection1lastClient and got 874 from http://127.0.0.1:33316/i/collection1 at __randomizedtesting.SeedInfo.seed([A6832ADC3B33D393:2ED7150695CFBE6B]:0) at org.junit.Assert.fail(Assert.java:93) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1244) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1223) at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:165) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) REGRESSION: org.apache.solr.search.TestSearcherReuse.test Error Message: expected same:<Searcher@5e108515[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):c2) Uninverting(_1(6.0.0):C4)))}> was not:<Searcher@841079[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):c2) Uninverting(_1(6.0.0):C4)))}> Stack Trace: java.lang.AssertionError: expected same:<Searcher@5e108515[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):c2) Uninverting(_1(6.0.0):C4)))}> was not:<Searcher@841079[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):c2) Uninverting(_1(6.0.0):C4)))}> at __randomizedtesting.SeedInfo.seed([A6832ADC3B33D393:2ED7150695CFBE6B]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotSame(Assert.java:641) at org.junit.Assert.assertSame(Assert.java:580) at org.junit.Assert.assertSame(Assert.java:593) at org.apache.solr.search.TestSearcherReuse.assertSearcherHasNotChanged(TestSearcherReuse.java:247) at org.apache.solr.search.TestSearcherReuse.test(TestSearcherReuse.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=10579, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10579, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:58796/_y/fm: Could not find collection : awholynewstresscollection_collection5_0 at __randomizedtesting.SeedInfo.seed([A6832ADC3B33D393]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:894) Build Log: [...truncated 10384 lines...] [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/init-core-data-001 [junit4] 2> 1648495 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[A6832ADC3B33D393]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) [junit4] 2> 1648495 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[A6832ADC3B33D393]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /i/ [junit4] 2> 1648500 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1648500 INFO (Thread-53813) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1648500 INFO (Thread-53813) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1648600 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ZkTestServer start zk server on port:47880 [junit4] 2> 1648600 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1648602 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1648605 INFO (zkCallback-515-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c1c3e3b name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1648605 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1648606 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1648606 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 1648614 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1648622 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1648623 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b01768d name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1648623 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1648623 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1648623 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 1648626 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 1648628 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 1648629 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 1648631 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1648631 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 1648633 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml [junit4] 2> 1648633 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 1648634 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1648635 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1648636 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1648636 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 1648638 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1648638 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 1648639 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1648640 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 1648650 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1648650 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 1648659 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1648659 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 1648661 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1648661 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1648663 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1648663 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 1648665 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1648665 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 1648986 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1 [junit4] 2> 1648989 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529 [junit4] 2> 1648991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5e5fbeb{/i,null,AVAILABLE} [junit4] 2> 1648991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.ServerConnector Started ServerConnector@249c9487{HTTP/1.1}{127.0.0.1:55420} [junit4] 2> 1648992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.Server Started @1652410ms [junit4] 2> 1648992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/tempDir-001/control/data, hostContext=/i, hostPort=55420, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores} [junit4] 2> 1648992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44 [junit4] 2> 1648992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/' [junit4] 2> 1649006 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/solr.xml [junit4] 2> 1649011 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores [junit4] 2> 1649011 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoreContainer New CoreContainer 1779118963 [junit4] 2> 1649011 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/] [junit4] 2> 1649011 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/lib [junit4] 2> 1649011 WARN (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/lib). [junit4] 2> 1649018 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 1649020 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1649020 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1649020 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1649020 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47880/solr [junit4] 2> 1649020 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 1649021 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1649021 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1649023 INFO (zkCallback-518-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6be3e187 name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1649024 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1649024 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1649032 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1649034 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f92dd42 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1649038 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1649046 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 1649054 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 1649056 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 1649058 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 1649060 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 1649063 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 1649065 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 1649066 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 1649067 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55420_i [junit4] 2> 1649068 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:55420_i [junit4] 2> 1649070 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 1649071 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 1649073 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1649074 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94080612367663107-127.0.0.1:55420_i-n_0000000000 [junit4] 2> 1649074 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55420_i [junit4] 2> 1649075 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 1649076 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer Overseer (id=94080612367663107-127.0.0.1:55420_i-n_0000000000) starting [junit4] 2> 1649078 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 1649084 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 1649085 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1649085 INFO (OverseerCollectionProcessor-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations [junit4] 2> 1649085 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 1649089 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 1649089 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 1649090 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores [junit4] 2> 1649091 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 1649091 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/ [junit4] 2> 1649091 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 1649092 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 1649092 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1649094 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 1649099 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 1649099 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1 [junit4] 2> 1649099 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:55420_i ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 1649100 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:55420/i";, [junit4] 2> "node_name":"127.0.0.1:55420_i", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 1649101 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:55420/i";, [junit4] 2> "node_name":"127.0.0.1:55420_i", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 1649101 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 1649102 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 1649103 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1649106 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1 [junit4] 2> 1650094 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 1650094 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 1650095 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 1650095 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 1650095 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1650096 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/' [junit4] 2> 1650108 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 1650113 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 1650116 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0 [junit4] 2> 1650132 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml [junit4] 2> 1650133 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1650137 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1650207 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 1650208 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 1650209 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1650212 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1650226 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 1650226 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory [junit4] 2> 1650227 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/], dataDir=[null] [junit4] 2> 1650227 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@40ea42dc [junit4] 2> 1650228 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data [junit4] 2> 1650228 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data/index/ [junit4] 2> 1650228 WARN (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index... [junit4] 2> 1650228 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data/index [junit4] 2> 1650229 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=9, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0] [junit4] 2> 1650232 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1} [junit4] 2> 1650233 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 1650233 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data/ [junit4] 2> 1650236 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1650236 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 1650236 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1650236 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1650236 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1650237 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1650237 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1650237 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1650237 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1650239 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1650240 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1650241 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1650242 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1650244 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file [junit4] 2> 1650245 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 1650245 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1650245 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1650246 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled [junit4] 2> 1650246 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled [junit4] 2> 1650247 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] [junit4] 2> 1650247 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1} [junit4] 2> 1650248 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 1650248 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@750137c3[collection1] main [junit4] 2> 1650248 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 1650249 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1650249 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1650249 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1650249 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 1650250 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1650250 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 1650250 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1650250 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 1650250 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1650251 INFO (searcherExecutor-2974-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@750137c3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1650251 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 1650251 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index [junit4] 2> 1650251 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 1650252 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1505289799717617664 [junit4] 2> 1650254 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1505289799717617664 [junit4] 2> 1650254 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 1650254 INFO (coreLoadExecutor-2973-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 1650255 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:55420/i collection:control_collection shard:shard1 [junit4] 2> 1650255 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 1650259 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94080612367663107-core_node1-n_0000000000 [junit4] 2> 1650260 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 [junit4] 2> 1650261 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 1650261 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 1650261 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 1650261 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55420/i/collection1/ [junit4] 2> 1650262 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 1650262 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 1650262 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:55420/i/collection1/ has no replicas [junit4] 2> 1650262 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55420/i/collection1/ shard1 [junit4] 2> 1650262 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 1650265 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 1650266 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:55420/i";, [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 1 [junit4] 2> 1650368 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1650370 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2 [junit4] 2> 1650416 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:55420/i/collection1/ and leader is http://127.0.0.1:55420/i/collection1/ [junit4] 2> 1650417 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55420/i [junit4] 2> 1650417 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 1650417 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 1650417 INFO (coreZkRegister-2967-thread-1-processing-n:127.0.0.1:55420_i x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55420_i c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1650418 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 1650419 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:55420/i";, [junit4] 2> "node_name":"127.0.0.1:55420_i", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 2 [junit4] 2> 1650420 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:55420/i";, [junit4] 2> "node_name":"127.0.0.1:55420_i", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 1650523 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1650524 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3 [junit4] 2> 1650601 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1650601 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1650602 INFO (zkCallback-521-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@770739e3 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1650603 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1650603 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1650603 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1650606 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1650606 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2 [junit4] 2> 1650606 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1650607 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1650607 INFO (zkCallback-522-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2265b065 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1650608 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1650608 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1650609 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 1650615 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"create", [junit4] 2> "name":"collection1", [junit4] 2> "numShards":"1", [junit4] 2> "stateFormat":"2"} current state version: 3 [junit4] 2> 1650615 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 1650718 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json [junit4] 2> 1650719 INFO (zkCallback-521-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1650719 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1650721 INFO (zkCallback-521-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4 [junit4] 2> 1650721 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4 [junit4] 2> 1650936 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores/collection1 [junit4] 2> 1650937 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001 [junit4] 2> 1650937 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529 [junit4] 2> 1650939 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b35b49b{/i,null,AVAILABLE} [junit4] 2> 1650940 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7b6f929b{HTTP/1.1}{127.0.0.1:38579} [junit4] 2> 1650940 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.e.j.s.Server Started @1654358ms [junit4] 2> 1650940 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/i, hostPort=38579, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores} [junit4] 2> 1650940 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44 [junit4] 2> 1650940 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/' [junit4] 2> 1650954 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/solr.xml [junit4] 2> 1650959 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores [junit4] 2> 1650959 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoreContainer New CoreContainer 1110259865 [junit4] 2> 1650959 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/] [junit4] 2> 1650959 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/lib [junit4] 2> 1650960 WARN (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/lib). [junit4] 2> 1650967 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 1650968 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1650968 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1650968 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1650969 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:47880/solr [junit4] 2> 1650969 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 1650969 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1650970 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1650971 INFO (zkCallback-524-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@330521ad name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1650971 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1650971 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1650973 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1650974 INFO (zkCallback-525-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5682d444 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1650974 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1650979 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1651983 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38579_i [junit4] 2> 1651984 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38579_i [junit4] 2> 1651988 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1651988 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94080612367663111-127.0.0.1:38579_i-n_0000000001 [junit4] 2> 1651989 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94080612367663107-127.0.0.1:55420_i-n_0000000000 to know if I could be the leader [junit4] 2> 1651990 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 1651990 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 1651991 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores [junit4] 2> 1651992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 1651992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores/collection1/ [junit4] 2> 1651992 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 1651995 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 1651996 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1651997 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1 [junit4] 2> 1651997 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[A6832ADC3B33D393]) [n:127.0.0.1:38579_i ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 1651997 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:55420_i) [n:127.0.0.1:55420_i ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 1651998 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for external collection collection1 [junit4] 2> 1651998 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1 [junit4] 2> 1651998 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:38579/i";, [junit4] 2> "node_name":"127.0.0.1:38579_i", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} current state version: 4 [junit4] 2> 1651999 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating collection state at /collections/collection1/state.json from ZooKeeper... [junit4] 2> 1651999 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:38579/i";, [junit4] 2> "node_name":"127.0.0.1:38579_i", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 1651999 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1 [junit4] 2> 1651999 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 1651999 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 [junit4] 2> 1652000 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 1652102 INFO (OverseerStateUpdate-94080612367663107-127.0.0.1:55420_i-n_0000000000) [n:127.0.0.1:55420_i ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0 [junit4] 2> 1652102 INFO (zkCallback-525-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2) [junit4] 2> 1652103 INFO (zkCallback-525-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 1 [junit4] 2> 1653000 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 1653000 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1 [junit4] 2> 1653001 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 1653001 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1 [junit4] 2> 1653002 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1653002 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_A6832ADC3B33D393-001/shard-1-001/cores/collection1/' [junit4] 2> 1653015 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 1653019 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 1653023 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0 [junit4] 2> 1653030 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml [junit4] 2> 1653032 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1653036 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1653112 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 1653113 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 1653114 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1653117 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1653132 INFO (coreLoadExecutor-2984-thread-1-processing-n:127.0.0.1:38579_i) [n:127.0.0.1:38579_i c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 1653132 INFO (coreLoadExecutor-2984-thread-1-processin [...truncated too long message...] earcherReuse.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.u.UpdateHandler start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 3147749 INFO (TEST-TestSearcherReuse.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2 [junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e541a59; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4} [junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e541a59; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5} [junit4] 2> 3147750 INFO (TEST-TestSearcherReuse.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.c.SolrCore newest commit generation = 5 [junit4] 2> 3147750 INFO (TEST-TestSearcherReuse.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.s.SolrIndexSearcher Opening Searcher@4f925ff6[collection1] main [junit4] 2> 3147751 INFO (TEST-TestSearcherReuse.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.u.UpdateHandler end_commit_flush [junit4] 2> 3147751 INFO (searcherExecutor-4495-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4f925ff6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3147753 INFO (TEST-TestSearcherReuse.test-seed#[A6832ADC3B33D393]) [ ] o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} {commit=} 0 7 [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSearcherReuse -Dtests.method=test -Dtests.seed=A6832ADC3B33D393 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=tr_TR -Dtests.timezone=Chile/Continental -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] FAILURE 0.13s J2 | TestSearcherReuse.test <<< [junit4] > Throwable #1: java.lang.AssertionError: expected same:<Searcher@5e108515[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):c2) Uninverting(_1(6.0.0):C4)))}> was not:<Searcher@841079[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):c2) Uninverting(_1(6.0.0):C4)))}> [junit4] > at __randomizedtesting.SeedInfo.seed([A6832ADC3B33D393:2ED7150695CFBE6B]:0) [junit4] > at org.apache.solr.search.TestSearcherReuse.assertSearcherHasNotChanged(TestSearcherReuse.java:247) [junit4] > at org.apache.solr.search.TestSearcherReuse.test(TestSearcherReuse.java:104) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> 3147758 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> 3147758 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1300220582 [junit4] 2> 3147758 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@271d4e0c [junit4] 2> 3147759 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=6,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=399,transaction_logs_total_number=3} [junit4] 2> 3147759 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState [junit4] 2> 3147759 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter [junit4] 2> 3147759 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser [junit4] 2> 3147760 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request. [junit4] 2> 3147760 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing NRTCachingDirectoryFactory - 2 directories currently being tracked [junit4] 2> 3147760 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001;done=false>>] [junit4] 2> 3147760 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001 [junit4] 2> 3147760 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001/index;done=false>>] [junit4] 2> 3147760 INFO (SUITE-TestSearcherReuse-seed#[A6832ADC3B33D393]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001/init-core-data-001/index [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_A6832ADC3B33D393-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=tr_TR, timezone=Chile/Continental [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=1,free=173295136,total=531628032 [junit4] 2> NOTE: All tests run in this JVM: [PluginInfoTest, ReplicationFactorTest, TestReplicationHandlerBackup, DistanceUnitsTest, SharedFSAutoReplicaFailoverTest, SearchHandlerTest, LeaderInitiatedRecoveryOnCommitTest, TestPseudoReturnFields, TestPartialUpdateDeduplication, RollingRestartTest, DistributedVersionInfoTest, TestFieldTypeCollectionResource, SimpleCollectionCreateDeleteTest, TestSort, RegexBoostProcessorTest, FullSolrCloudDistribCmdsTest, HdfsCollectionsAPIDistributedZkTest, SampleTest, TestSolr4Spatial2, TestManagedResource, NotRequiredUniqueKeyTest, TestSolrConfigHandlerConcurrent, DeleteReplicaTest, TestSolrJ, TestReqParamsAPI, CursorPagingTest, OverriddenZkACLAndCredentialsProvidersTest, TestManagedStopFilterFactory, TestStressRecovery, DirectUpdateHandlerOptimizeTest, SolrIndexSplitterTest, TestQueryUtils, VersionInfoTest, ResponseLogComponentTest, TestChildDocTransformer, TestTrie, PrimUtilsTest, AtomicUpdatesTest, TestPerFieldSimilarity, TestRawResponseWriter, TestSearcherReuse] [junit4] Completed [367/514] on J2 in 0.34s, 1 test, 1 failure <<< FAILURES! [...truncated 466 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 514 suites, 2021 tests, 1 error, 2 failures, 20 ignored (10 assumptions) Total time: 173 minutes 46 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
