Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/735/
2 tests failed. REGRESSION: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest.test Error Message: shard4 is not consistent. Got 74 from http://127.0.0.1:50144/collection1lastClient and got 38 from http://127.0.0.1:47734/collection1 Stack Trace: java.lang.AssertionError: shard4 is not consistent. Got 74 from http://127.0.0.1:50144/collection1lastClient and got 38 from http://127.0.0.1:47734/collection1 at __randomizedtesting.SeedInfo.seed([D83020E37C7B824C:50641F39D287EFB4]:0) at org.junit.Assert.fail(Assert.java:93) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1244) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1223) at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:165) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=55133, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=55133, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40332/zw: Could not find collection : awholynewstresscollection_collection5_1 at __randomizedtesting.SeedInfo.seed([D83020E37C7B824C]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:894) Build Log: [...truncated 10145 lines...] [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/init-core-data-001 [junit4] 2> 311086 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) [junit4] 2> 311097 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: / [junit4] 1> Formatting using clusterid: testClusterID [junit4] 2> 311335 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties [junit4] 2> 311362 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 311395 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 311444 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_33429_hdfs____gkbop1/webapp [junit4] 2> 311926 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 312925 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33429 [junit4] 2> 313412 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 313414 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 313433 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_43224_datanode____1jj798/webapp [junit4] 2> 313735 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 313862 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=381596602 [junit4] 2> 313862 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1924569860 [junit4] 2> 313874 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1230234716 [junit4] 2> 313875 ERROR (Finalizer) [ ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=871379439 [junit4] 2> 314483 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43224 [junit4] 2> 314897 WARN (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 314899 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 314929 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_59026_datanode____.f9v5qh/webapp [junit4] 2> 315036 INFO (IPC Server handler 3 on 40080) [ ] BlockStateChange BLOCK* processReport: from storage DS-db8b2c25-0a98-41e8-acbf-1857fccc51e7 node DatanodeRegistration(127.0.0.1, datanodeUuid=5fab64e0-76d4-4df0-b82f-13b4bd7ee17b, infoPort=43224, ipcPort=41183, storageInfo=lv=-56;cid=testClusterID;nsid=431653412;c=0), blocks: 0, hasStaleStorages: true, processing time: 11 msecs [junit4] 2> 315037 INFO (IPC Server handler 3 on 40080) [ ] BlockStateChange BLOCK* processReport: from storage DS-8e4988b7-1db8-4a4e-a693-b101aef6fc69 node DatanodeRegistration(127.0.0.1, datanodeUuid=5fab64e0-76d4-4df0-b82f-13b4bd7ee17b, infoPort=43224, ipcPort=41183, storageInfo=lv=-56;cid=testClusterID;nsid=431653412;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs [junit4] 2> 315258 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 315940 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[D83020E37C7B824C]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59026 [junit4] 2> 316419 INFO (IPC Server handler 3 on 40080) [ ] BlockStateChange BLOCK* processReport: from storage DS-9f96c59c-16f6-4537-8b0c-3a54eaef5e2f node DatanodeRegistration(127.0.0.1, datanodeUuid=63077f5a-7a19-455d-81ef-2420041d2612, infoPort=59026, ipcPort=57273, storageInfo=lv=-56;cid=testClusterID;nsid=431653412;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs [junit4] 2> 316420 INFO (IPC Server handler 3 on 40080) [ ] BlockStateChange BLOCK* processReport: from storage DS-daf67910-48e4-479c-a508-604bd2255d05 node DatanodeRegistration(127.0.0.1, datanodeUuid=63077f5a-7a19-455d-81ef-2420041d2612, infoPort=59026, ipcPort=57273, storageInfo=lv=-56;cid=testClusterID;nsid=431653412;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs [junit4] 2> 316574 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 316589 INFO (Thread-789) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 316590 INFO (Thread-789) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 316757 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ZkTestServer start zk server on port:46868 [junit4] 2> 316757 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 316777 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 316805 INFO (zkCallback-114-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ed325d2 name:ZooKeeperConnection Watcher:127.0.0.1:46868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 316806 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 316806 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 316806 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 316825 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 316885 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 316921 INFO (zkCallback-115-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@523fdd07 name:ZooKeeperConnection Watcher:127.0.0.1:46868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 316922 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 316923 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 316923 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 316925 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 316927 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 316928 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 316930 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 316930 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 316933 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml [junit4] 2> 316933 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 316935 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 316935 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 316943 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 316943 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 316945 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 316945 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 316947 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 316947 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 316950 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 316950 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 316952 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 316952 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 316953 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 316954 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 316955 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 316955 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 316957 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 316957 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 317762 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores/collection1 [junit4] 2> 317775 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529 [junit4] 2> 317859 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@335d8166{/,null,AVAILABLE} [junit4] 2> 317860 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.ServerConnector Started ServerConnector@b3ebbb5{HTTP/1.1}{127.0.0.1:36183} [junit4] 2> 317860 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.Server Started @321304ms [junit4] 2> 317860 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40080/hdfs__localhost_40080__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001_tempDir-002_control_data, hostContext=/, hostPort=36183, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores} [junit4] 2> 317861 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44 [junit4] 2> 317861 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/' [junit4] 2> 317877 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/solr.xml [junit4] 2> 317910 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores [junit4] 2> 317910 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoreContainer New CoreContainer 984647594 [junit4] 2> 317910 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/] [junit4] 2> 317910 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/lib [junit4] 2> 317910 WARN (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/lib). [junit4] 2> 317929 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 317931 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 317931 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 317931 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 317931 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46868/solr [junit4] 2> 317932 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 317932 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 317942 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 317961 INFO (zkCallback-117-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54abc0b name:ZooKeeperConnection Watcher:127.0.0.1:46868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 317962 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 317963 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 318013 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 318039 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1ab7257f name:ZooKeeperConnection Watcher:127.0.0.1:46868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 318039 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 318041 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 318043 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 318045 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 318047 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 318048 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 318050 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 318052 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 318053 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 318054 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36183_ [junit4] 2> 318054 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:36183_ [junit4] 2> 318056 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 318057 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 318058 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 318058 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94142656949518339-127.0.0.1:36183_-n_0000000000 [junit4] 2> 318059 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36183_ [junit4] 2> 318059 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 318060 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer Overseer (id=94142656949518339-127.0.0.1:36183_-n_0000000000) starting [junit4] 2> 318062 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 318075 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 318086 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 318095 INFO (OverseerCollectionProcessor-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations [junit4] 2> 318103 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 318106 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 318106 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 318107 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores [junit4] 2> 318108 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 318108 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores/collection1/ [junit4] 2> 318108 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 318122 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 318123 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 318126 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 318126 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0 [junit4] 2> 318126 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:36183_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 318127 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:36183";, [junit4] 2> "node_name":"127.0.0.1:36183_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 318127 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:36183";, [junit4] 2> "node_name":"127.0.0.1:36183_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 318127 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 318128 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 318129 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 318131 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1 [junit4] 2> 318188 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 318189 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 318189 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 318191 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 318191 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 318199 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 318199 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores/collection1/' [junit4] 2> 318225 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 318242 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 318246 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0 [junit4] 2> 318294 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml [junit4] 2> 318295 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 318310 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 318419 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 318420 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 318428 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 318436 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 318461 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 318462 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory [junit4] 2> 318462 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:40080/solr_hdfs_home [junit4] 2> 318462 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled [junit4] 2> 318462 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/control-001/cores/collection1/], dataDir=[null] [junit4] 2> 318462 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49f78cd8 [junit4] 2> 318463 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data [junit4] 2> 318555 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data for locality metrics. [junit4] 2> 318556 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data [junit4] 2> 318561 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data/index/ [junit4] 2> 318843 WARN (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:40080/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index... [junit4] 2> 318843 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data/index [junit4] 2> 318886 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true] [junit4] 2> 318888 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes [junit4] 2> 318888 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache [junit4] 2> 318926 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled [junit4] 2> 318926 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics. [junit4] 2> 318929 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data/index [junit4] 2> 318932 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=9, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5899791287170559] [junit4] 2> 319159 INFO (IPC Server handler 0 on 40080) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40521 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-db8b2c25-0a98-41e8-acbf-1857fccc51e7:NORMAL:127.0.0.1:34241|RBW], ReplicaUnderConstruction[[DISK]DS-9f96c59c-16f6-4537-8b0c-3a54eaef5e2f:NORMAL:127.0.0.1:40521|FINALIZED]]} size 0 [junit4] 2> 319184 INFO (IPC Server handler 1 on 40080) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34241 is added to blk_1073741825_1001 size 71 [junit4] 2> 319213 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b6d144c6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@533caba4); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1} [junit4] 2> 319213 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 319225 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 319225 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 319225 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 319225 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 319225 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 319226 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 319226 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 319226 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 319226 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 319229 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 319230 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 319310 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:40080/solr_hdfs_home/control_collection/core_node1/data/ [junit4] 2> 319423 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 319424 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 319450 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file [junit4] 2> 319450 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 319483 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog [junit4] 2> 319483 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2 [junit4] 2> 319526 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled [junit4] 2> 319526 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled [junit4] 2> 319530 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0] [junit4] 2> 319784 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b6d144c6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@533caba4); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1} [junit4] 2> 319785 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 319785 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@242aca3b[collection1] main [junit4] 2> 319785 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 319786 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 319787 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 319787 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 319787 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 319787 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 319789 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 319789 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 319789 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 319790 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 319790 INFO (searcherExecutor-623-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@242aca3b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 319827 WARN (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Could not retrieve locality information for hdfs://localhost:60475/solr3 due to exception: java.net.ConnectException: Call From lucene1-us-west/10.41.0.5 to localhost:60475 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused [junit4] 2> 319845 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 319845 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index [junit4] 2> 319846 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 319846 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1506282514604359680 [junit4] 2> 319846 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1 ms to seed version buckets with highest version 1506282514604359680 [junit4] 2> 319846 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 319847 INFO (coreLoadExecutor-622-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 319856 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:36183 collection:control_collection shard:shard1 [junit4] 2> 319860 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 319883 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94142656949518339-core_node1-n_0000000000 [junit4] 2> 319893 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 [junit4] 2> 319897 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 319898 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 319900 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 319901 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2 [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36183/collection1/ [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:36183/collection1/ has no replicas [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36183/collection1/ shard1 [junit4] 2> 319904 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 319908 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 319909 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:36183";, [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 2 [junit4] 2> 320012 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 320014 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3 [junit4] 2> 320065 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:36183/collection1/ and leader is http://127.0.0.1:36183/collection1/ [junit4] 2> 320065 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36183 [junit4] 2> 320066 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 320066 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 320066 INFO (coreZkRegister-616-thread-1-processing-n:127.0.0.1:36183_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36183_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 320068 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 320068 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:36183";, [junit4] 2> "node_name":"127.0.0.1:36183_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 3 [junit4] 2> 320069 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:36183";, [junit4] 2> "node_name":"127.0.0.1:36183_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 320131 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 320150 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320171 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56a8d735 name:ZooKeeperConnection Watcher:127.0.0.1:46868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320172 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320172 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 320172 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 320174 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 320175 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0) [junit4] 2> 320177 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4 [junit4] 2> 320178 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 320178 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2 [junit4] 2> 320178 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 320181 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 320193 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4 [junit4] 2> 320207 INFO (zkCallback-121-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7193c81f name:ZooKeeperConnection Watcher:127.0.0.1:46868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 320207 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 320207 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 320210 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 320212 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"create", [junit4] 2> "name":"collection1", [junit4] 2> "numShards":"4", [junit4] 2> "stateFormat":"2"} current state version: 4 [junit4] 2> 320212 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 320315 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json [junit4] 2> 320316 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 320316 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 320321 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 5 [junit4] 2> 320322 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 5 [junit4] 2> 320881 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores/collection1 [junit4] 2> 320883 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001 [junit4] 2> 320893 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529 [junit4] 2> 320985 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@26447417{/,null,AVAILABLE} [junit4] 2> 320986 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.ServerConnector Started ServerConnector@32ab2823{HTTP/1.1}{127.0.0.1:39339} [junit4] 2> 320986 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.e.j.s.Server Started @324430ms [junit4] 2> 320986 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40080/hdfs__localhost_40080__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=39339, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores} [junit4] 2> 320987 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44 [junit4] 2> 320987 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/' [junit4] 2> 321027 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/solr.xml [junit4] 2> 321050 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores [junit4] 2> 321050 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoreContainer New CoreContainer 172389982 [junit4] 2> 321051 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/] [junit4] 2> 321051 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/lib [junit4] 2> 321051 WARN (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/lib). [junit4] 2> 321074 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 321076 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 321076 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 321076 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 321080 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46868/solr [junit4] 2> 321080 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 321080 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 321100 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 321114 INFO (zkCallback-123-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a9f12d4 name:ZooKeeperConnection Watcher:127.0.0.1:46868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 321114 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 321115 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 321141 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 321198 INFO (zkCallback-124-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@21acce16 name:ZooKeeperConnection Watcher:127.0.0.1:46868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 321198 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 321208 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 322214 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39339_ [junit4] 2> 322214 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39339_ [junit4] 2> 322217 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 322218 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94142656949518343-127.0.0.1:39339_-n_0000000001 [junit4] 2> 322218 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94142656949518339-127.0.0.1:36183_-n_0000000000 to know if I could be the leader [junit4] 2> 322219 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 322219 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 322220 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores [junit4] 2> 322221 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 322221 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_D83020E37C7B824C-001/shard-1-001/cores/collection1/ [junit4] 2> 322221 INFO (TEST-HdfsChaosMonkeySafeLeaderTest.test-seed#[D83020E37C7B824C]) [n:127.0.0.1:39339_ ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 322238 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 322239 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 322240 INFO (zkCallback-118-thread-1-processing-n:127.0.0.1:36183_) [n:127.0.0.1:36183_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 322240 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for external collection collection1 [junit4] 2> 322240 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1 [junit4] 2> 322240 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:39339";, [junit4] 2> "node_name":"127.0.0.1:39339_", [junit4] 2> "numShards":"4", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} current state version: 5 [junit4] 2> 322241 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating collection state at /collections/collection1/state.json from ZooKeeper... [junit4] 2> 322241 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Update state numShards=4 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:39339";, [junit4] 2> "node_name":"127.0.0.1:39339_", [junit4] 2> "numShards":"4", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 322241 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=4 [junit4] 2> 322241 INFO (OverseerStateUpdate-94142656949518339-127.0.0.1:36183_-n_0000000000) [n:127.0.0.1:36183_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2 [junit4] 2> 322242 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 [junit4] 2> 322242 INFO (coreLoadExecutor-633-thread-1-processing-n:127.0.0.1:39339_) [n:127.0.0.1:39339_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node nam [...truncated too long message...] wn(MiniDFSCluster.java:1699) [junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197) [junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> Caused by: java.lang.NullPointerException [junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198) [junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223) [junit4] 2> ... 53 more [junit4] 2> 3639267 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D83020E37C7B824C]-worker) [n:127.0.0.1:34457_zw c:addReplicaColl s:shard1 r:core_node7 x:propertyDotName] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> Jul 10, 2015 1:31:07 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=PostingsFormat(name=Memory doPackFST= true), range_facet_l_dv=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=Memory doPackFST= true), multiDefault=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Direct), intDefault=PostingsFormat(name=Memory doPackFST= true), a_i1=PostingsFormat(name=Direct), id=BlockTreeOrds(blocksize=128), range_facet_i_dv=PostingsFormat(name=Direct), text=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_l=PostingsFormat(name=Direct), timestamp=PostingsFormat(name=Direct)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=DefaultSimilarity, locale=mk_MK, timezone=Pacific/Fakaofo [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=171640704,total=525860864 [junit4] 2> NOTE: All tests run in this JVM: [SuggestComponentTest, RankQueryTest, DateRangeFieldTest, DeleteLastCustomShardedReplicaTest, TestManagedSchema, TestOverriddenPrefixQueryForCustomFieldType, CacheHeaderTest, DisMaxRequestHandlerTest, TestDownShardTolerantSearch, TestRandomRequestDistribution, TestReRankQParserPlugin, TestManagedSchemaDynamicFieldResource, TestSolrConfigHandlerCloud, JsonLoaderTest, CleanupOldIndexTest, SpatialHeatmapFacetsTest, TestDistributedMissingSort, TestSolrDeletionPolicy2, ShowFileRequestHandlerTest, TestDefaultStatsCache, ClusterStateUpdateTest, DirectSolrConnectionTest, SpellingQueryConverterTest, OpenCloseCoreStressTest, TestSolrCoreProperties, TestWriterPerf, BadCopyFieldTest, ZkControllerTest, SpatialFilterTest, TestJettySolrRunner, TestConfigSets, HdfsRecoverLeaseTest, TestCustomDocTransformer, RulesTest, HdfsBasicDistributedZkTest, TestReplicaProperties, DistanceFunctionTest, ConvertedLegacyTest, TestSchemaVersionResource, ChaosMonkeySafeLeaderTest, DistributedQueueTest, TestCoreDiscovery, TestLRUCache, ZkCLITest, DocExpirationUpdateProcessorFactoryTest, CollectionsAPIDistributedZkTest, TestSerializedLuceneMatchVersion, FieldAnalysisRequestHandlerTest, StatelessScriptUpdateProcessorFactoryTest, TestAtomicUpdateErrorCases, AddSchemaFieldsUpdateProcessorFactoryTest, SolrCloudExampleTest, ResourceLoaderTest, SolrXmlInZkTest, DocumentBuilderTest, FieldMutatingUpdateProcessorTest, TestSQLHandler, CoreAdminRequestStatusTest, SolrPluginUtilsTest, PreAnalyzedUpdateProcessorTest, QueryResultKeyTest, TestRTGBase, SpellPossibilityIteratorTest, TestLMDirichletSimilarityFactory, TestFastWriter, TestStressVersions, SolrCmdDistributorTest, TestHashPartitioner, AnalysisErrorHandlingTest, InfoHandlerTest, TestPHPSerializedResponseWriter, TestSchemaNameResource, CoreAdminHandlerTest, TestClusterStateMutator, TestLFUCache, ScriptEngineTest, TestStandardQParsers, AsyncCallRequestStatusResponseTest, WordBreakSolrSpellCheckerTest, TestFoldingMultitermQuery, TestFiltering, AnalysisAfterCoreReloadTest, TestElisionMultitermQuery, TestReload, TestCoreContainer, StatsComponentTest, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, TestIndexSearcher, SimplePostToolTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SuggesterTSTTest, SuggesterWFSTTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, TestRemoteStreaming, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, LukeRequestHandlerTest, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, RequestHandlersTest, RequiredFieldsTest, FastVectorHighlighterTest, TestCollationField, UpdateRequestProcessorFactoryTest, JSONWriterTest, QueryParsingTest, PingRequestHandlerTest, TestComponentsName, TestBinaryResponseWriter, SOLR749Test, UpdateParamsTest, TestQuerySenderNoQuery, ResponseLogComponentTest, BadComponentTest, TestMergePolicyConfig, TestDocSet, TestSearchPerf, TestFuzzyAnalyzedSuggestions, TestPhraseSuggestions, TestCharFilters, EchoParamsTest, TestPerFieldSimilarity, TestBM25SimilarityFactory, TestJmxMonitoredMap, PluginInfoTest, PreAnalyzedFieldTest, TestSolrJ, TestDocumentBuilder, SliceStateTest, SystemInfoHandlerTest, CursorPagingTest, TestTolerantSearch, AliasIntegrationTest, BaseCdcrDistributedZkTest, CloudExitableDirectoryReaderTest, ConcurrentDeleteAndCreateCollectionTest, DistribCursorPagingTest, LeaderFailoverAfterPartitionTest, MigrateRouteKeyTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, RemoteQueryErrorTest, SSLMigrationTest, SaslZkACLProviderTest, ShardSplitTest, TestMiniSolrCloudCluster, TestRequestStatusCollectionAPI, TestShortCircuitedRequests, VMParamsZkACLAndCredentialsProvidersTest, HdfsCollectionsAPIDistributedZkTest] [junit4] Completed [457/514] on J1 in 709.25s, 1 test, 1 error <<< FAILURES! [...truncated 189 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 514 suites, 2022 tests, 1 error, 1 failure, 20 ignored (10 assumptions) Total time: 168 minutes 50 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
