Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.3/7/
4 tests failed. FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=53555, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=53555, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44540/k_t/yn: Could not find collection : awholynewstresscollection_collection3_0 at __randomizedtesting.SeedInfo.seed([1FB1272CD8B4CB56]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1085) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:894) FAILED: junit.framework.TestSuite.org.apache.solr.core.TestDynamicLoading Error Message: Stack Trace: java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([1FB1272CD8B4CB56]:0) at org.apache.lucene.util.TestRuleRestoreSystemProperties.before(TestRuleRestoreSystemProperties.java:53) at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.before(TestRuleAdapter.java:26) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:35) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.handler.component.BadComponentTest Error Message: Java heap space Stack Trace: java.lang.OutOfMemoryError: Java heap space FAILED: junit.framework.TestSuite.org.apache.solr.schema.DocValuesMultiTest Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([1FB1272CD8B4CB56]:0) Build Log: [...truncated 10660 lines...] [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/init-core-data-001 [junit4] 2> 948918 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) [junit4] 2> 948918 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /k_t/yn [junit4] 2> 949572 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [junit4] 1> Formatting using clusterid: testClusterID [junit4] 2> 950341 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties [junit4] 2> 950660 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog [junit4] 2> 950687 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 950791 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 950891 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_49145_hdfs____dnfvxz/webapp [junit4] 2> 951195 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 952320 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49145 [junit4] 2> 953186 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 953197 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 953210 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42276_datanode____ti93ui/webapp [junit4] 2> 953379 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 954068 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42276 [junit4] 2> 954194 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j [junit4] 2> 954196 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log jetty-6.1.26 [junit4] 2> 954211 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_47795_datanode____t1tonr/webapp [junit4] 2> 954345 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [junit4] 2> 954976 INFO (IPC Server handler 2 on 49181) [ ] BlockStateChange BLOCK* processReport: from storage DS-8ab9bdc3-21c6-439a-82aa-7388b325ce18 node DatanodeRegistration(127.0.0.1, datanodeUuid=b8676401-da84-4f26-8595-49397b842261, infoPort=42276, ipcPort=56150, storageInfo=lv=-56;cid=testClusterID;nsid=1475220372;c=0), blocks: 0, hasStaleStorages: true, processing time: 3 msecs [junit4] 2> 954979 INFO (IPC Server handler 2 on 49181) [ ] BlockStateChange BLOCK* processReport: from storage DS-1ae4ae06-1d81-4006-becb-e3ff05b9bac7 node DatanodeRegistration(127.0.0.1, datanodeUuid=b8676401-da84-4f26-8595-49397b842261, infoPort=42276, ipcPort=56150, storageInfo=lv=-56;cid=testClusterID;nsid=1475220372;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs [junit4] 2> 955110 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1FB1272CD8B4CB56]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:47795 [junit4] 2> 955253 INFO (IPC Server handler 2 on 49181) [ ] BlockStateChange BLOCK* processReport: from storage DS-18cf5bc6-e992-4175-95e1-43e67a839be1 node DatanodeRegistration(127.0.0.1, datanodeUuid=50c0256a-3db2-4308-a7eb-9102b2979ac9, infoPort=47795, ipcPort=49913, storageInfo=lv=-56;cid=testClusterID;nsid=1475220372;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs [junit4] 2> 955254 INFO (IPC Server handler 2 on 49181) [ ] BlockStateChange BLOCK* processReport: from storage DS-85b59010-3641-400d-925b-4bed344c103a node DatanodeRegistration(127.0.0.1, datanodeUuid=50c0256a-3db2-4308-a7eb-9102b2979ac9, infoPort=47795, ipcPort=49913, storageInfo=lv=-56;cid=testClusterID;nsid=1475220372;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs [junit4] 2> 956002 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 956003 INFO (Thread-49150) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 956003 INFO (Thread-49150) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 956103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ZkTestServer start zk server on port:56104 [junit4] 2> 956103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 956117 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 956124 INFO (zkCallback-1319-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46539568 name:ZooKeeperConnection Watcher:127.0.0.1:56104 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 956124 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 956125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 956125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 956132 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 956134 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 956135 INFO (zkCallback-1320-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7766ec35 name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 956135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 956135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 956136 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 956138 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 956140 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 956141 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 956143 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 956143 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 956147 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 956148 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 956151 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 956151 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 956154 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 956154 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 956157 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 956157 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 956160 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 956160 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 956163 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 956163 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 956166 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 956167 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 956170 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 956170 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 956173 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 956173 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 956176 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 956176 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 956536 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores/collection1 [junit4] 2> 956538 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529 [junit4] 2> 956541 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b26338d{/k_t/yn,null,AVAILABLE} [junit4] 2> 956542 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.ServerConnector Started ServerConnector@39029486{HTTP/1.1}{127.0.0.1:52030} [junit4] 2> 956542 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.Server Started @959597ms [junit4] 2> 956542 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/k_t/yn, solr.data.dir=hdfs://localhost:49181/hdfs__localhost_49181__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.3_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001_tempDir-002_control_data, hostPort=52030, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores} [junit4] 2> 956542 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@1fe91485 [junit4] 2> 956542 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/' [junit4] 2> 956559 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 956561 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 956562 INFO (zkCallback-1321-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4aaa3915 name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 956562 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 956562 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 956564 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 956564 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/solr.xml [junit4] 2> 956580 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores [junit4] 2> 956580 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoreContainer New CoreContainer 1955343669 [junit4] 2> 956580 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/] [junit4] 2> 956580 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/lib [junit4] 2> 956580 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/lib). [junit4] 2> 956588 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 956590 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 956590 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 956591 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 956591 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56104/solr [junit4] 2> 956591 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 956591 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 956592 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 956594 INFO (zkCallback-1323-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63d4890a name:ZooKeeperConnection Watcher:127.0.0.1:56104 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 956595 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 956595 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 956598 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 956599 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10abcaa6 name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 956599 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 956601 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 956603 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 956605 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 956608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 956610 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 956613 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 956615 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 956617 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 956618 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 956619 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52030_k_t%2Fyn [junit4] 2> 956620 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52030_k_t%2Fyn [junit4] 2> 956621 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 956623 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 956624 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 956625 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000 [junit4] 2> 956626 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52030_k_t%2Fyn [junit4] 2> 956626 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 956627 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer Overseer (id=94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) starting [junit4] 2> 956629 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 956636 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 956636 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 956636 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 956637 INFO (OverseerCollectionProcessor-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations [junit4] 2> 956651 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 956651 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 956652 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores [junit4] 2> 956653 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.SolrCore Created CoreDescriptor: {shard=, config=solrconfig.xml, coreNodeName=, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores/collection1, configSetProperties=configsetprops.json, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores/collection1/, loadOnStartup=true, collection=control_collection, transient=false, dataDir=data/, name=collection1, schema=schema.xml} [junit4] 2> 956653 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores/collection1/ [junit4] 2> 956653 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 956655 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 956655 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0 [junit4] 2> 956655 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 956655 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 956656 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 956656 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 956657 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:52030_k_t%2Fyn", [junit4] 2> "state":"down", [junit4] 2> "numShards":"1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "core":"collection1", [junit4] 2> "base_url":"http://127.0.0.1:52030/k_t/yn";, [junit4] 2> "shard":null} current state version: 0 [junit4] 2> 956657 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:52030_k_t%2Fyn", [junit4] 2> "state":"down", [junit4] 2> "numShards":"1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "core":"collection1", [junit4] 2> "base_url":"http://127.0.0.1:52030/k_t/yn";, [junit4] 2> "shard":null} [junit4] 2> 956657 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 956658 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 956659 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 956660 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1 [junit4] 2> 957656 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 957657 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 957657 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 957657 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 957658 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 957658 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores/collection1/' [junit4] 2> 957696 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 957705 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 957719 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.3.0 [junit4] 2> 957748 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml [junit4] 2> 957750 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 957770 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 958046 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 958055 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 958058 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 958070 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 958074 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 958078 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 958079 WARN (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 958079 WARN (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 958079 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 958080 WARN (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 958080 WARN (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 958082 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0 [junit4] 2> 958082 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 958082 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory [junit4] 2> 958094 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:49181/solr_hdfs_home [junit4] 2> 958094 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled [junit4] 2> 958094 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/control-001/cores/collection1/], dataDir=[null] [junit4] 2> 958095 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@19f2d9af [junit4] 2> 958095 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data [junit4] 2> 958158 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data for locality metrics. [junit4] 2> 958158 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data [junit4] 2> 958164 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data/index/ [junit4] 2> 958185 WARN (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:49181/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index... [junit4] 2> 958185 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data/index [junit4] 2> 958204 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics. [junit4] 2> 958204 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data/index [junit4] 2> 958204 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@71a8b41c [junit4] 2> 958496 INFO (IPC Server handler 6 on 49181) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:54108 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-8ab9bdc3-21c6-439a-82aa-7388b325ce18:NORMAL:127.0.0.1:54108|RBW], ReplicaUnderConstruction[[DISK]DS-85b59010-3641-400d-925b-4bed344c103a:NORMAL:127.0.0.1:51481|RBW]]} size 71 [junit4] 2> 958503 INFO (IPC Server handler 7 on 49181) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51481 is added to blk_1073741825_1001 size 71 [junit4] 2> 958902 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b7dfed3f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50a28b65; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1} [junit4] 2> 958902 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 958905 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:49181/solr_hdfs_home/control_collection/core_node1/data/ [junit4] 2> 958909 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 958909 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 958910 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 958910 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 958910 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 958910 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 958911 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 958911 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 958911 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 958914 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 958916 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 958917 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 958919 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 958931 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /get,/admin/system,/update/json/docs,/admin/threads,/admin/luke,/replication,/admin/file,/admin/plugins,/admin/properties,/admin/segments,standard,/update/csv,/update,/admin/ping,/schema,/config,/update/json,/admin/mbeans,/admin/logging [junit4] 2> 958933 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 958937 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog [junit4] 2> 958937 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2 [junit4] 2> 958960 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled [junit4] 2> 958960 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled [junit4] 2> 958962 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=85.2431640625, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=6.460220982143582, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 959069 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b7dfed3f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50a28b65; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1} [junit4] 2> 959069 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 959069 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@35ce0533[collection1] main [junit4] 2> 959070 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 959071 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 959071 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 959072 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 959072 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 959072 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 959072 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 959073 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 959073 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 959073 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 959075 INFO (searcherExecutor-1307-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@35ce0533[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 959083 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 959084 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index [junit4] 2> 959084 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 959085 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1509692274745802752 [junit4] 2> 959085 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1 ms to seed version buckets with highest version 1509692274745802752 [junit4] 2> 959085 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 959087 INFO (coreLoadExecutor-1306-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 959087 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:52030/k_t/yn collection:control_collection shard:shard1 [junit4] 2> 959089 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 959093 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94355766969761796-core_node1-n_0000000000 [junit4] 2> 959094 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 [junit4] 2> 959096 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 959096 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 959096 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 959096 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 959098 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959100 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2 [junit4] 2> 959101 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52030/k_t/yn/collection1/ [junit4] 2> 959101 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 959101 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:52030/k_t/yn/collection1/ has no replicas [junit4] 2> 959101 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52030/k_t/yn/collection1/ shard1 [junit4] 2> 959102 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 959105 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 959106 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:52030/k_t/yn";, [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 2 [junit4] 2> 959157 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 959158 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 959160 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ba67bc1 name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 959160 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 959160 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 959161 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 959164 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 959164 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2 [junit4] 2> 959165 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 959165 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 959167 INFO (zkCallback-1327-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3e4a5f4d name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 959167 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 959168 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 959170 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 959170 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"create", [junit4] 2> "name":"collection1", [junit4] 2> "numShards":"2", [junit4] 2> "stateFormat":"2"} current state version: 2 [junit4] 2> 959170 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 959171 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959172 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959176 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3 [junit4] 2> 959176 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3 [junit4] 2> 959210 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:52030/k_t/yn/collection1/ and leader is http://127.0.0.1:52030/k_t/yn/collection1/ [junit4] 2> 959210 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52030/k_t/yn [junit4] 2> 959210 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 959210 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 959210 INFO (coreZkRegister-1300-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn c:control_collection x:collection1 r:core_node1 s:shard1) [n:127.0.0.1:52030_k_t%2Fyn c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 959212 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 959213 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:52030_k_t%2Fyn", [junit4] 2> "state":"active", [junit4] 2> "numShards":"2", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "core":"collection1", [junit4] 2> "base_url":"http://127.0.0.1:52030/k_t/yn";, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "shard":"shard1"} current state version: 3 [junit4] 2> 959214 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={ [junit4] 2> "roles":null, [junit4] 2> "node_name":"127.0.0.1:52030_k_t%2Fyn", [junit4] 2> "state":"active", [junit4] 2> "numShards":"2", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state", [junit4] 2> "core":"collection1", [junit4] 2> "base_url":"http://127.0.0.1:52030/k_t/yn";, [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "shard":"shard1"} [junit4] 2> 959215 INFO (OverseerStateUpdate-94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json [junit4] 2> 959216 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959217 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959219 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4 [junit4] 2> 959222 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4 [junit4] 2> 959325 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959325 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 959326 INFO (zkCallback-1326-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 5 [junit4] 2> 959327 INFO (zkCallback-1324-thread-1-processing-n:127.0.0.1:52030_k_t%2Fyn) [n:127.0.0.1:52030_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updated cluster state version to 5 [junit4] 2> 959543 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores/collection1 [junit4] 2> 959544 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001 [junit4] 2> 959544 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529 [junit4] 2> 959547 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@393470ab{/k_t/yn,null,AVAILABLE} [junit4] 2> 959547 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.ServerConnector Started ServerConnector@225d1b14{HTTP/1.1}{127.0.0.1:44540} [junit4] 2> 959547 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.e.j.s.Server Started @962602ms [junit4] 2> 959547 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:49181/hdfs__localhost_49181__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.3_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001_tempDir-002_jetty1, hostContext=/k_t/yn, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores, solrconfig=solrconfig.xml, hostPort=44540} [junit4] 2> 959548 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@1fe91485 [junit4] 2> 959548 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/' [junit4] 2> 959571 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 959573 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 959575 INFO (zkCallback-1328-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22fd7f85 name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 959575 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 959576 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 959580 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 959580 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/solr.xml [junit4] 2> 959596 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores [junit4] 2> 959596 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoreContainer New CoreContainer 700299965 [junit4] 2> 959596 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/] [junit4] 2> 959597 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/lib [junit4] 2> 959597 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/lib). [junit4] 2> 959606 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 959607 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 959608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 959608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 959608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56104/solr [junit4] 2> 959608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 959608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 959609 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 959611 INFO (zkCallback-1330-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fc55ad4 name:ZooKeeperConnection Watcher:127.0.0.1:56104 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 959612 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 959612 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 959614 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 959616 INFO (zkCallback-1331-thread-1-processing-n:127.0.0.1:44540_k_t%2Fyn) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6844eedd name:ZooKeeperConnection Watcher:127.0.0.1:56104/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 959616 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 959622 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 960628 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44540_k_t%2Fyn [junit4] 2> 960629 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44540_k_t%2Fyn [junit4] 2> 960634 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 960634 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94355766969761801-127.0.0.1:44540_k_t%2Fyn-n_0000000001 [junit4] 2> 960635 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94355766969761796-127.0.0.1:52030_k_t%2Fyn-n_0000000000 to know if I could be the leader [junit4] 2> 960646 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 960646 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 960647 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores [junit4] 2> 960648 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.SolrCore Created CoreDescriptor: {schema=schema.xml, shard=, config=solrconfig.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, transient=false, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores/collection1, name=collection1, dataDir=data/, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores/collection1/} [junit4] 2> 960649 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1FB1272CD8B4CB56-001/shard-1-001/cores/collection1/ [junit4] 2> 960649 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 960650 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/J0 [junit4] 2> 960650 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1FB1272CD8B4CB56]) [n:127.0.0.1:44540_k_t%2Fyn ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 960651 INFO (coreLoadExecutor-1317-thread-1-processing-n:127.0.0.1:44540_k_t%2Fyn) [n:127.0.0.1:44540_k_t%2Fyn c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 960651 INFO (coreLoadExecutor-1317-thread-1-processing-n:127.0.0.1:44540_k_t%2Fyn) [n:127 [...truncated too long message...] , TestSearchPerf, TestReplicationHandlerBackup, SpatialFilterTest, CursorMarkTest, FieldMutatingUpdateProcessorTest, DistributedSuggestComponentTest, TestElisionMultitermQuery, TestFastLRUCache, OutOfBoxZkACLAndCredentialsProvidersTest, SolrCmdDistributorTest, SimpleMLTQParserTest, TestComponentsName, TestManagedSchemaDynamicFieldResource, TestNonDefinedSimilarityFactory, TestCloudManagedSchema, CacheHeaderTest, PreAnalyzedFieldTest, TestLMJelinekMercerSimilarityFactory, TestImplicitCoreProperties, TestLMDirichletSimilarityFactory, TestSmileRequest, TestPHPSerializedResponseWriter, HdfsNNFailoverTest, CurrencyFieldOpenExchangeTest, TestLRUCache, TestHashQParserPlugin, StatelessScriptUpdateProcessorFactoryTest, TestFiltering, TestSolrCloudWithKerberosAlt, DistributedVersionInfoTest, DistribDocExpirationUpdateProcessorTest, DistributedQueueTest, ReturnFieldsTest, TestReRankQParserPlugin, DisMaxRequestHandlerTest, DistributedMLTComponentTest, TestFoldingMultitermQuery, DocumentAnalysisRequestHandlerTest, TestInitQParser, DistanceFunctionTest, TestBlobHandler, TestDownShardTolerantSearch, CollectionsAPIDistributedZkTest, BadComponentTest, TestDynamicLoading] [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> 40506063 WARN (SyncThread:0) [n:127.0.0.1:51630_ c:awholynewcollection_3 s:shard4 r:core_node12 x:awholynewcollection_3_shard4_replica1] o.a.z.s.p.FileTxnLog fsync-ing the write ahead log in SyncThread:0 took 1127ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDynamicLoading -Dtests.seed=1FB1272CD8B4CB56 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=en_NZ -Dtests.timezone=Europe/Belfast -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] 2> 40512624 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:51472) [n:127.0.0.1:51630_ c:awholynewcollection_3 s:shard4 r:core_node12 x:awholynewcollection_3_shard4_replica1] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x14f381d893c017c, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 40515461 WARN (SyncThread:0) [n:127.0.0.1:51630_ c:awholynewcollection_3 s:shard4 r:core_node12 x:awholynewcollection_3_shard4_replica1] o.a.z.s.p.FileTxnLog fsync-ing the write ahead log in SyncThread:0 took 1137ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide [junit4] 2> 40515461 ERROR (zkCallback-971-thread-29-processing-n:127.0.0.1:33250_) [n:127.0.0.1:33250_ c:awholynewstresscollection_collection1_6 s:shard4 r:core_node17 x:awholynewstresscollection_collection1_6_shard4_replica2] o.a.s.c.ZkController There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is close [junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1042) [junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1009) [junit4] 2> at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1600) [junit4] 2> at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:466) [junit4] 2> at org.apache.solr.cloud.ZkController.access$100(ZkController.java:112) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:296) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:158) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:56) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:132) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264) [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262) [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 40518301 ERROR (zkCallback-1020-thread-21-processing-n:127.0.0.1:51630_) [n:127.0.0.1:51630_ c:awholynewstresscollection_collection4_6 s:shard9 r:core_node14 x:awholynewstresscollection_collection4_6_shard9_replica2] o.a.s.c.ZkController There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props [junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1045) [junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1009) [junit4] 2> at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1600) [junit4] 2> at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:466) [junit4] 2> at org.apache.solr.cloud.ZkController.access$100(ZkController.java:112) [junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:296) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:158) [junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:56) [junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:132) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264) [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262) [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewstresscollection_collection3_6/leaders/shard7 [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342) [junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1023) [junit4] 2> ... 15 more [junit4] 2> [junit4] ERROR 0.00s J1 | TestDynamicLoading (suite) <<< [junit4] > Throwable #1: java.lang.AssertionError [junit4] > at __randomizedtesting.SeedInfo.seed([1FB1272CD8B4CB56]:0) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] Completed [517/531] on J1 in 332.57s, 0 tests, 1 failure <<< FAILURES! [...truncated 2422 lines...] [junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build/solr-core/test/temp/junit4-J1-20150816_153625_841.sysout [junit4] >>> JVM J1: stdout (verbatim) ---- [junit4] java.lang.OutOfMemoryError: Java heap space [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/heapdumps/java_pid29070.hprof ... [junit4] Heap dump file created [660077402 bytes in 10.742 secs] [junit4] <<< JVM J1: EOF ---- [...truncated 13 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/build.xml:733: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/build.xml:670: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/build.xml:230: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/solr/common-build.xml:524: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/lucene/common-build.xml:1449: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.3/lucene/common-build.xml:1003: There were test failures: 531 suites, 2098 tests, 4 suite-level errors, 1 error, 57 ignored (13 assumptions) Total time: 986 minutes 34 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure Sending email for trigger: Failure
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
