Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/181/
1 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=26637, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=26637, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:41100 at __randomizedtesting.SeedInfo.seed([DCAD7898587F04D9]:0) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997) Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:41100 at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:604) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:251) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1292) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1062) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1004) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1620) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:987) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973) at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930) at sun.security.ssl.AppInputStream.read(AppInputStream.java:105) at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160) at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84) at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251) at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:498) ... 11 more Build Log: [...truncated 12218 lines...] [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/init-core-data-001 [junit4] 2> 2665484 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[DCAD7898587F04D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 2665485 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[DCAD7898587F04D9]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: / [junit4] 2> 2665487 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 2665487 INFO (Thread-12164) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2665487 INFO (Thread-12164) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 2665587 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkTestServer start zk server on port:34046 [junit4] 2> 2665598 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 2665600 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 2665602 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2665604 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 2665605 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 2665607 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 2665608 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 2665610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 2665611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2665612 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 2665614 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 2665623 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml [junit4] 2> 2665624 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml [junit4] 2> 2665626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml [junit4] 2> 2665627 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2665629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt [junit4] 2> 2665630 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt [junit4] 2> 2665631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml [junit4] 2> 2665632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json [junit4] 2> 2665634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt [junit4] 2> 2665635 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt [junit4] 2> 2665636 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt [junit4] 2> 2665641 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml [junit4] 2> 2665758 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/control-001/cores/collection1 [junit4] 2> 2665760 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 2665761 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ad2062a{/,null,AVAILABLE} [junit4] 2> 2665763 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.ServerConnector Started ServerConnector@54796a97{SSL,[ssl, http/1.1]}{127.0.0.1:44523} [junit4] 2> 2665764 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server Started @2668987ms [junit4] 2> 2665764 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/tempDir-001/control/data, hostContext=/, hostPort=44523, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/control-001/cores} [junit4] 2> 2665764 ERROR (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 2665765 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0 [junit4] 2> 2665765 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2665765 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2665765 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-21T00:59:33.838Z [junit4] 2> 2665774 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 2665775 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/control-001/solr.xml [junit4] 2> 2665781 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 2665782 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34046/solr [junit4] 2> 2665803 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:44523_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44523_ [junit4] 2> 2665804 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:44523_ ] o.a.s.c.Overseer Overseer (id=96797430484893703-127.0.0.1:44523_-n_0000000000) starting [junit4] 2> 2665813 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:44523_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44523_ [junit4] 2> 2665816 INFO (zkCallback-3046-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2665831 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:44523_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/control-001/cores [junit4] 2> 2665831 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:44523_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 2665834 INFO (OverseerStateUpdate-96797430484893703-127.0.0.1:44523_-n_0000000000) [n:127.0.0.1:44523_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 2665852 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0 [junit4] 2> 2665866 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 2665962 WARN (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 2665964 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 2665976 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 2665976 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/control-001/cores/collection1/data/] [junit4] 2> 2665976 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e59acf [junit4] 2> 2665977 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39906220184106955] [junit4] 2> 2665981 WARN (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 2665989 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 2665989 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 2665990 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 2665990 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 2665990 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@42aaac9 [junit4] 2> 2665990 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@65eba463[collection1] main] [junit4] 2> 2665991 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2665992 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2665992 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 2665992 INFO (searcherExecutor-7228-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@65eba463[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2665993 INFO (coreLoadExecutor-7227-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1548758888287830016 [junit4] 2> 2666001 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 2666001 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 2666001 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44523/collection1/ [junit4] 2> 2666001 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 2666001 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:44523/collection1/ has no replicas [junit4] 2> 2666005 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44523/collection1/ shard1 [junit4] 2> 2666156 INFO (coreZkRegister-7220-thread-1-processing-n:127.0.0.1:44523_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44523_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 2666336 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2666338 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 2666439 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001/cores/collection1 [junit4] 2> 2666439 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001 [junit4] 2> 2666441 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 2666442 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ff5bf8a{/,null,AVAILABLE} [junit4] 2> 2666444 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2b02e071{SSL,[ssl, http/1.1]}{127.0.0.1:41100} [junit4] 2> 2666444 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server Started @2669668ms [junit4] 2> 2666444 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=41100, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001/cores} [junit4] 2> 2666445 ERROR (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 2666445 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0 [junit4] 2> 2666445 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2666445 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2666445 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-21T00:59:34.518Z [junit4] 2> 2666448 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 2666448 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001/solr.xml [junit4] 2> 2666454 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 2666455 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34046/solr [junit4] 2> 2666464 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41100_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 2666469 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41100_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41100_ [junit4] 2> 2666470 INFO (zkCallback-3046-thread-3-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 2666474 INFO (zkCallback-3050-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 2666475 INFO (zkCallback-3055-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 2666490 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41100_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001/cores [junit4] 2> 2666490 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41100_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 2666492 INFO (OverseerStateUpdate-96797430484893703-127.0.0.1:44523_-n_0000000000) [n:127.0.0.1:44523_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2 [junit4] 2> 2667507 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0 [junit4] 2> 2667521 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 2667611 WARN (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 2667614 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 2667625 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 2667626 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-1-001/cores/collection1/data/] [junit4] 2> 2667626 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e59acf [junit4] 2> 2667627 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39906220184106955] [junit4] 2> 2667631 WARN (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 2667640 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 2667640 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 2667640 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 2667640 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 2667642 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1166eaee [junit4] 2> 2667642 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5bef58c6[collection1] main] [junit4] 2> 2667643 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2667644 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2667644 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 2667645 INFO (searcherExecutor-7239-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5bef58c6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2667645 INFO (coreLoadExecutor-7238-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1548758890020077568 [junit4] 2> 2667652 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 2667652 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 2667652 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41100/collection1/ [junit4] 2> 2667652 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 2667652 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:41100/collection1/ has no replicas [junit4] 2> 2667656 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41100/collection1/ shard2 [junit4] 2> 2667808 INFO (coreZkRegister-7233-thread-1-processing-n:127.0.0.1:41100_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 2668111 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001/cores/collection1 [junit4] 2> 2668112 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001 [junit4] 2> 2668113 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 2668115 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39c9ac60{/,null,AVAILABLE} [junit4] 2> 2668117 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.ServerConnector Started ServerConnector@782856da{SSL,[ssl, http/1.1]}{127.0.0.1:38915} [junit4] 2> 2668118 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server Started @2671342ms [junit4] 2> 2668118 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=38915, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001/cores} [junit4] 2> 2668118 ERROR (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 2668119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0 [junit4] 2> 2668119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2668119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2668119 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-21T00:59:36.192Z [junit4] 2> 2668122 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 2668122 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001/solr.xml [junit4] 2> 2668129 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 2668130 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34046/solr [junit4] 2> 2668141 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:38915_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 2668146 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:38915_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38915_ [junit4] 2> 2668148 INFO (zkCallback-3055-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 2668149 INFO (zkCallback-3050-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 2668149 INFO (zkCallback-3046-thread-2-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 2668150 INFO (zkCallback-3061-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 2668160 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:38915_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001/cores [junit4] 2> 2668160 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:38915_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 2668162 INFO (OverseerStateUpdate-96797430484893703-127.0.0.1:44523_-n_0000000000) [n:127.0.0.1:44523_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 2669176 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0 [junit4] 2> 2669191 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 2669295 WARN (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 2669298 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 2669311 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 2669312 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-2-001/cores/collection1/data/] [junit4] 2> 2669312 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e59acf [junit4] 2> 2669313 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39906220184106955] [junit4] 2> 2669318 WARN (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 2669328 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 2669328 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 2669329 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 2669329 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 2669331 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@16ea032 [junit4] 2> 2669331 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@25ad21d1[collection1] main] [junit4] 2> 2669333 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2669333 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2669333 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 2669334 INFO (searcherExecutor-7250-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@25ad21d1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2669335 INFO (coreLoadExecutor-7249-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1548758891792171008 [junit4] 2> 2669343 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 2669343 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 2669343 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38915/collection1/ [junit4] 2> 2669343 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 2669343 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:38915/collection1/ has no replicas [junit4] 2> 2669348 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38915/collection1/ shard1 [junit4] 2> 2669499 INFO (coreZkRegister-7244-thread-1-processing-n:127.0.0.1:38915_ x:collection1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:38915_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 2669785 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001/cores/collection1 [junit4] 2> 2669786 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001 [junit4] 2> 2669788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 2669790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@84a9b27{/,null,AVAILABLE} [junit4] 2> 2669791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.ServerConnector Started ServerConnector@57c27552{SSL,[ssl, http/1.1]}{127.0.0.1:41240} [junit4] 2> 2669792 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server Started @2673016ms [junit4] 2> 2669792 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=41240, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001/cores} [junit4] 2> 2669792 ERROR (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 2669793 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0 [junit4] 2> 2669793 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2669793 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2669793 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-21T00:59:37.866Z [junit4] 2> 2669797 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 2669797 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001/solr.xml [junit4] 2> 2669804 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 2669805 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34046/solr [junit4] 2> 2669816 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41240_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 2669822 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41240_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41240_ [junit4] 2> 2669824 INFO (zkCallback-3055-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 2669824 INFO (zkCallback-3046-thread-1-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 2669825 INFO (zkCallback-3061-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 2669825 INFO (zkCallback-3050-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 2669826 INFO (zkCallback-3067-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 2669852 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41240_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001/cores [junit4] 2> 2669852 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:41240_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 2669854 INFO (OverseerStateUpdate-96797430484893703-127.0.0.1:44523_-n_0000000000) [n:127.0.0.1:44523_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2 [junit4] 2> 2670873 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0 [junit4] 2> 2670893 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 2670995 WARN (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 2670998 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 2671010 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 2671011 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-3-001/cores/collection1/data/] [junit4] 2> 2671011 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e59acf [junit4] 2> 2671012 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39906220184106955] [junit4] 2> 2671017 WARN (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 2671027 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 2671027 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 2671028 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 2671028 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 2671029 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7f87d759 [junit4] 2> 2671030 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3bb167c6[collection1] main] [junit4] 2> 2671031 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2671032 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2671032 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 2671033 INFO (searcherExecutor-7261-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3bb167c6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2671033 INFO (coreLoadExecutor-7260-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1548758893572653056 [junit4] 2> 2671038 INFO (coreZkRegister-7255-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1 [junit4] 2> 2671038 INFO (updateExecutor-3064-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery [junit4] 2> 2671039 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true [junit4] 2> 2671039 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]] [junit4] 2> 2671039 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1] [junit4] 2> 2671039 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4] 2> 2671039 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [https://127.0.0.1:41100/collection1/] and I am [https://127.0.0.1:41240/collection1/] [junit4] 2> 2671041 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:41100]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:41240_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] [junit4] 2> 2671102 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true [junit4] 2> 2671103 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of collection1) have state: recovering [junit4] 2> 2671103 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:41240_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"https://127.0.0.1:41240","node_name":"127.0.0.1:41240_","state":"down"} [junit4] 2> 2671476 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001/cores/collection1 [junit4] 2> 2671477 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001 [junit4] 2> 2671478 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 2671481 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10400459{/,null,AVAILABLE} [junit4] 2> 2671483 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.ServerConnector Started ServerConnector@144cf26{SSL,[ssl, http/1.1]}{127.0.0.1:37384} [junit4] 2> 2671484 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.e.j.s.Server Started @2674708ms [junit4] 2> 2671484 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/tempDir-001/jetty4, solrconfig=solrconfig.xml, hostContext=/, hostPort=37384, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001/cores} [junit4] 2> 2671484 ERROR (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 2671485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0 [junit4] 2> 2671485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 2671485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 2671485 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-21T00:59:39.558Z [junit4] 2> 2671488 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 2671489 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001/solr.xml [junit4] 2> 2671496 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 2671496 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34046/solr [junit4] 2> 2671509 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:37384_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 2671518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:37384_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37384_ [junit4] 2> 2671519 INFO (zkCallback-3055-thread-1-processing-n:127.0.0.1:41100_) [n:127.0.0.1:41100_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 2671519 INFO (zkCallback-3061-thread-1-processing-n:127.0.0.1:38915_) [n:127.0.0.1:38915_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 2671522 INFO (zkCallback-3050-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 2671522 INFO (zkCallback-3046-thread-3-processing-n:127.0.0.1:44523_) [n:127.0.0.1:44523_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 2671519 INFO (zkCallback-3067-thread-1-processing-n:127.0.0.1:41240_) [n:127.0.0.1:41240_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 2671525 INFO (zkCallback-3074-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 2671538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:37384_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001/cores [junit4] 2> 2671538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [n:127.0.0.1:37384_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 2671539 INFO (OverseerStateUpdate-96797430484893703-127.0.0.1:44523_-n_0000000000) [n:127.0.0.1:44523_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 2672103 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:41240_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"https://127.0.0.1:41240","node_name":"127.0.0.1:41240_","state":"recovering"} [junit4] 2> 2672103 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4] 2> 2672103 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:41240_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001 [junit4] 2> 2672553 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0 [junit4] 2> 2672579 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 2672672 WARN (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 2672675 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 2672688 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 2672688 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_DCAD7898587F04D9-001/shard-4-001/cores/collection1/data/] [junit4] 2> 2672688 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e59acf [junit4] 2> 2672689 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=29, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39906220184106955] [junit4] 2> 2672695 WARN (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 2672704 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 2672705 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 2672705 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 2672706 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 2672706 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@48d464a6 [junit4] 2> 2672706 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@553676ec[collection1] main] [junit4] 2> 2672707 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2672708 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2672708 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 2672709 INFO (searcherExecutor-7272-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@553676ec[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2672709 INFO (coreLoadExecutor-7271-thread-1-processing-n:127.0.0.1:37384_) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1548758895330066432 [junit4] 2> 2672714 INFO (coreZkRegister-7266-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1 [junit4] 2> 2672715 INFO (updateExecutor-3071-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery [junit4] 2> 2672715 INFO (recoveryExecutor-3072-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true [junit4] 2> 2672716 INFO (recoveryExecutor-3072-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]] [junit4] 2> 2672716 INFO (recoveryExecutor-3072-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1] [junit4] 2> 2672716 INFO (recoveryExecutor-3072-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4] 2> 2672720 INFO (recoveryExecutor-3072-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [https://127.0.0.1:38915/collection1/] and I am [https://127.0.0.1:37384/collection1/] [junit4] 2> 2672722 INFO (recoveryExecutor-3072-thread-1-processing-n:127.0.0.1:37384_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:37384_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:38915]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:37384_&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] [junit4] 2> 2672789 INFO (qtp2147037837-26175) [n:127.0.0.1:38915_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true [junit4] 2> 2672790 INFO (qtp2147037837-26175) [n:127.0.0.1:38915_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering [junit4] 2> 2672790 INFO (qtp2147037837-26175) [n:127.0.0.1:38915_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:37384_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{"core":"collection1","base_url":"https://127.0.0.1:37384","node_name":"127.0.0.1:37384_","state":"down"} [junit4] 2> 2673041 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test [junit4] 2> 2673042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[DCAD7898587F04D9]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330 [junit4] 2> 2673790 INFO (qtp2147037837-26175) [n:127.0.0.1:38915_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:37384_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{"core":"collection1","base_url":"https://127.0.0.1:37384","node_name":"127.0.0.1:37384_","state":"recovering"} [junit4] 2> 2673791 INFO (qtp2147037837-26175) [n:127.0.0.1:38915_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4] 2> 2673791 INFO (qtp2147037837-26175) [n:127.0.0.1:38915_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:37384_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node4&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1002 [junit4] 2> 2679104 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [https://127.0.0.1:41100/collection1/] - recoveringAfterStartup=[true] [junit4] 2> 2679105 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:41240_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync PeerSync: core=collection1 url=https://127.0.0.1:41240 START replicas=[https://127.0.0.1:41100/collection1/] nUpdates=100 [junit4] 2> 2679113 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0} [junit4] 2> 2679113 INFO (qtp51286503-26147) [n:127.0.0.1:41100_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=0 [junit4] 2> 2679114 INFO (recoveryExecutor-3065-thread-1-processing-n:127.0.0.1:41240_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1: [...truncated too long message...] acheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-common-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-hdfs-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-minikdc-2.7.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/mockito-core-1.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/analysis/icu/lucene-analyzers-icu-6.3.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/contrib/analysis-extras/lib/icu4j-56.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_102/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.4.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/temp/junit4-J2-20161021_001504_788.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/temp/junit4-J2-20161021_001504_788.suites -stdin [junit4] ERROR: JVM J2 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs. [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501) [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121) [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955) [junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952) [junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit4] at java.lang.Thread.run(Thread.java:745) BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:773: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:709: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:252: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/common-build.xml:536: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:1443: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:984: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs. Total time: 269 minutes 5 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
