Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1455/ Java: 64bit/jdk-9.0.4 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed. FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit Error Message: expected:<1> but was:<2> Stack Trace: java.lang.AssertionError: expected:<1> but was:<2> at __randomizedtesting.SeedInfo.seed([71909E92264CD1DA:88DD0D3D1A399C50]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:472) at org.junit.Assert.assertEquals(Assert.java:456) at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:283) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:564) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.base/java.lang.Thread.run(Thread.java:844) Build Log: [...truncated 13008 lines...] [junit4] Suite: org.apache.solr.cloud.api.collections.ShardSplitTest [junit4] 2> 774314 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/init-core-data-001 [junit4] 2> 774314 WARN (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=20 numCloses=20 [junit4] 2> 774314 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 774315 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") [junit4] 2> 774315 INFO (SUITE-ShardSplitTest-seed#[71909E92264CD1DA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_y/jo [junit4] 2> 774316 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 774316 INFO (Thread-1604) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 774316 INFO (Thread-1604) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 774322 ERROR (Thread-1604) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 774416 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkTestServer start zk server on port:41619 [junit4] 2> 774420 INFO (zkConnectionManagerCallback-1248-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 774423 INFO (zkConnectionManagerCallback-1250-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 774425 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 774426 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml [junit4] 2> 774427 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 774427 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 774428 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 774429 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 774429 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 774430 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 774431 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 774431 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 774432 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 774432 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise [junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 774518 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 774519 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ebe1d33{/_y/jo,null,AVAILABLE} [junit4] 2> 774520 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@725ea9d3{HTTP/1.1,[http/1.1]}{127.0.0.1:44519} [junit4] 2> 774520 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @776393ms [junit4] 2> 774520 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/control/data, hostPort=44519, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores, replicaType=NRT} [junit4] 2> 774521 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0 [junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 774521 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:37.448255Z [junit4] 2> 774522 INFO (zkConnectionManagerCallback-1252-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 774523 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 774523 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/solr.xml [junit4] 2> 774524 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 774525 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 774525 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 774527 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr [junit4] 2> 774528 INFO (zkConnectionManagerCallback-1256-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 774530 INFO (zkConnectionManagerCallback-1258-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 774588 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 774589 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44519__y%2Fjo [junit4] 2> 774589 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.Overseer Overseer (id=72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) starting [junit4] 2> 774603 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44519__y%2Fjo [junit4] 2> 774606 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 774645 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 774654 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 774654 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 774655 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores [junit4] 2> 774670 INFO (zkConnectionManagerCallback-1264-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 774671 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 774672 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41619/solr ready [junit4] 2> 774673 INFO (qtp201282915-6805) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44519__y%252Fjo&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 774674 INFO (OverseerThreadFactory-2635-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection [junit4] 2> 774778 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 774778 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 774884 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 775802 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0 [junit4] 2> 775809 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test [junit4] 2> 775851 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id [junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true [junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 775858 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/control-001/cores/control_collection_shard1_replica_n1/data/] [junit4] 2> 775860 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0] [junit4] 2> 776888 WARN (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 776913 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 776913 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 776914 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 776914 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 776914 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104 [junit4] 2> 776915 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f117f1[control_collection_shard1_replica_n1] main] [junit4] 2> 776916 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 776916 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 776917 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 776917 INFO (searcherExecutor-2638-thread-1-processing-n:127.0.0.1:44519__y%2Fjo x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@4f117f1[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 776918 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779106448670720 [junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44519/_y/jo/control_collection_shard1_replica_n1/ [junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:44519/_y/jo/control_collection_shard1_replica_n1/ has no replicas [junit4] 2> 776923 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 776924 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44519/_y/jo/control_collection_shard1_replica_n1/ shard1 [junit4] 2> 776924 INFO (zkCallback-1257-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 776974 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 776976 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2198 [junit4] 2> 776978 INFO (qtp201282915-6805) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas [junit4] 2> 777076 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 777978 INFO (qtp201282915-6805) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44519__y%252Fjo&wt=javabin&version=2} status=0 QTime=3304 [junit4] 2> 777990 INFO (zkConnectionManagerCallback-1268-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 777991 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 777991 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41619/solr ready [junit4] 2> 777991 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 777992 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 777993 INFO (OverseerThreadFactory-2635-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1 [junit4] 2> 777993 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 777993 WARN (OverseerThreadFactory-2635-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores. [junit4] 2> 778196 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas [junit4] 2> 778196 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204 [junit4] 2> 778277 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001 of type NRT [junit4] 2> 778277 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e8303bc{/_y/jo,null,AVAILABLE} [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@65d1da9e{HTTP/1.1,[http/1.1]}{127.0.0.1:44709} [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @780152ms [junit4] 2> 778278 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty1, hostPort=44709, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores} [junit4] 2> 778279 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0 [junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 778279 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:41.206284Z [junit4] 2> 778280 INFO (zkConnectionManagerCallback-1270-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 778281 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 778281 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/solr.xml [junit4] 2> 778282 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 778282 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 778294 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 778296 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr [junit4] 2> 778297 INFO (zkConnectionManagerCallback-1274-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 778299 INFO (zkConnectionManagerCallback-1276-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 778301 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 778302 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 778302 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44709__y%2Fjo [junit4] 2> 778303 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 778303 INFO (zkCallback-1267-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 778303 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 778335 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 778342 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 778342 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 778343 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores [junit4] 2> 778358 INFO (qtp201282915-6810) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44709__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 778359 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 778359 INFO (OverseerThreadFactory-2635-thread-3-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44709__y%2Fjo for creating new replica [junit4] 2> 778361 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT [junit4] 2> 778361 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 779369 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0 [junit4] 2> 779376 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test [junit4] 2> 779433 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id [junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true [junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 779439 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-1-001/cores/collection1_shard2_replica_n41/data/] [junit4] 2> 779441 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0] [junit4] 2> 779459 WARN (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 779484 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 779484 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 779485 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 779485 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 779486 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104 [junit4] 2> 779486 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@79e1a486[collection1_shard2_replica_n41] main] [junit4] 2> 779487 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 779487 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 779488 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 779488 INFO (searcherExecutor-2649-thread-1-processing-n:127.0.0.1:44709__y%2Fjo x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@79e1a486[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 779488 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779109143511040 [junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/ [junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/ has no replicas [junit4] 2> 779492 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 779493 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/ shard2 [junit4] 2> 779644 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 779645 INFO (qtp143754951-6856) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1284 [junit4] 2> 779646 INFO (qtp201282915-6810) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44709__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1288 [junit4] 2> 779753 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001 of type NRT [junit4] 2> 779753 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 779754 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 779754 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 779754 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5fe0cd84{/_y/jo,null,AVAILABLE} [junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@702880b3{HTTP/1.1,[http/1.1]}{127.0.0.1:45679} [junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @781628ms [junit4] 2> 779755 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty2, hostPort=45679, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores} [junit4] 2> 779755 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0 [junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 779756 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:42.683207Z [junit4] 2> 779757 INFO (zkConnectionManagerCallback-1280-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 779758 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 779758 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/solr.xml [junit4] 2> 779760 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 779760 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 779760 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 779762 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr [junit4] 2> 779763 INFO (zkConnectionManagerCallback-1284-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 779764 INFO (zkConnectionManagerCallback-1286-thread-1-processing-n:127.0.0.1:45679__y%2Fjo) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 779766 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 779767 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 779767 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45679__y%2Fjo [junit4] 2> 779768 INFO (zkCallback-1257-thread-1-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 779768 INFO (zkCallback-1267-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 779768 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 779768 INFO (zkCallback-1285-thread-1-processing-n:127.0.0.1:45679__y%2Fjo) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 779800 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 779807 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 779807 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 779808 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores [junit4] 2> 779829 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:45679__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 779830 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 779830 INFO (OverseerThreadFactory-2635-thread-4-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:45679__y%2Fjo for creating new replica [junit4] 2> 779832 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 779832 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 780843 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0 [junit4] 2> 780861 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test [junit4] 2> 780905 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id [junit4] 2> 780912 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true [junit4] 2> 780912 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 780912 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 780913 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-2-001/cores/collection1_shard1_replica_n43/data/] [junit4] 2> 780915 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0] [junit4] 2> 781019 WARN (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 781045 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 781045 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 781046 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 781046 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 781046 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104 [junit4] 2> 781047 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@49db72f2[collection1_shard1_replica_n43] main] [junit4] 2> 781047 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 781048 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 781048 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 781049 INFO (searcherExecutor-2660-thread-1-processing-n:127.0.0.1:45679__y%2Fjo x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@49db72f2[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 781049 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779110780338176 [junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45679/_y/jo/collection1_shard1_replica_n43/ [junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:45679/_y/jo/collection1_shard1_replica_n43/ has no replicas [junit4] 2> 781052 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 781053 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45679/_y/jo/collection1_shard1_replica_n43/ shard1 [junit4] 2> 781204 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 781206 INFO (qtp421706131-6887) [n:127.0.0.1:45679__y%2Fjo c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1373 [junit4] 2> 781207 INFO (qtp201282915-6811) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:45679__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1377 [junit4] 2> 781287 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001 of type NRT [junit4] 2> 781288 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@352ed26f{/_y/jo,null,AVAILABLE} [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5e656c39{HTTP/1.1,[http/1.1]}{127.0.0.1:33199} [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @783162ms [junit4] 2> 781289 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty3, hostPort=33199, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores, replicaType=NRT} [junit4] 2> 781290 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0 [junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 781290 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:44.217364Z [junit4] 2> 781291 INFO (zkConnectionManagerCallback-1290-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 781292 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 781292 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/solr.xml [junit4] 2> 781293 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 781293 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 781294 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 781295 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41619/solr [junit4] 2> 781296 INFO (zkConnectionManagerCallback-1294-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 781298 INFO (zkConnectionManagerCallback-1296-thread-1-processing-n:127.0.0.1:33199__y%2Fjo) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 781300 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 781301 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 781301 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33199__y%2Fjo [junit4] 2> 781302 INFO (zkCallback-1285-thread-1-processing-n:127.0.0.1:45679__y%2Fjo) [n:127.0.0.1:45679__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 781302 INFO (zkCallback-1275-thread-1-processing-n:127.0.0.1:44709__y%2Fjo) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 781302 INFO (zkCallback-1257-thread-2-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 781302 INFO (zkCallback-1267-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 781302 INFO (zkCallback-1295-thread-1-processing-n:127.0.0.1:33199__y%2Fjo) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 781326 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 781345 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 781345 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 781346 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores [junit4] 2> 781371 INFO (qtp84018367-6918) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33199__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 781372 INFO (OverseerCollectionConfigSetProcessor-72063086239154180-127.0.0.1:44519__y%2Fjo-n_0000000000) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 781372 INFO (OverseerThreadFactory-2635-thread-5-processing-n:127.0.0.1:44519__y%2Fjo) [n:127.0.0.1:44519__y%2Fjo ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:33199__y%2Fjo for creating new replica [junit4] 2> 781373 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT [junit4] 2> 781374 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 782707 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0 [junit4] 2> 782713 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test [junit4] 2> 782757 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id [junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true [junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d298b42 [junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 782763 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-3-001/cores/collection1_shard2_replica_n45/data/] [junit4] 2> 782765 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0] [junit4] 2> 782784 WARN (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 782817 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 782817 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 782818 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 782818 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 782818 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=1.666015625, floorSegmentMB=0.3720703125, forceMergeDeletesPctAllowed=12.718653601279936, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31403727550278104 [junit4] 2> 782819 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.SolrIndexSearcher Opening [Searcher@b0bebf0[collection1_shard2_replica_n45] main] [junit4] 2> 782819 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 782820 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 782820 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 782821 INFO (searcherExecutor-2671-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [collection1_shard2_replica_n45] Registered new searcher Searcher@b0bebf0[collection1_shard2_replica_n45] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 782821 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593779112638414848 [junit4] 2> 782823 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n45 [junit4] 2> 782823 INFO (updateExecutor-1291-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.DefaultSolrCoreState Running recovery [junit4] 2> 782824 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true [junit4] 2> 782824 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]] [junit4] 2> 782824 INFO (qtp84018367-6944) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1450 [junit4] 2> 782825 INFO (qtp84018367-6918) [n:127.0.0.1:33199__y%2Fjo ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33199__y%252Fjo&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1454 [junit4] 2> 782825 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp=/_y/jo path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=0 [junit4] 2> 782826 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_n41] o.a.s.c.S.Request [collection1_shard2_replica_n41] webapp=/_y/jo path=/admin/ping params={wt=javabin&version=2} status=0 QTime=0 [junit4] 2> 782826 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n45] [junit4] 2> 782826 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4] 2> 782826 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n45] as recovering, leader is [http://127.0.0.1:44709/_y/jo/collection1_shard2_replica_n41/] and I am [http://127.0.0.1:33199/_y/jo/collection1_shard2_replica_n45/] [junit4] 2> 782834 INFO (recoveryExecutor-1292-thread-1-processing-n:127.0.0.1:33199__y%2Fjo x:collection1_shard2_replica_n45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:33199__y%2Fjo c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_n45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:44709/_y/jo]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n41&nodeName=127.0.0.1:33199__y%252Fjo&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] [junit4] 2> 782835 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s [junit4] 2> 782836 INFO (qtp143754951-6862) [n:127.0.0.1:44709__y%2Fjo ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:33199__y%2Fjo, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_n45","base_url":"http://127.0.0.1:33199/_y/jo","node_name":"127.0.0.1:33199__y%2Fjo","state":"down","type":"NRT"} [junit4] 2> 782934 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-4-001 of type NRT [junit4] 2> 782934 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 782935 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5732113a{/_y/jo,null,AVAILABLE} [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ec6b9d0{HTTP/1.1,[http/1.1]}{127.0.0.1:45025} [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.e.j.s.Server Started @784809ms [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_y/jo, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/tempDir-001/jetty4, hostPort=45025, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-4-001/cores, replicaType=NRT} [junit4] 2> 782936 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0 [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 782936 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-03-01T23:16:45.863803Z [junit4] 2> 782937 INFO (zkConnectionManagerCallback-1301-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 782938 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 782938 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001/shard-4-001/solr.xml [junit4] 2> 782940 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 782940 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[71909E92264CD1DA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 782941 [...truncated too long message...] (zkCallback-1490-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) [junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.c.SolrCore [collection1_shard1_replica_t47] CLOSING SolrCore org.apache.solr.core.SolrCore@7ff8b794 [junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_t47, tag=2147006356 [junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.c.SolrCore [shardSplitWithRule_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@1c80ac73 [junit4] 2> 988194 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c0c0bd5: rootName = null, domain = solr.core.collection1.shard1.replica_t47, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_t47 / com.codahale.metrics.MetricRegistry@41c129d1 [junit4] 2> 988199 INFO (coreCloseExecutor-3094-thread-1) [n:127.0.0.1:45651__y%2Fjo c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=2147006356 [junit4] 2> 988199 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.shardSplitWithRule.shard1.replica_n2, tag=478194803 [junit4] 2> 988199 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@583687c0: rootName = null, domain = solr.core.shardSplitWithRule.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.shardSplitWithRule.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@71520271 [junit4] 2> 988204 INFO (coreCloseExecutor-3094-thread-2) [n:127.0.0.1:45651__y%2Fjo c:shardSplitWithRule s:shard1 r:core_node4 x:shardSplitWithRule_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.shardSplitWithRule.shard1.leader, tag=478194803 [junit4] 2> 988216 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.s.c.Overseer Overseer (id=72063096710168594-127.0.0.1:45651__y%2Fjo-n_0000000004) closing [junit4] 2> 988216 INFO (OverseerStateUpdate-72063096710168594-127.0.0.1:45651__y%2Fjo-n_0000000004) [n:127.0.0.1:45651__y%2Fjo ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45651__y%2Fjo [junit4] 2> 988216 WARN (OverseerAutoScalingTriggerThread-72063096710168594-127.0.0.1:45651__y%2Fjo-n_0000000004) [n:127.0.0.1:45651__y%2Fjo ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 988218 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@21e08141{HTTP/1.1,[http/1.1]}{127.0.0.1:0} [junit4] 2> 988218 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@77cc217b{/_y/jo,null,UNAVAILABLE} [junit4] 2> 988218 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.e.j.s.session Stopped scavenging [junit4] 2> 988219 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 33079 [junit4] 2> 988219 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 988219 INFO (TEST-ShardSplitTest.testSplitShardWithRule-seed#[71909E92264CD1DA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35875 35875 [junit4] 2> 993331 INFO (Thread-1820) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35875 35875 [junit4] 2> 993331 WARN (Thread-1820) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 7 /solr/aliases.json [junit4] 2> 5 /solr/security.json [junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1 [junit4] 2> 5 /solr/configs/conf1 [junit4] 2> 5 /solr/collections/collection1/terms/shard1 [junit4] 2> 5 /solr/collections/collection1/terms/shard2 [junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1_0 [junit4] 2> 5 /solr/collections/shardSplitWithRule/terms/shard1_1 [junit4] 2> 4 /solr/collections/collection1/state.json [junit4] 2> 2 /solr/collections/control_collection/terms/shard1 [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 48 /solr/collections/shardSplitWithRule/state.json [junit4] 2> 7 /solr/clusterprops.json [junit4] 2> 7 /solr/clusterstate.json [junit4] 2> 3 /solr/autoscaling.json [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 7 /solr/live_nodes [junit4] 2> 7 /solr/collections [junit4] 2> 3 /solr/overseer/queue [junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas [junit4] 2> 3 /solr/overseer/collection-queue-work [junit4] 2> 3 /solr/overseer/queue-work [junit4] 2> [junit4] IGNOR/A 0.00s J2 | ShardSplitTest.test [junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")) [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.ShardSplitTest_71909E92264CD1DA-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=BlockTreeOrds(blocksize=128), a_t=PostingsFormat(name=Direct), id=BlockTreeOrds(blocksize=128)}, docValues:{rnd_b=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Lucene70), a_t=DocValuesFormat(name=Asserting), a_i=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1064, maxMBSortInHeap=7.702639317728574, sim=RandomSimilarity(queryNorm=false): {}, locale=sv, timezone=Europe/Saratov [junit4] 2> NOTE: Linux 4.13.0-36-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=231820848,total=518979584 [junit4] 2> NOTE: All tests run in this JVM: [NodeMutatorTest, SolrCmdDistributorTest, RegexBoostProcessorTest, TestFieldCacheVsDocValues, IndexSchemaRuntimeFieldTest, TestReplicaProperties, TestAuthorizationFramework, TestSha256AuthenticationProvider, HdfsNNFailoverTest, TestTrackingShardHandlerFactory, CloudMLTQParserTest, TestExpandComponent, TestSolr4Spatial2, TestFilteredDocIdSet, ConvertedLegacyTest, DisMaxRequestHandlerTest, TriggerIntegrationTest, SharedFSAutoReplicaFailoverTest, TestManagedSchemaThreadSafety, TestUpdate, TestSchemaResource, TestDFISimilarityFactory, TestStandardQParsers, SecurityConfHandlerTest, AliasIntegrationTest, CollectionTooManyReplicasTest, TestXmlQParser, TestDistributedMissingSort, CoreAdminHandlerTest, TestDFRSimilarityFactory, TestSegmentSorting, DistributedSpellCheckComponentTest, NoCacheHeaderTest, ManagedSchemaRoundRobinCloudTest, DeleteReplicaTest, CacheHeaderTest, RegexBytesRefFilterTest, TestBlobHandler, TestFaceting, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestUseDocValuesAsStored2, DeleteInactiveReplicaTest, DistanceUnitsTest, TestLargeCluster, TestMissingGroups, TestScoreJoinQPNoScore, TestShardHandlerFactory, TestMacros, TestJmxIntegration, SpellCheckComponentTest, TestAtomicUpdateErrorCases, TestLegacyFieldReuse, TestSolrDeletionPolicy2, RecoveryZkTest, TimeRoutedAliasUpdateProcessorTest, PreAnalyzedFieldTest, ConnectionReuseTest, TestLazyCores, TestReRankQParserPlugin, HdfsBasicDistributedZkTest, ShardSplitTest] [junit4] Completed [270/777 (1!)] on J2 in 219.03s, 5 tests, 1 failure, 1 skipped <<< FAILURES! [...truncated 43088 lines...] [repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1455/consoleText [repro] Revision: 9363529f4bffc98be3955e2e0e0229eebeb43a5a [repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" [repro] Repro line: ant test -Dtestcase=ShardSplitTest -Dtests.method=testSplitAfterFailedSplit -Dtests.seed=71909E92264CD1DA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sv -Dtests.timezone=Europe/Saratov -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] ShardSplitTest [repro] ant compile-test [...truncated 3315 lines...] [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ShardSplitTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=71909E92264CD1DA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sv -Dtests.timezone=Europe/Saratov -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [...truncated 117 lines...] [repro] Failures: [repro] 0/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest [repro] Exiting with code 0 [...truncated 40 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org