Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/567/
1 tests failed. FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration Error Message: Stack Trace: java.util.concurrent.TimeoutException at __randomizedtesting.SeedInfo.seed([A2BDA1E5C8E2819F:9B3318A5E71D4861]:0) at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:109) at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:299) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) Build Log: [...truncated 12546 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest [junit4] 2> 141564 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_A2BDA1E5C8E2819F-001/init-core-data-001 [junit4] 2> 141565 WARN (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3 [junit4] 2> 141565 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 141566 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 141567 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_A2BDA1E5C8E2819F-001/tempDir-001 [junit4] 2> 141567 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 141567 INFO (Thread-122) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 141567 INFO (Thread-122) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 141568 ERROR (Thread-122) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 141667 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:51172 [junit4] 2> 141671 INFO (zkConnectionManagerCallback-325-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141677 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 141679 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 141679 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 141679 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 141680 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@478e180b{/solr,null,AVAILABLE} [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3da6747d{HTTP/1.1,[http/1.1]}{127.0.0.1:47666} [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.e.j.s.Server Started @141722ms [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47666} [junit4] 2> 141683 ERROR (jetty-launcher-322-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 141683 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-17T13:38:18.370Z [junit4] 2> 141686 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T13:27:37-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 141687 INFO (zkConnectionManagerCallback-327-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141688 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 141688 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 141688 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 141688 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 141688 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2abe842e{/solr,null,AVAILABLE} [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@31f08506{HTTP/1.1,[http/1.1]}{127.0.0.1:42959} [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.e.j.s.Server Started @141728ms [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42959} [junit4] 2> 141689 ERROR (jetty-launcher-322-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 141689 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-17T13:38:18.376Z [junit4] 2> 141691 INFO (zkConnectionManagerCallback-329-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141691 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 141698 INFO (jetty-launcher-322-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51172/solr [junit4] 2> 141701 INFO (jetty-launcher-322-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51172/solr [junit4] 2> 141703 INFO (zkConnectionManagerCallback-333-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141705 INFO (zkConnectionManagerCallback-339-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141705 INFO (zkConnectionManagerCallback-337-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141713 INFO (zkConnectionManagerCallback-341-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141807 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 141807 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 141807 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47666_solr [junit4] 2> 141809 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.Overseer Overseer (id=73645150975229958-127.0.0.1:47666_solr-n_0000000000) starting [junit4] 2> 141809 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42959_solr [junit4] 2> 141828 INFO (zkCallback-340-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 141830 INFO (zkCallback-338-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 141844 INFO (zkConnectionManagerCallback-350-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 141845 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 141846 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51172/solr ready [junit4] 2> 141858 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 141858 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47666_solr [junit4] 2> 141859 INFO (zkCallback-338-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 141862 INFO (zkCallback-340-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 141868 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers [junit4] 2> 141880 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 141886 INFO (zkCallback-349-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 141887 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1 [junit4] 2> 141887 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 141900 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:47666_solr, 127.0.0.1:42959_solr] [junit4] 2> 141913 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 141913 DEBUG (OverseerAutoScalingTriggerThread-73645150975229958-127.0.0.1:47666_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 141914 DEBUG (ScheduledTrigger-577-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 141987 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42959.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@db3a835 [junit4] 2> 141994 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42959.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@db3a835 [junit4] 2> 141994 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42959.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@db3a835 [junit4] 2> 141995 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_A2BDA1E5C8E2819F-001/tempDir-001/node1/. [junit4] 2> 142000 INFO (zkConnectionManagerCallback-355-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 142001 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 142001 INFO (jetty-launcher-322-thread-1) [n:127.0.0.1:42959_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51172/solr ready [junit4] 2> 142097 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47666.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@db3a835 [junit4] 2> 142107 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47666.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@db3a835 [junit4] 2> 142107 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47666.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@db3a835 [junit4] 2> 142108 INFO (jetty-launcher-322-thread-2) [n:127.0.0.1:47666_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_A2BDA1E5C8E2819F-001/tempDir-001/node2/. [junit4] 2> 142133 INFO (zkConnectionManagerCallback-357-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 142136 INFO (zkConnectionManagerCallback-362-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 142138 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 142139 INFO (SUITE-IndexSizeTriggerTest-seed#[A2BDA1E5C8E2819F]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51172/solr ready [junit4] 2> 142143 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers [junit4] 2> 142144 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0 [junit4] 2> 142144 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1 [junit4] 2> 142144 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0 [junit4] 2> 142145 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10006_solr, 127.0.0.1:10005_solr] [junit4] 2> 142145 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 142145 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0 [junit4] 2> 142145 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142166 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142186 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142207 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142227 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142247 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142268 DEBUG (ScheduledTrigger-586-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142288 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142308 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142329 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142350 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142367 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSplitIntegration [junit4] 2> 142371 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142390 DEBUG (simCloudManagerPool-585-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 142391 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142412 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142432 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142440 DEBUG (simCloudManagerPool-585-thread-8) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 142440 DEBUG (simCloudManagerPool-585-thread-8) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 142444 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 142444 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 142444 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 142450 DEBUG (simCloudManagerPool-585-thread-9) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 142450 DEBUG (simCloudManagerPool-585-thread-9) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2 [junit4] 2> 142450 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2 [junit4] 2> 142451 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 142451 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2 [junit4] 2> 142451 DEBUG (simCloudManagerPool-585-thread-10) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 142452 DEBUG (simCloudManagerPool-585-thread-10) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3 [junit4] 2> 142452 DEBUG (ScheduledTrigger-586-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142452 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3 [junit4] 2> 142452 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 142452 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3 [junit4] 2> 142473 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142493 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142514 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142534 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142538 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} [junit4] 2> 142541 DEBUG (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger, .auto_add_replicas, .scheduled_maintenance] [junit4] 2> 142543 INFO (ScheduledTrigger-586-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230940285908439, stage=STARTED, actionName='null', event={ [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142559 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} [junit4] 2> 142561 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230941190706939, stage=BEFORE_ACTION, actionName='compute_plan', event={ [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142561 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: { [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]} [junit4] 2> 142563 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1 [junit4] 2> 142563 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 24230941338 sessionWrapper.createTime 24230941239184289, this.sessionWrapper.createTime 24230941239184289 [junit4] 2> 142564 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230941352209689, stage=AFTER_ACTION, actionName='compute_plan', event={ [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":1, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142564 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230941371330239, stage=BEFORE_ACTION, actionName='execute_plan', event={ [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":1, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142564 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: { [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":1, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@9f569a8], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]} [junit4] 2> 142565 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1 [junit4] 2> 142707 DEBUG (simCloudManagerPool-585-thread-39) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11, [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 142716 DEBUG (simCloudManagerPool-585-thread-41) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_1: {"core_node10":{ [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "base_url":"http://127.0.0.1:10005/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7, [junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1", [junit4] 2> "shard":"shard1_1", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 142718 DEBUG (simCloudManagerPool-585-thread-42) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_0: {"core_node7":{ [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "base_url":"http://127.0.0.1:10006/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7, [junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0", [junit4] 2> "shard":"shard1_0", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 142720 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230949138529589, stage=AFTER_ACTION, actionName='execute_plan', event={ [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":1, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/5615e8500464b5T2e0gvbjjchomdcmoglig478os/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/5615e8500464b5T2e0gvbjjchomdcmoglig478os/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142720 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230949171309089, stage=SUCCEEDED, actionName='null', event={ [junit4] 2> "id":"5615e8500464b5T2e0gvbjjchomdcmoglig478os", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230935516177589, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":1, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230940248451589, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142727 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: index_size_trigger after 100ms [junit4] 2> 142727 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms [junit4] 2> 142727 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms [junit4] 2> 142727 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 8427 ms for event id=5615e8500464b5T2e0gvbjjchomdcmoglig478os [junit4] 2> 142828 DEBUG (ScheduledTrigger-586-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142848 DEBUG (ScheduledTrigger-586-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142869 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142889 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142909 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142910 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} [junit4] 2> 142910 DEBUG (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger, .auto_add_replicas, .scheduled_maintenance] [junit4] 2> 142911 INFO (ScheduledTrigger-586-thread-4) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230958695334839, stage=STARTED, actionName='null', event={ [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142926 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 0 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [testSplitIntegration_collection] [junit4] 2> DocCollection(testSplitIntegration_collection//clusterstate.json/31)={ [junit4] 2> "replicationFactor":"2", [junit4] 2> "pullReplicas":"0", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "autoCreated":"true", [junit4] 2> "shards":{ [junit4] 2> "shard2":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n4", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}}, [junit4] 2> "range":"0-7fffffff", [junit4] 2> "state":"active"}, [junit4] 2> "shard1":{ [junit4] 2> "stateTimestamp":"1523979050318021750", [junit4] 2> "replicas":{ [junit4] 2> "core_node1":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}, [junit4] 2> "core_node2":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n2", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}}, [junit4] 2> "range":"80000000-ffffffff", [junit4] 2> "state":"inactive"}, [junit4] 2> "shard1_1":{ [junit4] 2> "parent":"shard1", [junit4] 2> "stateTimestamp":"1523979050318628150", [junit4] 2> "range":"c0000000-ffffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node10":{ [junit4] 2> "leader":"true", [junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "base_url":"http://127.0.0.1:10005/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}, [junit4] 2> "core_node9":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica0", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "base_url":"http://127.0.0.1:10006/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}}}, [junit4] 2> "shard1_0":{ [junit4] 2> "parent":"shard1", [junit4] 2> "stateTimestamp":"1523979050318517450", [junit4] 2> "range":"80000000-bfffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node7":{ [junit4] 2> "leader":"true", [junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "base_url":"http://127.0.0.1:10006/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}, [junit4] 2> "core_node8":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica1", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "base_url":"http://127.0.0.1:10005/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}}}}} [junit4] 2> ## Max replicas per node: 4 [junit4] 2> ## Min replicas per node: 4 [junit4] 2> ## Total replicas: 8 [junit4] 2> ## * testSplitIntegration_collection 8 [junit4] 2> ## - active 8 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ## - CREATE 1 [junit4] 2> ## - DELETESTATUS 1 [junit4] 2> ## - REQUESTSTATUS 1 [junit4] 2> ## - SPLITSHARD 1 [junit4] 2> ## - autoscaling 3 [junit4] 2> ## - update 28 [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> ## * Trigger: index_size_trigger [junit4] 2> ## - STARTED 1 [junit4] 2> ## - SUCCEEDED 1 [junit4] 2> [junit4] 2> 142926 DEBUG (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4 [junit4] 2> 142926 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4 [junit4] 2> 142927 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 142927 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 142927 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4 [junit4] 2> 142937 DEBUG (ScheduledTrigger-577-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 142944 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} [junit4] 2> 142945 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230960399128239, stage=BEFORE_ACTION, actionName='compute_plan', event={ [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142945 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: { [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]} [junit4] 2> 142945 INFO (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24230960431544689, stage=FAILED, actionName='compute_plan', event={ [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 142960 WARN (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Exception executing actions [junit4] 2> java.lang.Exception: Error executing action: compute_plan for trigger event: { [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} [junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:312) ~[java/:?] [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_152] [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_152] [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:192) ~[java/:?] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_152] [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_152] [junit4] 2> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152] [junit4] 2> Caused by: org.apache.solr.common.SolrException: Unexpected exception while processing event: { [junit4] 2> "id":"5615ecbf344f77T2e0gvbjjchomdcmoglig478ov", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230954561458039, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":["{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10006_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":24230958688626689, [junit4] 2> "requestedOps":["Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} [junit4] 2> at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:156) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:309) ~[java/:?] [junit4] 2> ... 6 more [junit4] 2> Caused by: java.lang.Exception: Action: compute_plan executed but no policy is configured [junit4] 2> at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:82) ~[java/:?] [junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:309) ~[java/:?] [junit4] 2> ... 6 more [junit4] 2> 142961 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 853 ms for event id=5615ecbf344f77T2e0gvbjjchomdcmoglig478ov [junit4] 2> 143027 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSplitIntegration [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSizeTriggerTest -Dtests.method=testSplitIntegration -Dtests.seed=A2BDA1E5C8E2819F -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ja-JP -Dtests.timezone=Indian/Mahe -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 0.69s J1 | IndexSizeTriggerTest.testSplitIntegration <<< [junit4] > Throwable #1: java.util.concurrent.TimeoutException [junit4] > at __randomizedtesting.SeedInfo.seed([A2BDA1E5C8E2819F:9B3318A5E71D4861]:0) [junit4] > at org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:109) [junit4] > at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:299) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] 2> 143064 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMixedBounds [junit4] 2> 143064 WARN (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.IndexSizeTriggerTest Requires SOLR-12208 [junit4] 2> 143065 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 2 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [] [junit4] 2> ## Max replicas per node: 0 [junit4] 2> ## Min replicas per node: 0 [junit4] 2> ## Total replicas: 0 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ## - update 2 [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> ## * Trigger: index_size_trigger [junit4] 2> ## - FAILED 1 [junit4] 2> ## - STARTED 2 [junit4] 2> ## - SUCCEEDED 1 [junit4] 2> [junit4] 2> 143065 DEBUG (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5 [junit4] 2> 143065 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5 [junit4] 2> 143065 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 143065 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 143065 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5 [junit4] 2> 143166 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMixedBounds [junit4] 2> 143198 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger [junit4] 2> 143241 DEBUG (simCloudManagerPool-585-thread-53) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{ [junit4] 2> "core":"testTrigger_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"testTrigger_collection"}} [junit4] 2> 143243 DEBUG (simCloudManagerPool-585-thread-54) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{ [junit4] 2> "core":"testTrigger_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testTrigger_collection"}} [junit4] 2> 143370 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 0 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [testTrigger_collection] [junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/61)={ [junit4] 2> "replicationFactor":"2", [junit4] 2> "pullReplicas":"0", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "autoCreated":"true", [junit4] 2> "shards":{ [junit4] 2> "shard2":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testTrigger_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testTrigger_collection_shard2_replica_n4", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}}, [junit4] 2> "range":"0-7fffffff", [junit4] 2> "state":"active"}, [junit4] 2> "shard1":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node1":{ [junit4] 2> "core":"testTrigger_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10006_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}, [junit4] 2> "core_node2":{ [junit4] 2> "core":"testTrigger_collection_shard1_replica_n2", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}}, [junit4] 2> "range":"80000000-ffffffff", [junit4] 2> "state":"active"}}} [junit4] 2> ## Max replicas per node: 2 [junit4] 2> ## Min replicas per node: 2 [junit4] 2> ## Total replicas: 4 [junit4] 2> ## * testTrigger_collection 4 [junit4] 2> ## - active 4 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ## - CREATE 1 [junit4] 2> ## - update 26 [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> ## * Trigger: index_size_trigger [junit4] 2> ## - FAILED 1 [junit4] 2> ## - STARTED 2 [junit4] 2> ## - SUCCEEDED 1 [junit4] 2> [junit4] 2> 143371 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6 [junit4] 2> 143371 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6 [junit4] 2> 143371 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 143371 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 143371 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6 [junit4] 2> 143471 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger [junit4] 2> 143521 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[A2BDA1E5C8E2819F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration [junit4] 2> 143589 DEBUG (simCloudManagerPool-585-thread-86) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard2: {"core_node3":{ [junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"testMergeIntegration_collection"}} [junit4] 2> 143590 DEBUG (simCloudManagerPool-585-thread-87) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1: {"core_node1":{ [junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10005_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testMergeIntegration_collection"}} [junit4] 2> 143650 DEBUG (simCloudManagerPool-585-thread-99) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 143652 DEBUG (simCloudManagerPool-585-thread-99) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7 [junit4] 2> 143653 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7 [junit4] 2> 143654 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 143654 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 143654 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7 [junit4] 2> 143656 DEBUG (simCloudManagerPool-585-thread-100) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 143659 DEBUG (simCloudManagerPool-585-thread-100) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8 [junit4] 2> 143659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8 [junit4] 2> 143659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 143659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 143659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8 [junit4] 2> 143660 DEBUG (simCloudManagerPool-585-thread-101) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 143660 DEBUG (simCloudManagerPool-585-thread-101) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9 [junit4] 2> 143660 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9 [junit4] 2> 143661 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 143661 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 143661 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9 [junit4] 2> 143798 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"5615f65d2ac167T2e0gvbjjchomdcmoglig478oz", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230995866337639, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{}, [junit4] 2> "belowSize":{"testMergeIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10005_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10005_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]}, [junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}} [junit4] 2> 143798 DEBUG (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger] [junit4] 2> 143798 INFO (ScheduledTrigger-586-thread-3) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=24231003076541239, stage=STARTED, actionName='null', event={ [junit4] 2> "id":"5615f65d2ac167T2e0gvbjjchomdcmoglig478oz", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":24230995866337639, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{}, [junit4] 2> "belowSize":{"testMergeIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testMergeIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":7,\n \"SEARCHER.searcher.deletedDocs\":5,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":2,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10005_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":2,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testMergeIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testMergeIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":3,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":3,\n \"violationType\":\"belowDocs\",\n \"node_name\":\"127.0.0.1:10005_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":3,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testMergeIntegration_collection\"}}"]}, [junit4] 2> "_enqueue_time_":24231003068143189, [junit4] 2> "requestedOps":["Op{action=MERGESHARDS, hints={COLL_SHARD=[{\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard2\"}, {\n \"first\":\"testMergeIntegration_collection\",\n \"second\":\"shard1\"}]}}"]}}, context={}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 143817 DEBUG (AutoscalingActionExecutor-587-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing [...truncated too long message...] configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: jar-checksums: [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null932150116 [copy] Copying 40 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null932150116 [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/null932150116 resolve-example: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: resolve-server: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: ivy-availability-check: [loadresource] Do not set property disallowed.ivy.jars.list as its length is 0. -ivy-fail-disallowed-ivy-version: ivy-fail: ivy-fail: ivy-configure: [ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/top-level-ivy-settings.xml resolve: jar-checksums: [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1730408654 [copy] Copying 246 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1730408654 [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/null1730408654 check-working-copy: [ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working [ivy:cachepath] confs: [default] [ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public [ivy:cachepath] found com.jcraft#jsch;0.1.53 in public [ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public [ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public [ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public [ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public [ivy:cachepath] found commons-codec#commons-codec;1.6 in public [ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public [ivy:cachepath] :: resolution report :: resolve 21ms :: artifacts dl 1ms --------------------------------------------------------------------- | | modules || artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| --------------------------------------------------------------------- | default | 8 | 0 | 0 | 0 || 8 | 0 | --------------------------------------------------------------------- [wc-checker] Initializing working copy... [wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". [wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation [wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. [wc-checker] Checking working copy status... -jenkins-base: BUILD SUCCESSFUL Total time: 97 minutes 14 seconds Archiving artifacts WARN: No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error? WARN: java.lang.InterruptedException: no matches found within 10000 Recording test results Build step 'Publish JUnit test result report' changed build result to UNSTABLE Email was triggered for: Unstable (Test Failures) Sending email for trigger: Unstable (Test Failures)
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org