Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/459/
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at
__randomizedtesting.SeedInfo.seed([6457619E7BD55BD8:ADE2233072B29D2D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:726)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12321 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 23147 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001/init-core-data-001
[junit4] 2> 23153 WARN
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
[junit4] 2> 23154 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 23155 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via:
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 23157 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001/tempDir-001
[junit4] 2> 23163 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 23165 INFO (Thread-91) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 23165 INFO (Thread-91) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 23264 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.c.ZkTestServer start zk server on port:51111
[junit4] 2> 23393 ERROR (Thread-91) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 23445 INFO (zkConnectionManagerCallback-28-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23501 INFO (jetty-launcher-25-thread-1) [ ] o.e.j.s.Server
jetty-9.4.8.v20171121, build timestamp: 2017-11-22T07:27:37+10:00, git hash:
82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 23506 INFO (jetty-launcher-25-thread-2) [ ] o.e.j.s.Server
jetty-9.4.8.v20171121, build timestamp: 2017-11-22T07:27:37+10:00, git hash:
82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 23507 INFO (jetty-launcher-25-thread-1) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 23507 INFO (jetty-launcher-25-thread-1) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 23508 INFO (jetty-launcher-25-thread-1) [ ]
o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 23508 INFO (jetty-launcher-25-thread-1) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1e047879{/solr,null,AVAILABLE}
[junit4] 2> 23509 INFO (jetty-launcher-25-thread-1) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@1e26e2ab{SSL,[ssl,
http/1.1]}{127.0.0.1:39216}
[junit4] 2> 23510 INFO (jetty-launcher-25-thread-1) [ ] o.e.j.s.Server
Started @26065ms
[junit4] 2> 23510 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=39216}
[junit4] 2> 23510 ERROR (jetty-launcher-25-thread-1) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 23510 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 23510 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 23510 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 23510 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-02-26T11:02:59.224Z
[junit4] 2> 23539 INFO (jetty-launcher-25-thread-2) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 23539 INFO (jetty-launcher-25-thread-2) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 23539 INFO (jetty-launcher-25-thread-2) [ ]
o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 23545 INFO (jetty-launcher-25-thread-2) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@11c52e75{/solr,null,AVAILABLE}
[junit4] 2> 23545 INFO (jetty-launcher-25-thread-2) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@31e8f6ab{SSL,[ssl,
http/1.1]}{127.0.0.1:49900}
[junit4] 2> 23545 INFO (jetty-launcher-25-thread-2) [ ] o.e.j.s.Server
Started @26100ms
[junit4] 2> 23545 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=49900}
[junit4] 2> 23546 ERROR (jetty-launcher-25-thread-2) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 23546 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 23546 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 23546 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 23546 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-02-26T11:02:59.260Z
[junit4] 2> 23549 INFO (zkConnectionManagerCallback-30-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23551 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 23593 INFO (zkConnectionManagerCallback-32-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23600 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 23615 INFO (jetty-launcher-25-thread-1) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51111/solr
[junit4] 2> 23619 INFO (jetty-launcher-25-thread-2) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51111/solr
[junit4] 2> 23642 INFO (zkConnectionManagerCallback-38-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23647 INFO (zkConnectionManagerCallback-40-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23659 INFO
(zkConnectionManagerCallback-42-thread-1-processing-n:127.0.0.1:39216_solr)
[n:127.0.0.1:39216_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23671 INFO
(zkConnectionManagerCallback-44-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 23921 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 23923 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:39216_solr
[junit4] 2> 23922 INFO (jetty-launcher-25-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 23927 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.c.Overseer Overseer
(id=73361425252352005-127.0.0.1:39216_solr-n_0000000000) starting
[junit4] 2> 23930 INFO (jetty-launcher-25-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:49900_solr
[junit4] 2> 23982 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 23990 INFO
(zkCallback-41-thread-1-processing-n:127.0.0.1:39216_solr)
[n:127.0.0.1:39216_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 24140 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:39216_solr
[junit4] 2> 24147 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 24147 INFO
(OverseerStateUpdate-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 24231 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Adding
.autoAddReplicas trigger
[junit4] 2> 24251 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 1
[junit4] 2> 24419 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:39216_solr, 127.0.0.1:49900_solr]
[junit4] 2> 24419 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 24419 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 1
[junit4] 2> 24440 INFO (jetty-launcher-25-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_49900.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 24443 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_39216.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 24462 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeAdded markers
[junit4] 2> 24463 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 24467 DEBUG (ScheduledTrigger-127-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 2
[junit4] 2> 24555 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_39216.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 24555 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_39216.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 24556 INFO (jetty-launcher-25-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_49900.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 24561 INFO (jetty-launcher-25-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_49900.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 24564 INFO (jetty-launcher-25-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001/tempDir-001/node2/.
[junit4] 2> 24569 INFO (jetty-launcher-25-thread-1)
[n:127.0.0.1:39216_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001/tempDir-001/node1/.
[junit4] 2> 24768 INFO (zkConnectionManagerCallback-50-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 24787 INFO (zkConnectionManagerCallback-54-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 24788 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 24789 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51111/solr ready
[junit4] 2> 24807 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
[junit4] 2> 24859 INFO (qtp1626247802-252) [n:127.0.0.1:49900_solr ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 24903 INFO (qtp1626247802-252) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=43
[junit4] 2> 24905 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 24909 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 24909 DEBUG
(zkCallback-41-thread-1-processing-n:127.0.0.1:39216_solr)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 2
[junit4] 2> 24910 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 2
[junit4] 2> 24910 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeLost markers
[junit4] 2> 24912 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeAdded markers
[junit4] 2> 24913 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 24914 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 24925 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.AbstractConnector Stopped ServerConnector@1e26e2ab{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 24925 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1778164046
[junit4] 2> 24927 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node,
tag=null
[junit4] 2> 24927 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@568370aa: rootName =
solr_39216, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@3d019a44
[junit4] 2> 24937 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm,
tag=null
[junit4] 2> 24937 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@24e0bb8f: rootName =
solr_39216, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@7c9c0827
[junit4] 2> 24947 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 24947 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@73c475ec: rootName =
solr_39216, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@429e79a1
[junit4] 2> 24949 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:39216_solr
[junit4] 2> 24950 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.cluster, tag=null
[junit4] 2> 24951 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 24951 INFO
(zkCallback-41-thread-1-processing-n:127.0.0.1:39216_solr)
[n:127.0.0.1:39216_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 24955 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for
2147483647 transient cores
[junit4] 2> 24956 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.Overseer Overseer
(id=73361425252352005-127.0.0.1:39216_solr-n_0000000000) closing
[junit4] 2> 24956 INFO
(OverseerStateUpdate-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:39216_solr
[junit4] 2> 24957 WARN
(OverseerAutoScalingTriggerThread-73361425252352005-127.0.0.1:39216_solr-n_0000000000)
[n:127.0.0.1:39216_solr ] o.a.s.c.a.OverseerTriggerThread
OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 24963 INFO (zkCallback-53-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 24963 INFO (zkCallback-53-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 24963 DEBUG
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed
explicitly
[junit4] 2> 24964 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:49900_solr
[junit4] 2> 24964 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@1e047879{/solr,null,UNAVAILABLE}
[junit4] 2> 24965 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session Stopped scavenging
[junit4] 2> 24966 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.Overseer Overseer
(id=73361425252352006-127.0.0.1:49900_solr-n_0000000001) starting
[junit4] 2> 24992 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Adding
.autoAddReplicas trigger
[junit4] 2> 24993 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 3
[junit4] 2> 24993 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:49900_solr]
[junit4] 2> 24994 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 3, lastZnodeVersion -1
[junit4] 2> 24994 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 3
[junit4] 2> 24998 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeAdded markers
[junit4] 2> 24999 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 24999 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 26000 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 27001 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 28001 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 29001 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 29970 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T07:27:37+10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 29978 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 29978 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 29978 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 29979 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@4b54797f{/solr,null,AVAILABLE}
[junit4] 2> 29979 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.AbstractConnector Started ServerConnector@77078bcc{SSL,[ssl,
http/1.1]}{127.0.0.1:52556}
[junit4] 2> 29979 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.Server Started @32534ms
[junit4] 2> 29979 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=52556}
[junit4] 2> 29980 ERROR
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 29980 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 29980 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
null
[junit4] 2> 29980 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 29980 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-02-26T11:03:05.694Z
[junit4] 2> 29986 INFO (zkConnectionManagerCallback-57-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 29987 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 29996 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51111/solr
[junit4] 2> 30002 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 30015 INFO (zkConnectionManagerCallback-61-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30028 INFO
(zkConnectionManagerCallback-63-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30075 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 30079 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 30083 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:52556_solr
[junit4] 2> 30085 INFO (zkCallback-53-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 30085 INFO (zkCallback-53-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 30085 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 30099 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 30164 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_52556.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 30182 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_52556.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 30182 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_52556.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 30184 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:52556_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001/tempDir-001/node3/.
[junit4] 2> 30319 INFO (qtp1626247802-252) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=9
[junit4] 2> 30331 INFO (qtp1116897922-316) [n:127.0.0.1:52556_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 30333 DEBUG (qtp1116897922-313) [n:127.0.0.1:52556_solr ]
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 30334 INFO (qtp1116897922-313) [n:127.0.0.1:52556_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling
params={wt=javabin&version=2} status=0 QTime=43
[junit4] 2> 30335 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 4
[junit4] 2> 30336 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 30338 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 30338 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 30338 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 4
[junit4] 2> 30341 INFO
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest
TestTriggerAction init
[junit4] 2> 30342 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 30343 DEBUG (ScheduledTrigger-136-thread-3)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger1
[junit4] 2> 30344 DEBUG (ScheduledTrigger-136-thread-3)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 30347 INFO (qtp1626247802-252) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 30353 INFO (qtp1116897922-311) [n:127.0.0.1:52556_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 30353 DEBUG (qtp1626247802-248) [n:127.0.0.1:49900_solr ]
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 30354 INFO (qtp1626247802-248) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling
params={wt=javabin&version=2} status=0 QTime=15
[junit4] 2> 30355 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 5
[junit4] 2> 30356 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 30356 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 30356 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 30356 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 30356 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 30356 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 5
[junit4] 2> 30358 INFO
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest
TestTriggerAction init
[junit4] 2> 30360 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T07:27:37+10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 30361 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 30361 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger2
[junit4] 2> 30361 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 30362 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 30362 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 30362 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 30363 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@42d63aff{/solr,null,AVAILABLE}
[junit4] 2> 30363 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.AbstractConnector Started ServerConnector@65392ad9{SSL,[ssl,
http/1.1]}{127.0.0.1:46072}
[junit4] 2> 30364 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.Server Started @32919ms
[junit4] 2> 30364 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=46072}
[junit4] 2> 30364 ERROR
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 30364 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 30364 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
null
[junit4] 2> 30364 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 30364 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-02-26T11:03:06.078Z
[junit4] 2> 30377 INFO (zkConnectionManagerCallback-67-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30379 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 30390 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51111/solr
[junit4] 2> 30400 INFO (zkConnectionManagerCallback-71-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30407 INFO
(zkConnectionManagerCallback-73-thread-1-processing-n:127.0.0.1:46072_solr)
[n:127.0.0.1:46072_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 30415 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (2)
[junit4] 2> 30416 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 30419 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:46072_solr
[junit4] 2> 30420 INFO (zkCallback-53-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 30421 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 30421 INFO
(zkCallback-72-thread-1-processing-n:127.0.0.1:46072_solr)
[n:127.0.0.1:46072_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 30426 INFO (zkCallback-53-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 30427 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (3)
[junit4] 2> 30537 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_46072.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 30551 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_46072.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 30551 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_46072.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 30553 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8])
[n:127.0.0.1:46072_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001/tempDir-001/node4/.
[junit4] 2> 31009 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 3
[junit4] 2> 31349 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger1
[junit4] 2> 31349 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 31349 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node:
127.0.0.1:46072_solr at time 19894893582611547
[junit4] 2> 31349 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger1 firing registered processor for nodes:
[127.0.0.1:46072_solr] added at times [19894893582611547], now=19894893582731377
[junit4] 2> 31350 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown
inactive - processing event: {
[junit4] 2> "id":"46ae4ce0d5f45bTest4fca8ihhox4gl8z8xk9ams",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":19894893582611547,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894893582611547],
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 31351 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers:
[.auto_add_replicas, node_added_trigger2, node_added_trigger1]
[junit4] 2> 31354 INFO (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.SystemLogListener Collection .system
does not exist, disabling logging.
[junit4] 2> 31356 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions
for {
[junit4] 2> "id":"46ae4ce0d5f45bTest4fca8ihhox4gl8z8xk9ams",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":19894893582611547,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894893582611547],
[junit4] 2> "_enqueue_time_":19894893585482963,
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 31360 INFO
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest action executed
from node_added_trigger1
[junit4] 2> 31365 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
.auto_add_replicas after 5000ms
[junit4] 2> 31365 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger2 after 5000ms
[junit4] 2> 31365 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger1 after 5000ms
[junit4] 2> 31365 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 9
ms for event id=46ae4ce0d5f45bTest4fca8ihhox4gl8z8xk9ams
[junit4] 2> 36365 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 3
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger2
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node:
127.0.0.1:46072_solr at time 19894898599765696
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger2 firing registered processor for nodes:
[127.0.0.1:46072_solr] added at times [19894898599765696], now=19894898599807195
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger1
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown
inactive - processing event: {
[junit4] 2> "id":"46ae4e0be1a6c0Test4fca8ihhox4gl8z8xk9amu",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":19894898599765696,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894898599765696],
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 36366 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers:
[.auto_add_replicas, node_added_trigger2, node_added_trigger1]
[junit4] 2> 36368 INFO (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.SystemLogListener Collection .system
does not exist, disabling logging.
[junit4] 2> 36368 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions
for {
[junit4] 2> "id":"46ae4e0be1a6c0Test4fca8ihhox4gl8z8xk9amu",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":19894898599765696,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894898599765696],
[junit4] 2> "_enqueue_time_":19894898600119266,
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 36369 INFO
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest last action at
1519642987074000000 current time = 1519642992082000000
[junit4] 2> real diff: 5008000000
[junit4] 2> min diff: 4998000000
[junit4] 2> 36369 INFO
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest action executed
from node_added_trigger2
[junit4] 2> 36382 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
.auto_add_replicas after 5000ms
[junit4] 2> 36382 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger2 after 5000ms
[junit4] 2> 36382 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger1 after 5000ms
[junit4] 2> 36382 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 13
ms for event id=46ae4e0be1a6c0Test4fca8ihhox4gl8z8xk9amu
[junit4] 2> 36412 INFO (qtp1798002316-341) [n:127.0.0.1:46072_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 36418 INFO (qtp1626247802-253) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 36423 INFO (qtp1116897922-313) [n:127.0.0.1:52556_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 36424 DEBUG (qtp1798002316-339) [n:127.0.0.1:46072_solr ]
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 36425 INFO (qtp1798002316-339) [n:127.0.0.1:46072_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling
params={wt=javabin&version=2} status=0 QTime=28
[junit4] 2> 36425 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 6
[junit4] 2> 36426 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36426 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 36426 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36426 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36426 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 36427 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36427 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 6
[junit4] 2> 36429 INFO
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest
TestTriggerAction init
[junit4] 2> 36430 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
node_lost_trigger1 with currently live nodes: 3
[junit4] 2> 36430 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 36432 INFO (qtp1798002316-340) [n:127.0.0.1:46072_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 36437 INFO (qtp1626247802-248) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 36440 INFO (qtp1116897922-315) [n:127.0.0.1:52556_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 36441 DEBUG (qtp1798002316-337) [n:127.0.0.1:46072_solr ]
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 36442 INFO (qtp1798002316-337) [n:127.0.0.1:46072_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling
params={wt=javabin&version=2} status=0 QTime=13
[junit4] 2> 36442 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 7
[junit4] 2> 36442 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36442 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 36443 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36443 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36443 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger
node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0,
actions=[{name=test,
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
enabled=true}
[junit4] 2> 36443 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36444 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:46072_solr, 127.0.0.1:49900_solr, 127.0.0.1:52556_solr]
[junit4] 2> 36444 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 7
[junit4] 2> 36446 INFO
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest
TestTriggerAction init
[junit4] 2> 36447 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 36448 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
node_lost_trigger2 with currently live nodes: 3
[junit4] 2> 36448 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.AbstractConnector Stopped ServerConnector@65392ad9{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 36448 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1583929461
[junit4] 2> 36448 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node,
tag=null
[junit4] 2> 36449 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@72d2b53e: rootName =
solr_46072, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@5a74acf2
[junit4] 2> 36457 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm,
tag=null
[junit4] 2> 36457 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@689931dd: rootName =
solr_46072, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@7c9c0827
[junit4] 2> 36463 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 36463 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@7b437b36: rootName =
solr_46072, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@429e79a1
[junit4] 2> 36465 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:46072_solr
[junit4] 2> 36466 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (2)
[junit4] 2> 36466 INFO
(zkCallback-72-thread-1-processing-n:127.0.0.1:46072_solr)
[n:127.0.0.1:46072_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (2)
[junit4] 2> 36466 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (2)
[junit4] 2> 36466 INFO (zkCallback-53-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 36466 INFO (zkCallback-53-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 36467 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.cluster, tag=null
[junit4] 2> 36467 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for
2147483647 transient cores
[junit4] 2> 36471 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@42d63aff{/solr,null,UNAVAILABLE}
[junit4] 2> 36471 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.e.j.s.session Stopped scavenging
[junit4] 2> 37434 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
node_lost_trigger1 with currently live nodes: 2
[junit4] 2> 37434 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node:
127.0.0.1:46072_solr
[junit4] 2> 37434 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing
registered processor for lost nodes: [127.0.0.1:46072_solr]
[junit4] 2> 37434 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown
inactive - processing event: {
[junit4] 2> "id":"46ae4e4b83b690Test4fca8ihhox4gl8z8xk9amw",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":19894899667351184,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894899667351184],
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 37434 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers:
[node_lost_trigger2, .auto_add_replicas, node_added_trigger2,
node_lost_trigger1, node_added_trigger1]
[junit4] 2> 37435 INFO (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.SystemLogListener Collection .system
does not exist, disabling logging.
[junit4] 2> 37435 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions
for {
[junit4] 2> "id":"46ae4e4b83b690Test4fca8ihhox4gl8z8xk9amw",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":19894899667351184,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894899667351184],
[junit4] 2> "_enqueue_time_":19894899667842598,
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 37435 INFO
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest action executed
from node_lost_trigger1
[junit4] 2> 37438 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_lost_trigger2 after 5000ms
[junit4] 2> 37438 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
.auto_add_replicas after 5000ms
[junit4] 2> 37438 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger2 after 5000ms
[junit4] 2> 37438 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_lost_trigger1 after 5000ms
[junit4] 2> 37438 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger1 after 5000ms
[junit4] 2> 37438 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 2
ms for event id=46ae4e4b83b690Test4fca8ihhox4gl8z8xk9amw
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 2
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
node_lost_trigger2 with currently live nodes: 2
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-1)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node:
127.0.0.1:46072_solr
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node:
127.0.0.1:46072_solr
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-3)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger2
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing
registered processor for lost nodes: [127.0.0.1:46072_solr]
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-3)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
node_lost_trigger1 with currently live nodes: 2
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown
inactive - processing event: {
[junit4] 2> "id":"46ae4f75d954c9Test4fca8ihhox4gl8z8xk9amy",
[junit4] 2> "source":"node_lost_trigger2",
[junit4] 2> "eventTime":19894904672572617,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894904672572617],
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Running
NodeAddedTrigger node_added_trigger1
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers:
[node_lost_trigger2, .auto_add_replicas, node_added_trigger2,
node_lost_trigger1, node_added_trigger1]
[junit4] 2> 42439 DEBUG (ScheduledTrigger-136-thread-2)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
[junit4] 2> 42442 INFO (ScheduledTrigger-136-thread-4)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.SystemLogListener Collection .system
does not exist, disabling logging.
[junit4] 2> 42443 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions
for {
[junit4] 2> "id":"46ae4f75d954c9Test4fca8ihhox4gl8z8xk9amy",
[junit4] 2> "source":"node_lost_trigger2",
[junit4] 2> "eventTime":19894904672572617,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[19894904672572617],
[junit4] 2> "_enqueue_time_":19894904672948639,
[junit4] 2> "nodeNames":["127.0.0.1:46072_solr"]}}
[junit4] 2> 42443 INFO
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest last action at
1519642993149000000 current time = 1519642998157000000
[junit4] 2> real diff: 5008000000
[junit4] 2> min diff: 4998000000
[junit4] 2> 42443 INFO
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.TriggerIntegrationTest action executed
from node_lost_trigger2
[junit4] 2> 42444 INFO
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[6457619E7BD55BD8]) [
] o.a.s.SolrTestCaseJ4 ###Ending testTriggerThrottling
[junit4] 2> 42449 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_lost_trigger2 after 5000ms
[junit4] 2> 42449 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
.auto_add_replicas after 5000ms
[junit4] 2> 42449 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger2 after 5000ms
[junit4] 2> 42449 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_lost_trigger1 after 5000ms
[junit4] 2> 42449 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
node_added_trigger1 after 5000ms
[junit4] 2> 42449 DEBUG
(AutoscalingActionExecutor-137-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 6
ms for event id=46ae4f75d954c9Test4fca8ihhox4gl8z8xk9amy
[junit4] 2> 42460 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
[junit4] 2> 42463 INFO (qtp1626247802-254) [n:127.0.0.1:49900_solr ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 42483 INFO (qtp1626247802-254) [n:127.0.0.1:49900_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=20
[junit4] 2> 42483 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_lost_trigger2
[junit4] 2> 42484 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
[junit4] 2> 42485 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_trigger2
[junit4] 2> 42486 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_lost_trigger1
[junit4] 2> 42487 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_trigger1
[junit4] 2> 42488 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode
version 8
[junit4] 2> 42489 DEBUG
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 8
[junit4] 2> 42489 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 8
[junit4] 2> 42489 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeLost markers
[junit4] 2> 42489 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeAdded markers
[junit4] 2> 42489 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 42489 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 42499 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.AbstractConnector Stopped ServerConnector@31e8f6ab{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 42505 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1550036723
[junit4] 2> 42505 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.node, tag=null
[junit4] 2> 42506 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@308ddd95: rootName =
solr_49900, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@97b36d0
[junit4] 2> 42513 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.jvm, tag=null
[junit4] 2> 42513 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@6c4138de: rootName =
solr_49900, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@7c9c0827
[junit4] 2> 42518 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.jetty, tag=null
[junit4] 2> 42518 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@233b6747: rootName =
solr_49900, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@429e79a1
[junit4] 2> 42526 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:49900_solr
[junit4] 2> 42527 INFO (zkCallback-53-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 42527 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 42527 INFO (zkCallback-53-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 42528 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.cluster, tag=null
[junit4] 2> 42528 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for
2147483647 transient cores
[junit4] 2> 42528 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.Overseer Overseer
(id=73361425252352006-127.0.0.1:49900_solr-n_0000000001) closing
[junit4] 2> 42529 DEBUG
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed
explicitly
[junit4] 2> 42529 WARN
(OverseerAutoScalingTriggerThread-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.a.OverseerTriggerThread
OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 42530 INFO
(OverseerStateUpdate-73361425252352006-127.0.0.1:49900_solr-n_0000000001)
[n:127.0.0.1:49900_solr ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:49900_solr
[junit4] 2> 42530 INFO
(zkCallback-43-thread-1-processing-n:127.0.0.1:49900_solr)
[n:127.0.0.1:49900_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 42532 INFO (zkCallback-53-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 42533 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:52556_solr
[junit4] 2> 42534 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@11c52e75{/solr,null,UNAVAILABLE}
[junit4] 2> 42534 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 42535 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.Overseer Overseer
(id=73361425252352011-127.0.0.1:52556_solr-n_0000000002) starting
[junit4] 2> 42549 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.OverseerTriggerThread Adding
.autoAddReplicas trigger
[junit4] 2> 42551 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
/autoscaling.json with znode version 9
[junit4] 2> 42552 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
[127.0.0.1:52556_solr]
[junit4] 2> 42552 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 9, lastZnodeVersion -1
[junit4] 2> 42552 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger
updates upto znodeVersion 9
[junit4] 2> 42558 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
nodeAdded markers
[junit4] 2> 42559 DEBUG
(OverseerAutoScalingTriggerThread-73361425252352011-127.0.0.1:52556_solr-n_0000000002)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.OverseerTriggerThread Current
znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 42559 DEBUG (ScheduledTrigger-154-thread-1)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 43560 DEBUG (ScheduledTrigger-154-thread-1)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 44561 DEBUG (ScheduledTrigger-154-thread-2)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 45561 DEBUG (ScheduledTrigger-154-thread-1)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 46561 DEBUG (ScheduledTrigger-154-thread-1)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 47561 DEBUG (ScheduledTrigger-154-thread-1)
[n:127.0.0.1:52556_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger:
.auto_add_replicas with currently live nodes: 1
[junit4] 2> 47653 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T07:27:37+10:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 47654 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 47654 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 47654 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 47655 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@f3234c6{/solr,null,AVAILABLE}
[junit4] 2> 47655 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.AbstractConnector Started ServerConnector@700bce83{SSL,[ssl,
http/1.1]}{127.0.0.1:51608}
[junit4] 2> 47655 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.e.j.s.Server Started @50210ms
[junit4] 2> 47655 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=51608}
[junit4] 2> 47656 ERROR
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 47656 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 7.3.0
[junit4] 2> 47656 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 47656 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 47656 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-02-26T11:03:23.370Z
[junit4] 2> 47662 INFO (zkConnectionManagerCallback-78-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 47663 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 47678 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51111/solr
[junit4] 2> 47692 INFO (zkConnectionManagerCallback-82-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 47715 INFO
(zkConnectionManagerCallback-84-thread-1-processing-n:127.0.0.1:51608_solr)
[n:127.0.0.1:51608_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 47732 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[n:127.0.0.1:51608_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 47734 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[n:127.0.0.1:51608_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 47736 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[n:127.0.0.1:51608_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:51608_solr
[junit4] 2> 47737 INFO
(zkCallback-62-thread-1-processing-n:127.0.0.1:52556_solr)
[n:127.0.0.1:52556_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 47737 INFO (zkCallback-53-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 47738 INFO (zkCallback-53-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 47738 INFO (zkCallback-53-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 47755 INFO
(zkCallback-83-thread-1-processing-n:127.0.0.1:51608_solr)
[n:127.0.0.1:51608_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (2)
[junit4] 2> 47827 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[n:127.0.0.1:51608_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_51608.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 47838 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[n:127.0.0.1:51608_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_51608.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@4dbce24a
[junit4] 2> 47839 INFO
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[6457619E7BD55BD8])
[n:127.0.0.1:51608_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_51608.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mb
[...truncated too long message...]
eporters.SolrJmxReporter@51996831: rootName = solr_46138, domain = solr.jvm,
service url = null, agent id = null] for registry solr.jvm /
com.codahale.metrics.MetricRegistry@7c9c0827
[junit4] 2> 302501 INFO
(zkCallback-312-thread-1-processing-n:127.0.0.1:59192_solr)
[n:127.0.0.1:59192_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (3)
[junit4] 2> 302501 INFO
(zkCallback-275-thread-2-processing-n:127.0.0.1:38790_solr)
[n:127.0.0.1:38790_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (3)
[junit4] 2> 302501 INFO
(zkCallback-285-thread-1-processing-n:127.0.0.1:46138_solr)
[n:127.0.0.1:46138_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (3)
[junit4] 2> 302502 INFO (jetty-closer-26-thread-3) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 302504 INFO (jetty-closer-26-thread-4) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 302505 INFO (jetty-closer-26-thread-4) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@2e557e48: rootName =
solr_59192, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@429e79a1
[junit4] 2> 302506 INFO (jetty-closer-26-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 302506 INFO (jetty-closer-26-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@44d2ca8a: rootName =
solr_46138, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@429e79a1
[junit4] 2> 302506 INFO
(zkCallback-301-thread-1-processing-n:127.0.0.1:56933_solr)
[n:127.0.0.1:56933_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (4) -> (3)
[junit4] 2> 302507 INFO (jetty-closer-26-thread-3) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 302514 INFO (jetty-closer-26-thread-3) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@14c55cc8{/solr,null,UNAVAILABLE}
[junit4] 2> 302514 INFO (jetty-closer-26-thread-3) [ ] o.e.j.s.session
Stopped scavenging
[junit4] 2> 302515 INFO (jetty-closer-26-thread-4) [ ]
o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:59192_solr
[junit4] 2> 302516 INFO (jetty-closer-26-thread-1) [ ]
o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:38790_solr
[junit4] 2> 302517 INFO (jetty-closer-26-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 302517 INFO
(zkCallback-285-thread-1-processing-n:127.0.0.1:46138_solr)
[n:127.0.0.1:46138_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (2)
[junit4] 2> 302517 INFO
(zkCallback-312-thread-1-processing-n:127.0.0.1:59192_solr)
[n:127.0.0.1:59192_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (2)
[junit4] 2> 302517 INFO
(zkCallback-275-thread-2-processing-n:127.0.0.1:38790_solr)
[n:127.0.0.1:38790_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (3) -> (2)
[junit4] 2> 302518 INFO (jetty-closer-26-thread-2) [ ]
o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:46138_solr
[junit4] 2> 302519 INFO
(zkCallback-275-thread-1-processing-n:127.0.0.1:38790_solr)
[n:127.0.0.1:38790_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 302519 INFO
(zkCallback-312-thread-1-processing-n:127.0.0.1:59192_solr)
[n:127.0.0.1:59192_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 302519 INFO (jetty-closer-26-thread-4) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 302519 INFO (jetty-closer-26-thread-4) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 302521 INFO
(zkCallback-285-thread-1-processing-n:127.0.0.1:46138_solr)
[n:127.0.0.1:46138_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (2) -> (1)
[junit4] 2> 302524 INFO (jetty-closer-26-thread-1) [ ]
o.a.s.c.Overseer Overseer
(id=73361425252352071-127.0.0.1:38790_solr-n_0000000022) closing
[junit4] 2> 302524 INFO
(OverseerStateUpdate-73361425252352071-127.0.0.1:38790_solr-n_0000000022)
[n:127.0.0.1:38790_solr ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:38790_solr
[junit4] 2> 302525 INFO (jetty-closer-26-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 302525 INFO (jetty-closer-26-thread-2) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 302528 WARN
(OverseerAutoScalingTriggerThread-73361425252352071-127.0.0.1:38790_solr-n_0000000022)
[n:127.0.0.1:38790_solr ] o.a.s.c.a.OverseerTriggerThread
OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 302528 INFO
(zkCallback-275-thread-1-processing-n:127.0.0.1:38790_solr)
[n:127.0.0.1:38790_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (0)
[junit4] 2> 302528 INFO
(zkCallback-285-thread-2-processing-n:127.0.0.1:46138_solr)
[n:127.0.0.1:46138_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (1) -> (0)
[junit4] 2> 302531 INFO (jetty-closer-26-thread-4) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@332d103b{/solr,null,UNAVAILABLE}
[junit4] 2> 302531 INFO (jetty-closer-26-thread-4) [ ] o.e.j.s.session
Stopped scavenging
[junit4] 2> 302532 DEBUG (jetty-closer-26-thread-1) [ ]
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 302535 INFO (jetty-closer-26-thread-2) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@490c1f93{/solr,null,UNAVAILABLE}
[junit4] 2> 302535 INFO (jetty-closer-26-thread-2) [ ] o.e.j.s.session
Stopped scavenging
[junit4] 2> 302542 INFO (jetty-closer-26-thread-1) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@33c433d8{/solr,null,UNAVAILABLE}
[junit4] 2> 302542 INFO (jetty-closer-26-thread-1) [ ] o.e.j.s.session
Stopped scavenging
[junit4] 2> 302550 ERROR
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper
server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 302552 INFO
(SUITE-TriggerIntegrationTest-seed#[6457619E7BD55BD8]-worker) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:51111 51111
[junit4] 2> 302719 INFO (Thread-91) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:51111 51111
[junit4] 2> 302721 WARN (Thread-91) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 41 /solr/aliases.json
[junit4] 2> 36 /solr/collections/collection1/terms/shard1
[junit4] 2> 26 /solr/security.json
[junit4] 2> 12 /solr/collections/testMetricTrigger/terms/shard1
[junit4] 2> 9 /solr/configs/conf
[junit4] 2> 3 /solr/collections/testMetricTrigger/terms/shard2
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 65 /solr/collections/collection1/state.json
[junit4] 2> 41 /solr/clusterprops.json
[junit4] 2> 41 /solr/clusterstate.json
[junit4] 2> 37 /solr/collections/testMetricTrigger/state.json
[junit4] 2> 20 /solr/autoscaling.json
[junit4] 2> 2
/solr/overseer_elect/election/73361425252352041-127.0.0.1:32869_solr-n_0000000012
[junit4] 2> 2
/solr/overseer_elect/election/73361425252352026-127.0.0.1:50794_solr-n_0000000007
[junit4] 2> 2
/solr/collections/collection1/leader_elect/shard1/election/73361425252352056-core_node3-n_0000000001
[junit4] 2> 2
/solr/collections/collection1/leader_elect/shard1/election/73361425252352062-core_node6-n_0000000002
[junit4] 2> 2
/solr/overseer_elect/election/73361425252352011-127.0.0.1:52556_solr-n_0000000002
[junit4] 2> 2
/solr/overseer_elect/election/73361425252352074-127.0.0.1:46138_solr-n_0000000023
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 363 /solr/live_nodes
[junit4] 2> 87 /solr/collections
[junit4] 2> 20 /solr/overseer/queue-work
[junit4] 2> 20 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 20 /solr/overseer/queue
[junit4] 2> 20 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/node_lost_triggerMR
[junit4] 2> 2 /solr/autoscaling/events/node_added_triggerCTOOR
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6457619E7BD55BD8-001
[junit4] 2> NOTE: test params are: codec=CheapBastard,
sim=RandomSimilarity(queryNorm=false): {}, locale=ms, timezone=Asia/Aqtobe
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation
1.8.0_144 (64-bit)/cpus=4,threads=1,free=206119432,total=283115520
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedMissingSort,
TriggerIntegrationTest]
[junit4] Completed [65/777 (1!)] on J2 in 279.68s, 14 tests, 1 failure <<<
FAILURES!
[...truncated 50292 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
