Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21496/ Java: 64bit/jdk1.8.0_162 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
No tests ran. Build Log: [...truncated 12162 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.ComputePlanActionTest [junit4] 2> 74098 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/init-core-data-001 [junit4] 2> 74099 WARN (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1 [junit4] 2> 74099 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 74101 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 74102 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001 [junit4] 2> 74102 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 74102 INFO (Thread-198) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 74102 INFO (Thread-198) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 74106 ERROR (Thread-198) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 74202 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:40449 [junit4] 2> 74205 INFO (zkConnectionManagerCallback-187-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74210 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 74243 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 74243 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 74243 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 74247 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fae5ce6{/solr,null,AVAILABLE} [junit4] 2> 74249 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@582fd689{SSL,[ssl, http/1.1]}{127.0.0.1:44063} [junit4] 2> 74249 INFO (jetty-launcher-184-thread-1) [ ] o.e.j.s.Server Started @76120ms [junit4] 2> 74249 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44063} [junit4] 2> 74250 ERROR (jetty-launcher-184-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 74250 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 74250 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 74250 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 74250 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-20T05:56:40.041Z [junit4] 2> 74263 INFO (zkConnectionManagerCallback-189-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74263 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 74270 INFO (jetty-launcher-184-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40449/solr [junit4] 2> 74271 INFO (zkConnectionManagerCallback-193-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74275 INFO (zkConnectionManagerCallback-195-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74337 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 74338 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44063_solr [junit4] 2> 74338 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer Overseer (id=72180104436776963-127.0.0.1:44063_solr-n_0000000000) starting [junit4] 2> 74347 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 74347 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44063_solr [junit4] 2> 74347 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger [junit4] 2> 74348 INFO (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 74356 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 74356 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:44063_solr] [junit4] 2> 74356 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1 [junit4] 2> 74356 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 74359 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 74359 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 74360 DEBUG (ScheduledTrigger-283-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 [junit4] 2> 74414 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44063.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 74418 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44063.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 74418 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44063.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 74419 INFO (jetty-launcher-184-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node1/. [junit4] 2> 74438 INFO (zkConnectionManagerCallback-199-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74451 INFO (zkConnectionManagerCallback-203-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74452 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 74452 INFO (SUITE-ComputePlanActionTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40449/solr ready [junit4] 2> 74461 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLost [junit4] 2> 74462 DEBUG (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2 [junit4] 2> 74462 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2 [junit4] 2> 74462 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 74463 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 74463 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 74463 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2 [junit4] 2> 74563 INFO (qtp1248966674-810) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=9 [junit4] 2> 74566 DEBUG (qtp1248966674-813) [n:127.0.0.1:44063_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 74567 INFO (qtp1248966674-813) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=57 [junit4] 2> 74567 DEBUG (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3 [junit4] 2> 74567 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3 [junit4] 2> 74568 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 74568 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 74568 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3 [junit4] 2> 74577 INFO (qtp1248966674-814) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 74578 DEBUG (qtp1248966674-813) [n:127.0.0.1:44063_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 74579 INFO (qtp1248966674-813) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=4 [junit4] 2> 74579 DEBUG (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4 [junit4] 2> 74579 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4 [junit4] 2> 74579 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 74580 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 74580 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4 [junit4] 2> 74581 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 74590 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 74590 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 74590 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 74591 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36e51be{/solr,null,AVAILABLE} [junit4] 2> 74592 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6bbd9143{SSL,[ssl, http/1.1]}{127.0.0.1:46747} [junit4] 2> 74592 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.Server Started @76463ms [junit4] 2> 74592 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46747} [junit4] 2> 74593 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 74593 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 74593 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 74593 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 74593 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-20T05:56:40.384Z [junit4] 2> 74599 INFO (zkConnectionManagerCallback-206-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74599 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 74607 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40449/solr [junit4] 2> 74615 INFO (zkConnectionManagerCallback-210-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74623 INFO (zkConnectionManagerCallback-212-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 74626 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 74628 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 74632 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46747_solr [junit4] 2> 74632 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"downnode", [junit4] 2> "node_name":"127.0.0.1:46747_solr"} current state version: 0 [junit4] 2> 74632 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:46747_solr [junit4] 2> 74633 INFO (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 74640 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 74643 INFO (zkCallback-202-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 74644 INFO (zkCallback-202-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 74678 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46747.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 74687 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46747.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 74687 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46747.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 74689 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:46747_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node2/. [junit4] 2> 74765 INFO (qtp1248966674-814) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 74790 INFO (qtp701790142-849) [n:127.0.0.1:46747_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 74790 DEBUG (qtp701790142-854) [n:127.0.0.1:46747_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 74791 INFO (qtp701790142-854) [n:127.0.0.1:46747_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=56 [junit4] 2> 74791 DEBUG (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5 [junit4] 2> 74792 DEBUG (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46747_solr, 127.0.0.1:44063_solr] [junit4] 2> 74792 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5 [junit4] 2> 74793 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 74793 DEBUG (OverseerAutoScalingTriggerThread-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5 [junit4] 2> 74793 DEBUG (ScheduledTrigger-283-thread-1) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 74804 INFO (qtp1248966674-815) [n:127.0.0.1:44063_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 74808 INFO (OverseerThreadFactory-285-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testNodeLost [junit4] 2> 74827 INFO (qtp1248966674-810) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 74838 INFO (qtp701790142-854) [n:127.0.0.1:46747_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 74851 INFO (OverseerThreadFactory-285-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1869361080 sessionWrapper.createTime 1869361068239690, this.sessionWrapper.createTime 1869361068239690 [junit4] 2> 74853 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "name":"testNodeLost", [junit4] 2> "fromApi":"true", [junit4] 2> "replicationFactor":"2", [junit4] 2> "collection.configName":"conf", [junit4] 2> "numShards":"1", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "stateFormat":"2", [junit4] 2> "operation":"create"} current state version: 0 [junit4] 2> 74853 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: testNodeLost [junit4] 2> 74858 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testNodeLost/state.json [junit4] 2> 74955 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} current state version: 0 [junit4] 2> 74956 INFO (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.SliceMutator createReplica() { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} [junit4] 2> 74956 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{}} [junit4] 2> 74957 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{"core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "state":"down", [junit4] 2> "node_name":null, [junit4] 2> "type":"NRT"}}} [junit4] 2> 74959 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} current state version: 0 [junit4] 2> 74959 INFO (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.SliceMutator createReplica() { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} [junit4] 2> 74960 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{"core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "state":"down", [junit4] 2> "node_name":null, [junit4] 2> "type":"NRT"}}} [junit4] 2> 74960 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "state":"down", [junit4] 2> "node_name":null, [junit4] 2> "type":"NRT"}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "state":"down", [junit4] 2> "node_name":null, [junit4] 2> "type":"NRT"}}} [junit4] 2> 75061 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 0 [junit4] 2> 75184 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 75184 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 75184 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 75184 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 75187 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "core_node_name":"core_node3", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 75187 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "core_node_name":"core_node3", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} [junit4] 2> 75187 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:46747/solr","node_name":"127.0.0.1:46747_solr","state":"down","type":"NRT"} [junit4] 2> 75187 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={ [junit4] 2> "pullReplicas":"0", [junit4] 2> "replicationFactor":"2", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"1", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "shards":{"shard1":{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "state":"down", [junit4] 2> "type":"NRT"}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "state":"down", [junit4] 2> "node_name":null, [junit4] 2> "type":"NRT"}}}}} [junit4] 2> 75192 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = { [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "core_node_name":"core_node4", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 75192 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "core_node_name":"core_node4", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} [junit4] 2> 75192 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"https://127.0.0.1:44063/solr","node_name":"127.0.0.1:44063_solr","state":"down","type":"NRT"} [junit4] 2> 75192 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/1)={ [junit4] 2> "pullReplicas":"0", [junit4] 2> "replicationFactor":"2", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"1", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "shards":{"shard1":{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "state":"down", [junit4] 2> "type":"NRT"}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "state":"down", [junit4] 2> "type":"NRT"}}}}} [junit4] 2> 75293 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 1 [junit4] 2> 75293 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 75295 INFO (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 75296 INFO (zkCallback-211-thread-2-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 75296 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 75794 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 76205 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0 [junit4] 2> 76209 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0 [junit4] 2> 76210 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n1] Schema name=minimal [junit4] 2> 76212 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 76212 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n1' using configuration from collection testNodeLost, trusted=true [junit4] 2> 76213 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46747.solr.core.testNodeLost.shard1.replica_n1' (registry 'solr.core.testNodeLost.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 76213 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.IndexSchema [testNodeLost_shard1_replica_n2] Schema name=minimal [junit4] 2> 76213 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 76213 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node2/testNodeLost_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node2/./testNodeLost_shard1_replica_n1/data/] [junit4] 2> 76215 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 76215 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testNodeLost_shard1_replica_n2' using configuration from collection testNodeLost, trusted=true [junit4] 2> 76215 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44063.solr.core.testNodeLost.shard1.replica_n2' (registry 'solr.core.testNodeLost.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 76215 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 76215 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [[testNodeLost_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node1/testNodeLost_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node1/./testNodeLost_shard1_replica_n2/data/] [junit4] 2> 76257 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 76257 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 76258 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 76258 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 76258 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 76258 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 76258 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 76258 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 76260 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a71421[testNodeLost_shard1_replica_n1] main] [junit4] 2> 76260 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@36173c38[testNodeLost_shard1_replica_n2] main] [junit4] 2> 76260 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 76260 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 76260 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf [junit4] 2> 76260 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf [junit4] 2> 76261 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 76261 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 76262 INFO (searcherExecutor-295-thread-1-processing-n:127.0.0.1:44063_solr x:testNodeLost_shard1_replica_n2 s:shard1 c:testNodeLost r:core_node4) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n2] Registered new searcher Searcher@36173c38[testNodeLost_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 76262 INFO (searcherExecutor-294-thread-1-processing-n:127.0.0.1:46747_solr x:testNodeLost_shard1_replica_n1 s:shard1 c:testNodeLost r:core_node3) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n1] Registered new searcher Searcher@3a71421[testNodeLost_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 76262 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592898304923926528 [junit4] 2> 76262 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1592898304923926528 [junit4] 2> 76265 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.ZkShardTerms Failed to save terms, version is not match, retrying [junit4] 2> 76267 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 76267 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 76267 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost"} current state version: 0 [junit4] 2> 76267 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44063/solr/testNodeLost_shard1_replica_n2/ [junit4] 2> 76267 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n2 url=https://127.0.0.1:44063/solr START replicas=[https://127.0.0.1:46747/solr/testNodeLost_shard1_replica_n1/] nUpdates=100 [junit4] 2> 76272 INFO (qtp701790142-875) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.S.Request [testNodeLost_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0 [junit4] 2> 76368 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 2 [junit4] 2> 76368 INFO (zkCallback-211-thread-2-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76368 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76368 INFO (zkCallback-194-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76368 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76568 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=testNodeLost_shard1_replica_n2 url=https://127.0.0.1:44063/solr DONE. We have no versions. sync failed. [junit4] 2> 76568 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate [junit4] 2> 76568 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway [junit4] 2> 76568 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 76570 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:44063/solr/testNodeLost_shard1_replica_n2/ shard1 [junit4] 2> 76570 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "state":"active"} current state version: 0 [junit4] 2> 76671 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 3 [junit4] 2> 76671 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76671 INFO (zkCallback-211-thread-2-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76671 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76671 INFO (zkCallback-194-thread-3-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76720 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 76722 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "core_node_name":"core_node4", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 76722 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "core_node_name":"core_node4", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} [junit4] 2> 76722 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"testNodeLost_shard1_replica_n2","base_url":"https://127.0.0.1:44063/solr","node_name":"127.0.0.1:44063_solr","state":"active","type":"NRT","leader":"true"} [junit4] 2> 76722 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/4)={ [junit4] 2> "pullReplicas":"0", [junit4] 2> "replicationFactor":"2", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"1", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "shards":{"shard1":{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "state":"down", [junit4] 2> "type":"NRT"}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "leader":"true"}}}}} [junit4] 2> 76759 INFO (qtp1248966674-846) [n:127.0.0.1:44063_solr c:testNodeLost s:shard1 r:core_node4 x:testNodeLost_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n2&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1575 [junit4] 2> 76794 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 76823 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 4 [junit4] 2> 76823 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76823 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76823 INFO (zkCallback-211-thread-2-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 76823 INFO (zkCallback-194-thread-3-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77269 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "core_node_name":"core_node3", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 77269 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "core_node_name":"core_node3", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testNodeLost", [junit4] 2> "type":"NRT", [junit4] 2> "operation":"state"} [junit4] 2> 77269 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:46747/solr","node_name":"127.0.0.1:46747_solr","state":"active","type":"NRT"} [junit4] 2> 77269 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(testNodeLost//collections/testNodeLost/state.json/5)={ [junit4] 2> "pullReplicas":"0", [junit4] 2> "replicationFactor":"2", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"1", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "shards":{"shard1":{ [junit4] 2> "range":"80000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n1", [junit4] 2> "base_url":"https://127.0.0.1:46747/solr", [junit4] 2> "node_name":"127.0.0.1:46747_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT"}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testNodeLost_shard1_replica_n2", [junit4] 2> "base_url":"https://127.0.0.1:44063/solr", [junit4] 2> "node_name":"127.0.0.1:44063_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "leader":"true"}}}}} [junit4] 2> 77369 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 5 [junit4] 2> 77370 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77370 INFO (zkCallback-211-thread-2-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77370 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77370 INFO (zkCallback-194-thread-3-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77455 INFO (qtp701790142-848) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testNodeLost_shard1_replica_n1&action=CREATE&numShards=1&collection=testNodeLost&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2270 [junit4] 2> 77457 INFO (qtp1248966674-815) [n:127.0.0.1:44063_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas [junit4] 2> 77457 INFO (qtp1248966674-815) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=testNodeLost&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2653 [junit4] 2> 77461 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 77461 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 77461 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 77461 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 77462 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5adade3a{/solr,null,AVAILABLE} [junit4] 2> 77462 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6d3b554{SSL,[ssl, http/1.1]}{127.0.0.1:38773} [junit4] 2> 77462 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.Server Started @79333ms [junit4] 2> 77462 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38773} [junit4] 2> 77463 ERROR (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 77463 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 77463 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 77463 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 77463 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-02-20T05:56:43.254Z [junit4] 2> 77464 INFO (zkConnectionManagerCallback-216-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 77464 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 77473 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40449/solr [junit4] 2> 77474 INFO (zkConnectionManagerCallback-220-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 77476 INFO (zkConnectionManagerCallback-222-thread-1-processing-n:127.0.0.1:38773_solr) [n:127.0.0.1:38773_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 77480 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 77480 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 77482 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38773_solr [junit4] 2> 77482 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 77482 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 77483 INFO (zkCallback-221-thread-1-processing-n:127.0.0.1:38773_solr) [n:127.0.0.1:38773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 77483 INFO (zkCallback-202-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 77483 INFO (zkCallback-202-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 77483 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"downnode", [junit4] 2> "node_name":"127.0.0.1:38773_solr"} current state version: 0 [junit4] 2> 77483 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:38773_solr [junit4] 2> 77520 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38773.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 77526 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38773.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 77526 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38773.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bcb845b [junit4] 2> 77527 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [n:127.0.0.1:38773_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ComputePlanActionTest_6E81E6D1177700DE-001/tempDir-001/node3/. [junit4] 2> 77553 INFO (zkConnectionManagerCallback-226-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 77555 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6bbd9143{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 77555 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=135412288 [junit4] 2> 77555 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 77556 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@27d5376e: rootName = solr_46747, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@248e291 [junit4] 2> 77560 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 77560 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7463ec64: rootName = solr_46747, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1b4e662f [junit4] 2> 77563 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 77563 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@184a124a: rootName = solr_46747, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2b0a4f24 [junit4] 2> 77564 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:46747_solr [junit4] 2> 77564 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 77565 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = { [junit4] 2> "operation":"downnode", [junit4] 2> "node_name":"127.0.0.1:46747_solr"} current state version: 0 [junit4] 2> 77565 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:46747_solr [junit4] 2> 77565 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.NodeMutator Update replica state for core_node3:{"core":"testNodeLost_shard1_replica_n1","base_url":"https://127.0.0.1:46747/solr","node_name":"127.0.0.1:46747_solr","state":"active","type":"NRT"} to down [junit4] 2> 77565 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 77565 INFO (zkCallback-211-thread-1-processing-n:127.0.0.1:46747_solr) [n:127.0.0.1:46747_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 77565 INFO (zkCallback-202-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 77565 INFO (zkCallback-202-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 77565 INFO (zkCallback-221-thread-1-processing-n:127.0.0.1:38773_solr) [n:127.0.0.1:38773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 77565 INFO (coreCloseExecutor-310-thread-1) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.c.SolrCore [testNodeLost_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@7bd42944 [junit4] 2> 77565 INFO (coreCloseExecutor-310-thread-1) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testNodeLost.shard1.replica_n1, tag=2077501764 [junit4] 2> 77565 INFO (coreCloseExecutor-310-thread-1) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30aad9e8: rootName = solr_46747, domain = solr.core.testNodeLost.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testNodeLost.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@3f8ff3a8 [junit4] 2> 77571 INFO (coreCloseExecutor-310-thread-1) [n:127.0.0.1:46747_solr c:testNodeLost s:shard1 r:core_node3 x:testNodeLost_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testNodeLost.shard1.leader, tag=2077501764 [junit4] 2> 77576 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@36e51be{/solr,null,UNAVAILABLE} [junit4] 2> 77576 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.session Stopped scavenging [junit4] 2> 77576 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.a.ComputePlanActionTest Stopped_node : 127.0.0.1:46747_solr [junit4] 2> 77577 INFO (zkConnectionManagerCallback-228-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 77666 DEBUG (OverseerStateUpdate-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testNodeLost/state.json version: 6 [junit4] 2> 77666 INFO (zkCallback-194-thread-3-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77666 INFO (zkCallback-194-thread-2-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testNodeLost/state.json] for collection [testNodeLost] has occurred - updating... (live nodes size: [2]) [junit4] 2> 77794 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 77795 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:46747_solr [junit4] 2> 78795 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 78811 INFO (OverseerCollectionConfigSetProcessor-72180104436776963-127.0.0.1:44063_solr-n_0000000000) [n:127.0.0.1:44063_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 79796 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 80796 DEBUG (ScheduledTrigger-283-thread-2) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 81796 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 82796 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 83797 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 84797 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2 [junit4] 2> 84797 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:46747_solr] [junit4] 2> 84798 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"6a42d3a940e91Tbbp9tosslbyg03kll0hqq6aj0", [junit4] 2> "source":"node_lost_trigger", [junit4] 2> "eventTime":1869364023529105, [junit4] 2> "eventType":"NODELOST", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[1869364023529105], [junit4] 2> "nodeNames":["127.0.0.1:46747_solr"]}} [junit4] 2> 84798 DEBUG (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger] [junit4] 2> 84800 INFO (ScheduledTrigger-283-thread-4) [n:127.0.0.1:44063_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging. [junit4] 2> 84801 DEBUG (AutoscalingActionExecutor-284-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"6a42d3a940e91Tbbp9tosslbyg03kll0hqq6aj0", [junit4] 2> "source":"node_lost_trigger", [junit4] 2> "eventTime":1869364023529105, [junit4] 2> "eventType":"NODELOST", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[1869364023529105], [junit4] 2> "_enqueue_time_":1869371027385687, [junit4] 2> "nodeNames":["127.0.0.1:46747_solr"]}} [junit4] 2> 84802 DEBUG (AutoscalingActionExecutor-284-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.ComputePlanAction -- processing event: { [junit4] 2> "id":"6a42d3a940e91Tbbp9tosslbyg03kll0hqq6aj0", [junit4] 2> "source":"node_lost_trigger", [junit4] 2> "eventTime":1869364023529105, [junit4] 2> "eventType":"NODELOST", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[1869364023529105], [junit4] 2> "_enqueue_time_":1869371027385687, [junit4] 2> "nodeNames":["127.0.0.1:46747_solr"]}} with context properties: {BEFORE_ACTION=[compute_plan]} [junit4] 2> 84814 INFO (qtp486470421-899) [n:127.0.0.1:38773_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 84818 INFO (qtp1248966674-809) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testNodeLost.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0 [junit4] 2> 84820 INFO (qtp1248966674-815) [n:127.0.0.1:44063_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 84824 WARN (AutoscalingActionExecutor-284-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.s.i.SolrClientNodeStateProvider could not get tags from node 127.0.0.1:46747_solr [junit4] 2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:46747/solr [junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650) [junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) [junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) [junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) [junit4] 2> at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider$ClientSnitchCtx.invoke(SolrClientNodeStateProvider.java:292) [junit4] 2> at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.fetchMetrics(SolrClientNodeStateProvider.java:150) [junit4] 2> at org.apache.solr.client.solrj.impl.SolrClientNodeStateProvider.getReplicaInfo(SolrClientNodeStateProvider.java:131) [junit4] 2> at org.apache.solr.client.solrj.cloud.autoscaling.Row.<init>(Row.java:47) [junit4] 2> at org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:119) [junit4] 2> at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:97) [junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:297) [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [junit4] 2> at java.lang.Thread.run(Thread.java:748) [junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:46747 [/127.0.0.1] failed: Connection refused (Connection refused) [junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) [junit4] 2> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) [junit4] 2> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) [junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) [junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) [junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) [junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) [junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) [junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) [junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) [junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542) [junit4] 2> ... 16 more [junit4] 2> Caused by: java.net.ConnectException: Connection refused (Connection refused) [junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method) [junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) [junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) [junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) [junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [junit4] 2> at java.net.Socket.connect(Socket.java:589) [junit4] 2> at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339) [junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) [junit4] 2> ... 26 more [junit4] 2> 84826 INFO (AutoscalingActionExecutor-284-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testNodeLost&targetNode=127.0.0.1:38773_solr&inPlaceMove=true&replica=core_node3 [junit4] 2> 84827 INFO (AutoscalingActionExecutor-284-thread-1-processing-n:127.0.0.1:44063_solr) [n:127.0.0.1:44063_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 1869371055 sessionWrapper.createTime 1869371049185366, this.sessionWrapper.createTime 1869371049185366 [junit4] 2> 84828 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6d3b554{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 84828 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=822924038 [junit4] 2> 84828 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 84829 INFO (TEST-ComputePlanActionTest.testNodeLost-seed#[6E81E6D1177700DE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@fd56ec0: rootName = solr_38773, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metric [...truncated too long message...] FO (coreCloseExecutor-3041-thread-4) [n:127.0.0.1:34393_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple2.shard1.replica_n2, tag=1238879811 [junit4] 2> 896272 INFO (coreCloseExecutor-3041-thread-4) [n:127.0.0.1:34393_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2edfdb01: rootName = solr_34393, domain = solr.core.testSimple2.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testSimple2.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@214f7863 [junit4] 2> 896272 DEBUG (ScheduledTrigger-3037-thread-3) [n:127.0.0.1:34393_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 0 [junit4] 2> 896272 DEBUG (ScheduledTrigger-3037-thread-3) [n:127.0.0.1:34393_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:43499_solr [junit4] 2> 896272 DEBUG (ScheduledTrigger-3037-thread-3) [n:127.0.0.1:34393_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:34393_solr [junit4] 2> 896277 INFO (coreCloseExecutor-3040-thread-1) [n:127.0.0.1:43499_solr c:testSimple3 s:shard1 r:core_node3 x:testSimple3_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard1.leader, tag=1581385247 [junit4] 2> 896277 INFO (coreCloseExecutor-3040-thread-3) [n:127.0.0.1:43499_solr c:testSimple3 s:shard3 r:core_node6 x:testSimple3_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple3.shard3.leader, tag=229806775 [junit4] 2> 896283 INFO (coreCloseExecutor-3041-thread-5) [n:127.0.0.1:34393_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testSimple1.shard1.replica_n11, tag=840707669 [junit4] 2> 896283 INFO (jetty-closer-1478-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@34e58688{/solr,null,UNAVAILABLE} [junit4] 2> 896283 INFO (coreCloseExecutor-3041-thread-5) [n:127.0.0.1:34393_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@69f78d9a: rootName = solr_34393, domain = solr.core.testSimple1.shard1.replica_n11, service url = null, agent id = null] for registry solr.core.testSimple1.shard1.replica_n11 / com.codahale.metrics.MetricRegistry@54fbb429 [junit4] 2> 896283 INFO (jetty-closer-1478-thread-1) [ ] o.e.j.s.session Stopped scavenging [junit4] 2> 896289 INFO (coreCloseExecutor-3041-thread-1) [n:127.0.0.1:34393_solr c:testSimple1 s:shard1 r:core_node3 x:testSimple1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=759834201 [junit4] 2> 896289 INFO (coreCloseExecutor-3041-thread-2) [n:127.0.0.1:34393_solr c:testSimple1 s:shard2 r:core_node7 x:testSimple1_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard2.leader, tag=2134254911 [junit4] 2> 896289 INFO (coreCloseExecutor-3041-thread-3) [n:127.0.0.1:34393_solr c:testSimple2 s:shard2 r:core_node8 x:testSimple2_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard2.leader, tag=1601550898 [junit4] 2> 896289 INFO (coreCloseExecutor-3041-thread-4) [n:127.0.0.1:34393_solr c:testSimple2 s:shard1 r:core_node5 x:testSimple2_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple2.shard1.leader, tag=1238879811 [junit4] 2> 896290 INFO (coreCloseExecutor-3041-thread-5) [n:127.0.0.1:34393_solr c:testSimple1 s:shard1 r:core_node12 x:testSimple1_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testSimple1.shard1.leader, tag=840707669 [junit4] 2> 896292 INFO (jetty-closer-1478-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72180149118369800-127.0.0.1:34393_solr-n_0000000002) closing [junit4] 2> 896292 INFO (OverseerStateUpdate-72180149118369800-127.0.0.1:34393_solr-n_0000000002) [n:127.0.0.1:34393_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34393_solr [junit4] 2> 896292 WARN (OverseerAutoScalingTriggerThread-72180149118369800-127.0.0.1:34393_solr-n_0000000002) [n:127.0.0.1:34393_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 896292 DEBUG (jetty-closer-1478-thread-2) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly [junit4] 2> 896293 INFO (jetty-closer-1478-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7b44acb7{/solr,null,UNAVAILABLE} [junit4] 2> 896293 INFO (jetty-closer-1478-thread-2) [ ] o.e.j.s.session Stopped scavenging [junit4] 2> 896293 ERROR (SUITE-AutoAddReplicasIntegrationTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 896294 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[6E81E6D1177700DE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41895 41895 [junit4] 2> 901698 INFO (Thread-1346) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41895 41895 [junit4] 2> 901698 WARN (Thread-1346) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 8 /solr/collections/testSimple1/terms/shard2 [junit4] 2> 7 /solr/collections/testSimple1/terms/shard1 [junit4] 2> 5 /solr/collections/testSimple2/terms/shard2 [junit4] 2> 5 /solr/collections/testSimple2/terms/shard1 [junit4] 2> 5 /solr/aliases.json [junit4] 2> 4 /solr/security.json [junit4] 2> 4 /solr/configs/conf [junit4] 2> 3 /solr/collections/testSimple3/terms/shard3 [junit4] 2> 3 /solr/collections/testSimple3/terms/shard2 [junit4] 2> 3 /solr/collections/testSimple3/terms/shard1 [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 58 /solr/collections/testSimple1/state.json [junit4] 2> 14 /solr/collections/testSimple2/state.json [junit4] 2> 10 /solr/collections/testSimple3/state.json [junit4] 2> 5 /solr/clusterprops.json [junit4] 2> 5 /solr/clusterstate.json [junit4] 2> 3 /solr/autoscaling.json [junit4] 2> 2 /solr/collections/testSimple1/leader_elect/shard2/election/72180149118369800-core_node7-n_0000000000 [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 5 /solr/live_nodes [junit4] 2> 5 /solr/collections [junit4] 2> 3 /solr/overseer/queue [junit4] 2> 3 /solr/overseer/queue-work [junit4] 2> 3 /solr/overseer/collection-queue-work [junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas [junit4] 2> [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_6E81E6D1177700DE-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=903, maxMBSortInHeap=5.145031449416771, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4bcbd7d8), locale=be, timezone=Europe/Busingen [junit4] 2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=8,threads=1,free=190605232,total=518979584 [junit4] 2> NOTE: All tests run in this JVM: [TestConfigSetsAPIExclusivity, TestSSLRandomization, BasicDistributedZk2Test, TestSmileRequest, SpatialFilterTest, DateMathParserTest, TestUtils, MultiTermTest, UUIDUpdateProcessorFallbackTest, ComputePlanActionTest, SolrCmdDistributorTest, LeaderElectionTest, ZkFailoverTest, RecoveryZkTest, SpellPossibilityIteratorTest, DistanceFunctionTest, TestRestManager, DirectSolrSpellCheckerTest, ResponseLogComponentTest, EnumFieldTest, ClassificationUpdateProcessorIntegrationTest, TestFastWriter, TestLegacyFieldCache, TestLazyCores, TestSolrFieldCacheBean, TestRealTimeGet, TestNumericRangeQuery64, ShowFileRequestHandlerTest, TestComplexPhraseLeadingWildcard, SolrGangliaReporterTest, TestDeleteCollectionOnDownNodes, CollectionsAPIDistributedZkTest, TestCloudPivotFacet, AutoscalingHistoryHandlerTest, TestTrieFacet, TestSchemaNameResource, LukeRequestHandlerTest, URLClassifyProcessorTest, TestValueSourceCache, RestartWhileUpdatingTest, TestSolrCoreSnapshots, BadCopyFieldTest, TestRuleBasedAuthorizationPlugin, TestSubQueryTransformerDistrib, HdfsChaosMonkeySafeLeaderTest, TestGenericDistributedQueue, TestFieldCacheSortRandom, RegexBoostProcessorTest, TestSolrCLIRunExample, TestStressReorder, DisMaxRequestHandlerTest, ReturnFieldsTest, TestNestedDocsSort, AnalyticsQueryTest, TestCloudSearcherWarming, TestTolerantSearch, TestPayloadScoreQParserPlugin, CollectionsAPISolrJTest, TestQueryTypes, DocValuesTest, PingRequestHandlerTest, CoreSorterTest, LeaderElectionIntegrationTest, SearchHandlerTest, TestMaxScoreQueryParser, SearchHandlerTest, UpdateLogTest, SolrJmxReporterTest, AutoAddReplicasIntegrationTest] [junit4] Completed [281/778 (2!)] on J2 in 145.82s, 1 test, 1 failure <<< FAILURES! [...truncated 50142 lines...] ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org