Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/706/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.MissingSegmentRecoveryTest
Error Message:
1 thread leaked from SUITE scope at
org.apache.solr.cloud.MissingSegmentRecoveryTest: 1) Thread[id=233,
name=SessionTracker, state=TIMED_WAITING,
group=TGRP-MissingSegmentRecoveryTest] at java.lang.Thread.sleep(Native
Method) at
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE
scope at org.apache.solr.cloud.MissingSegmentRecoveryTest:
1) Thread[id=233, name=SessionTracker, state=TIMED_WAITING,
group=TGRP-MissingSegmentRecoveryTest]
at java.lang.Thread.sleep(Native Method)
at
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([F1593AF39497380B]:0)
Build Log:
[...truncated 13317 lines...]
[junit4] Suite: org.apache.solr.cloud.MissingSegmentRecoveryTest
[junit4] 2> 73143 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to
test-framework derived value of
'/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 73144 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCaseJ4 Created dataDir:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/data-dir-11-001
[junit4] 2> 73144 WARN
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 73144 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 73149 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
w/ MAC_OS_X supressed clientAuth
[junit4] 2> 73149 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 73151 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001
[junit4] 2> 73151 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 73152 INFO (ZkTestServer Run Thread) [ ]
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 73152 INFO (ZkTestServer Run Thread) [ ]
o.a.s.c.ZkTestServer Starting server
[junit4] 2> 73254 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer start zk server on port:60967
[junit4] 2> 73254 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:60967
[junit4] 2> 73254 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:60967
[junit4] 2> 73254 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1 60967
[junit4] 2> 73258 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73264 INFO (zkConnectionManagerCallback-103-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73264 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73270 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73274 INFO (zkConnectionManagerCallback-105-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73275 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73275 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73279 INFO (zkConnectionManagerCallback-107-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73280 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73390 WARN (jetty-launcher-108-thread-2) [ ]
o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
break even is size 23
[junit4] 2> 73390 WARN (jetty-launcher-108-thread-1) [ ]
o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
break even is size 23
[junit4] 2> 73390 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 73390 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 73390 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 73390 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 73390 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git:
363d5f2df3a8a28de40604320230664b9c793c16; jvm 1.8.0_201-b09
[junit4] 2> 73390 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git:
363d5f2df3a8a28de40604320230664b9c793c16; jvm 1.8.0_201-b09
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@70eb21ce{/solr,null,AVAILABLE}
[junit4] 2> 73394 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@4286c442{/solr,null,AVAILABLE}
[junit4] 2> 73397 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@183c75c{HTTP/1.1,[http/1.1,
h2c]}{127.0.0.1:60973}
[junit4] 2> 73397 INFO (jetty-launcher-108-thread-1) [ ]
o.e.j.s.Server Started @73511ms
[junit4] 2> 73397 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=60973}
[junit4] 2> 73397 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@52ffbe96{HTTP/1.1,[http/1.1,
h2c]}{127.0.0.1:60972}
[junit4] 2> 73397 INFO (jetty-launcher-108-thread-2) [ ]
o.e.j.s.Server Started @73511ms
[junit4] 2> 73397 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=60972}
[junit4] 2> 73398 ERROR (jetty-launcher-108-thread-2) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 73398 ERROR (jetty-launcher-108-thread-1) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
8.5.0
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
8.5.0
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2020-03-03T03:23:14.428Z
[junit4] 2> 73398 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2020-03-03T03:23:14.428Z
[junit4] 2> 73399 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73400 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73404 INFO (zkConnectionManagerCallback-112-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73404 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73405 INFO (zkConnectionManagerCallback-111-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73405 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73406 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 73406 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 73623 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 73625 WARN (jetty-launcher-108-thread-2) [ ]
o.e.j.u.s.S.config Trusting all certificates configured for
Client@f380[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73625 WARN (jetty-launcher-108-thread-2) [ ]
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
Client@f380[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73633 WARN (jetty-launcher-108-thread-2) [ ]
o.e.j.u.s.S.config Trusting all certificates configured for
Client@14bf2dc4[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73633 WARN (jetty-launcher-108-thread-2) [ ]
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
Client@14bf2dc4[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73635 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60967/solr
[junit4] 2> 73636 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73642 INFO (zkConnectionManagerCallback-119-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73642 INFO (jetty-launcher-108-thread-2) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73713 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 73715 WARN (jetty-launcher-108-thread-1) [ ]
o.e.j.u.s.S.config Trusting all certificates configured for
Client@2d348c9b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73715 WARN (jetty-launcher-108-thread-1) [ ]
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
Client@2d348c9b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73721 WARN (jetty-launcher-108-thread-1) [ ]
o.e.j.u.s.S.config Trusting all certificates configured for
Client@611debde[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73721 WARN (jetty-launcher-108-thread-1) [ ]
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for
Client@611debde[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 73722 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60967/solr
[junit4] 2> 73723 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 73732 INFO (zkConnectionManagerCallback-126-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73732 INFO (jetty-launcher-108-thread-1) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 73761 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.c.ConnectionManager Waiting for client to
connect to ZooKeeper
[junit4] 2> 73767 INFO (zkConnectionManagerCallback-128-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73767 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.c.ConnectionManager Client is connected
to ZooKeeper
[junit4] 2> 73861 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.c.ConnectionManager Waiting for client to
connect to ZooKeeper
[junit4] 2> 73867 INFO (zkConnectionManagerCallback-132-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 73867 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.c.ConnectionManager Client is connected
to ZooKeeper
[junit4] 2> 73912 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:60973_solr
[junit4] 2> 73915 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.Overseer Overseer
(id=72070067268681736-127.0.0.1:60973_solr-n_0000000000) starting
[junit4] 2> 73938 INFO
(OverseerStateUpdate-72070067268681736-127.0.0.1:60973_solr-n_0000000000)
[n:127.0.0.1:60973_solr ] o.a.s.c.Overseer Starting to work on the main
queue : 127.0.0.1:60973_solr
[junit4] 2> 73939 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:60973_solr
[junit4] 2> 73947 INFO
(OverseerStateUpdate-72070067268681736-127.0.0.1:60973_solr-n_0000000000)
[n:127.0.0.1:60973_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 73956 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.p.PackageLoader /packages.json updated to
version -1
[junit4] 2> 73961 WARN (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.CoreContainer Not all security plugins
configured! authentication=disabled authorization=disabled. Solr is only as
secure as you make it. Consider configuring authentication/authorization before
exposing Solr to users internal or external. See
https://s.apache.org/solrsecurity for more info
[junit4] 2> 74013 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.h.a.MetricsHistoryHandler No .system
collection, keeping metrics history in memory.
[junit4] 2> 74042 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 74057 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.ZkController Publish
node=127.0.0.1:60972_solr as DOWN
[junit4] 2> 74061 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating
transient cache for 2147483647 transient cores
[junit4] 2> 74061 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:60972_solr
[junit4] 2> 74065 INFO (zkCallback-131-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 74067 INFO (zkCallback-127-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 74068 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.p.PackageLoader /packages.json updated to
version -1
[junit4] 2> 74069 WARN (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.CoreContainer Not all security plugins
configured! authentication=disabled authorization=disabled. Solr is only as
secure as you make it. Consider configuring authentication/authorization before
exposing Solr to users internal or external. See
https://s.apache.org/solrsecurity for more info
[junit4] 2> 74112 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60973.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74117 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.h.a.MetricsHistoryHandler No .system
collection, keeping metrics history in memory.
[junit4] 2> 74118 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60973.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74119 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60973.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74120 INFO (jetty-launcher-108-thread-1)
[n:127.0.0.1:60973_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node1/.
[junit4] 2> 74176 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60972.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74185 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60972.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74186 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60972.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74188 INFO (jetty-launcher-108-thread-2)
[n:127.0.0.1:60972_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/.
[junit4] 2> 74223 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 74226 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 74231 INFO (zkConnectionManagerCallback-143-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 74231 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 74238 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 74241 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60967/solr ready
[junit4] 2> 74290 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.SolrTestCaseJ4 ###Starting testLeaderRecovery
[junit4] 2> 74304 INFO (qtp256129220-269) [n:127.0.0.1:60973_solr ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
collection.configName=conf&maxShardsPerNode=1&name=MissingSegmentRecoveryTest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 74341 INFO
(OverseerThreadFactory-156-thread-1-processing-n:127.0.0.1:60973_solr)
[n:127.0.0.1:60973_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection
MissingSegmentRecoveryTest
[junit4] 2> 74560 INFO
(OverseerStateUpdate-72070067268681736-127.0.0.1:60973_solr-n_0000000000)
[n:127.0.0.1:60973_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MissingSegmentRecoveryTest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MissingSegmentRecoveryTest_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60973/solr";,
[junit4] 2> "node_name":"127.0.0.1:60973_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 74572 INFO
(OverseerStateUpdate-72070067268681736-127.0.0.1:60973_solr-n_0000000000)
[n:127.0.0.1:60973_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"MissingSegmentRecoveryTest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60972/solr";,
[junit4] 2> "node_name":"127.0.0.1:60972_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 74800 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation
core create command
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n1&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 74801 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation
core create command
qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n2&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 74803 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 74883 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrConfig Using
Lucene MatchVersion: 8.5.0
[junit4] 2> 74883 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrConfig Using
Lucene MatchVersion: 8.5.0
[junit4] 2> 74913 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema
[MissingSegmentRecoveryTest_shard1_replica_n2] Schema name=minimal
[junit4] 2> 74914 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.IndexSchema
[MissingSegmentRecoveryTest_shard1_replica_n1] Schema name=minimal
[junit4] 2> 74919 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded
schema minimal/1.1 with uniqueid field id
[junit4] 2> 74919 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating
SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n2' using configuration
from configset conf, trusted=true
[junit4] 2> 74922 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded
schema minimal/1.1 with uniqueid field id
[junit4] 2> 74922 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating
SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n1' using configuration
from configset conf, trusted=true
[junit4] 2> 74933 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX
monitoring for
'solr_60972.solr.core.MissingSegmentRecoveryTest.shard1.replica_n2' (registry
'solr.core.MissingSegmentRecoveryTest.shard1.replica_n2') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74934 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX
monitoring for
'solr_60973.solr.core.MissingSegmentRecoveryTest.shard1.replica_n1' (registry
'solr.core.MissingSegmentRecoveryTest.shard1.replica_n1') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 74993 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore
[[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at
[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/MissingSegmentRecoveryTest_shard1_replica_n2],
dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/./MissingSegmentRecoveryTest_shard1_replica_n2/data/]
[junit4] 2> 75000 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrCore
[[MissingSegmentRecoveryTest_shard1_replica_n1] ] Opening new SolrCore at
[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n1],
dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node1/./MissingSegmentRecoveryTest_shard1_replica_n1/data/]
[junit4] 2> 75290 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using
UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 75290 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 75292 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using
UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 75292 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 75293 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard
AutoCommit: disabled
[junit4] 2> 75293 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft
AutoCommit: disabled
[junit4] 2> 75294 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard
AutoCommit: disabled
[junit4] 2> 75294 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft
AutoCommit: disabled
[junit4] 2> 75300 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher
Opening [Searcher@77ee596c[MissingSegmentRecoveryTest_shard1_replica_n2] main]
[junit4] 2> 75307 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher
Opening [Searcher@248bc6e8[MissingSegmentRecoveryTest_shard1_replica_n1] main]
[junit4] 2> 75318 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 75319 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 75320 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage
Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 75321 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.ReplicationHandler
Commits will be reserved for 10000ms.
[junit4] 2> 75328 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage
Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 75329 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.ReplicationHandler
Commits will be reserved for 10000ms.
[junit4] 2> 75332 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not
find max version in index or recent updates, using new clock 1660111601126080512
[junit4] 2> 75343 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not
find max version in index or recent updates, using new clock 1660111601137614848
[junit4] 2> 75352 INFO
(searcherExecutor-165-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2] Registered new
searcher Searcher@77ee596c[MissingSegmentRecoveryTest_shard1_replica_n2]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 75369 INFO
(searcherExecutor-166-thread-1-processing-n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 c:MissingSegmentRecoveryTest
s:shard1 r:core_node3) [n:127.0.0.1:60973_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n1] Registered new
searcher Searcher@248bc6e8[MissingSegmentRecoveryTest_shard1_replica_n1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 75438 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Failed to
save terms, version is not a match, retrying
[junit4] 2> 75438 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkShardTerms
Successful update of terms at
/collections/MissingSegmentRecoveryTest/terms/shard1 to
Terms{values={core_node3=0}, version=0}
[junit4] 2> 75442 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkShardTerms
Successful update of terms at
/collections/MissingSegmentRecoveryTest/terms/shard1 to
Terms{values={core_node3=0, core_node4=0}, version=1}
[junit4] 2> 75469 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
/collections/MissingSegmentRecoveryTest/leaders/shard1
[junit4] 2> 75469 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
/collections/MissingSegmentRecoveryTest/leaders/shard1
[junit4] 2> 75520 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 75521 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 75523 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync
replicas to
http://127.0.0.1:60973/solr/MissingSegmentRecoveryTest_shard1_replica_n1/
[junit4] 2> 75540 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync:
core=MissingSegmentRecoveryTest_shard1_replica_n1
url=http://127.0.0.1:60973/solr START
replicas=[http://127.0.0.1:60972/solr/MissingSegmentRecoveryTest_shard1_replica_n2/]
nUpdates=100
[junit4] 2> 75541 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync:
core=MissingSegmentRecoveryTest_shard1_replica_n1
url=http://127.0.0.1:60973/solr DONE. We have no versions. sync failed.
[junit4] 2> 75558 INFO (qtp1547193185-273) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.S.Request
[MissingSegmentRecoveryTest_shard1_replica_n2] webapp=/solr path=/get
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
status=0 QTime=12
[junit4] 2> 75564 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's
attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 75565 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we
can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 75582 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
/collections/MissingSegmentRecoveryTest/leaders/shard1/leader after winning as
/collections/MissingSegmentRecoveryTest/leader_elect/shard1/election/72070067268681736-core_node3-n_0000000000
[junit4] 2> 75603 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
http://127.0.0.1:60973/solr/MissingSegmentRecoveryTest_shard1_replica_n1/ shard1
[junit4] 2> 75716 INFO (zkCallback-131-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 75717 INFO (zkCallback-131-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 75722 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkController I am the
leader, no recovery necessary
[junit4] 2> 75738 INFO (qtp256129220-274) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin]
webapp=null path=/admin/cores
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n1&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=942
[junit4] 2> 75831 INFO (zkCallback-131-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 75831 INFO (zkCallback-131-thread-3) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 75832 INFO (zkCallback-131-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 82240 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin]
webapp=null path=/admin/cores
params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n2&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT}
status=0 QTime=7444
[junit4] 2> 82248 INFO (zkCallback-127-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 82248 INFO (zkCallback-131-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 82248 INFO (zkCallback-131-thread-4) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 82248 INFO (zkCallback-131-thread-3) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 82248 INFO (zkCallback-127-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 82271 INFO (qtp256129220-269) [n:127.0.0.1:60973_solr ]
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most
45 seconds. Check all shard replicas
[junit4] 2> 82273 INFO (qtp256129220-269) [n:127.0.0.1:60973_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={collection.configName=conf&maxShardsPerNode=1&name=MissingSegmentRecoveryTest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2}
status=0 QTime=7970
[junit4] 2> 82277 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase waitForState (MissingSegmentRecoveryTest):
Expected a collection with one shard and two replicas
[junit4] 2> 82280 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
[junit4] 2> 82280 INFO (watches-140-thread-1) [ ]
o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
[junit4] 2> 82283 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
[junit4] 2> 82284 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
[junit4] 2> 82670 INFO (qtp256129220-266) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkShardTerms
Successful update of terms at
/collections/MissingSegmentRecoveryTest/terms/shard1 to
Terms{values={core_node3=1, core_node4=1}, version=2}
[junit4] 2> 83540 INFO (qtp1547193185-273) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.u.p.LogUpdateProcessorFactory
[MissingSegmentRecoveryTest_shard1_replica_n2] webapp=/solr path=/update
params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:60973/solr/MissingSegmentRecoveryTest_shard1_replica_n1/&wt=javabin&version=2}{add=[0
(1660111608639127552), 1 (1660111608796413952), 2 (1660111608798511104), 3
(1660111608801656832), 4 (1660111608805851136), 5 (1660111608806899712), 6
(1660111608812142592), 7 (1660111608814239744), 8 (1660111608815288320), 9
(1660111608817385472)]} 0 27
[junit4] 2> 83623 INFO (qtp256129220-266) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.u.p.LogUpdateProcessorFactory
[MissingSegmentRecoveryTest_shard1_replica_n1] webapp=/solr path=/update
params={wt=javabin&version=2}{add=[0 (1660111608639127552), 1
(1660111608796413952), 2 (1660111608798511104), 3 (1660111608801656832), 4
(1660111608805851136), 5 (1660111608806899712), 6 (1660111608812142592), 7
(1660111608814239744), 8 (1660111608815288320), 9 (1660111608817385472)]} 0 1303
[junit4] 2> 83647 INFO (qtp256129220-271) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2
start
commit{_version_=1660111609844989952,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 83647 INFO (qtp256129220-271) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter
Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4c10ec73
commitCommandVersion:1660111609844989952
[junit4] 2> 83713 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2
start
commit{_version_=1660111609914195968,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 83713 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter
Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@32a0bb90
commitCommandVersion:1660111609914195968
[junit4] 2> 83806 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher
Opening [Searcher@6dd33493[MissingSegmentRecoveryTest_shard1_replica_n2] main]
[junit4] 2> 83806 INFO (qtp256129220-271) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher
Opening [Searcher@495cdf1d[MissingSegmentRecoveryTest_shard1_replica_n1] main]
[junit4] 2> 83809 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2
end_commit_flush
[junit4] 2> 83812 INFO (qtp256129220-271) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2
end_commit_flush
[junit4] 2> 83813 INFO
(searcherExecutor-165-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2] Registered new
searcher Searcher@6dd33493[MissingSegmentRecoveryTest_shard1_replica_n2]
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.5.0):C10:[diagnostics={os=Mac
OS X, java.vendor=Oracle Corporation, java.version=1.8.0_201,
java.vm.version=25.201-b09, lucene.version=8.5.0, os.arch=x86_64,
java.runtime.version=1.8.0_201-b09, source=flush, os.version=10.14.6,
timestamp=1583205804789}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 83813 INFO
(searcherExecutor-166-thread-1-processing-n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 c:MissingSegmentRecoveryTest
s:shard1 r:core_node3) [n:127.0.0.1:60973_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n1] Registered new
searcher Searcher@495cdf1d[MissingSegmentRecoveryTest_shard1_replica_n1]
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.5.0):C10:[diagnostics={os=Mac
OS X, java.vendor=Oracle Corporation, java.version=1.8.0_201,
java.vm.version=25.201-b09, lucene.version=8.5.0, os.arch=x86_64,
java.runtime.version=1.8.0_201-b09, source=flush, os.version=10.14.6,
timestamp=1583205804800}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 83814 INFO (qtp1547193185-270) [n:127.0.0.1:60972_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.u.p.LogUpdateProcessorFactory
[MissingSegmentRecoveryTest_shard1_replica_n2] webapp=/solr path=/update
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:60973/solr/MissingSegmentRecoveryTest_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=}
0 103
[junit4] 2> 83821 INFO (qtp256129220-271) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ]
o.a.s.u.p.LogUpdateProcessorFactory
[MissingSegmentRecoveryTest_shard1_replica_n1] webapp=/solr path=/update
params={_stateVer_=MissingSegmentRecoveryTest:5&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
0 182
[junit4] 2> 83837 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.CoreContainer Shutting down CoreContainer instance=235674416
[junit4] 2> 83838 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:60972_solr
[junit4] 2> 83840 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 83840 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.ZkController Publish node=127.0.0.1:60972_solr as DOWN
[junit4] 2> 83850 INFO (coreCloseExecutor-175-thread-1)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore
[MissingSegmentRecoveryTest_shard1_replica_n2] CLOSING SolrCore
org.apache.solr.core.SolrCore@19cd4adc
[junit4] 2> 83850 INFO (coreCloseExecutor-175-thread-1)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.SolrMetricManager
Closing metric reporters for
registry=solr.core.MissingSegmentRecoveryTest.shard1.replica_n2,
tag=SolrCore@19cd4adc
[junit4] 2> 83850 INFO (coreCloseExecutor-175-thread-1)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter
Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c20e3fc:
rootName = solr_60972, domain =
solr.core.MissingSegmentRecoveryTest.shard1.replica_n2, service url = null,
agent id = null] for registry
solr.core.MissingSegmentRecoveryTest.shard1.replica_n2 /
com.codahale.metrics.MetricRegistry@502744da
[junit4] 2> 83859 INFO (coreCloseExecutor-175-thread-1)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.SolrMetricManager
Closing metric reporters for
registry=solr.collection.MissingSegmentRecoveryTest.shard1.leader,
tag=SolrCore@19cd4adc
[junit4] 2> 83864 INFO (coreCloseExecutor-175-thread-1)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2
Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 83882 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node,
tag=null
[junit4] 2> 83886 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@48c33e62: rootName =
solr_60972, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@1ca03115
[junit4] 2> 83902 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm,
tag=null
[junit4] 2> 83902 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@2b4b7c21: rootName =
solr_60972, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@39e950c2
[junit4] 2> 83907 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.jetty, tag=null
[junit4] 2> 83907 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@6a8c7506: rootName =
solr_60972, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@1ddbbc74
[junit4] 2> 83907 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.cluster, tag=null
[junit4] 2> 84025 INFO (zkCallback-131-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 84025 INFO (zkCallback-142-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 84028 INFO (zkCallback-131-thread-4) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
[junit4] 2> 84028 INFO (zkCallback-131-thread-3) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
[junit4] 2> 84028 INFO (zkCallback-131-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
[junit4] 2> 84051 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.AbstractConnector Stopped
ServerConnector@52ffbe96{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
[junit4] 2> 84053 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@70eb21ce{/solr,null,UNAVAILABLE}
[junit4] 2> 84055 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 84057 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding
port=60972)
[junit4] 2> 84058 WARN
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content,
break even is size 23
[junit4] 2> 84059 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 60972 try number
1 ...
[junit4] 2> 84059 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z;
git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 1.8.0_201-b09
[junit4] 2> 84062 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 84062 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 84063 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 84064 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1b9cf7d8{/solr,null,AVAILABLE}
[junit4] 2> 84070 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.AbstractConnector Started
ServerConnector@70731f57{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:60972}
[junit4] 2> 84070 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.s.Server Started @84184ms
[junit4] 2> 84071 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=60972}
[junit4] 2> 84072 ERROR
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may
be missing or incomplete.
[junit4] 2> 84072 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 84072 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 8.5.0
[junit4] 2> 84072 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 84072 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
[junit4] 2> 84073 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2020-03-03T03:23:25.103Z
[junit4] 2> 84075 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 84085 INFO (zkConnectionManagerCallback-151-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84085 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 84088 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 84288 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized:
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 84290 WARN
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.u.s.S.config Trusting all certificates configured for
Client@643d39b9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 84290 WARN
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured
for Client@643d39b9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 84303 WARN
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.u.s.S.config Trusting all certificates configured for
Client@6028cd9e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 84303 WARN
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured
for Client@6028cd9e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 84305 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60967/solr
[junit4] 2> 84308 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 84315 INFO (zkConnectionManagerCallback-158-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84315 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 84423 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.c.ConnectionManager Waiting for client to
connect to ZooKeeper
[junit4] 2> 84426 INFO (zkConnectionManagerCallback-160-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 84427 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.c.ConnectionManager Client is connected
to ZooKeeper
[junit4] 2> 84445 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 84460 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.ZkController Publish
node=127.0.0.1:60972_solr as DOWN
[junit4] 2> 84463 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating
transient cache for 2147483647 transient cores
[junit4] 2> 84464 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:60972_solr
[junit4] 2> 84468 INFO (zkCallback-142-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 84468 INFO (zkCallback-159-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 84468 INFO (zkCallback-131-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 84479 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.p.PackageLoader /packages.json updated to
version -1
[junit4] 2> 84479 WARN
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.CoreContainer Not all security plugins
configured! authentication=disabled authorization=disabled. Solr is only as
secure as you make it. Consider configuring authentication/authorization before
exposing Solr to users internal or external. See
https://s.apache.org/solrsecurity for more info
[junit4] 2> 84523 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.h.a.MetricsHistoryHandler No .system
collection, keeping metrics history in memory.
[junit4] 2> 84552 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60972.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 84559 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60972.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 84559 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_60972.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 84563 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.CorePropertiesLocator Found 1 core
definitions underneath
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/.
[junit4] 2> 84563 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B])
[n:127.0.0.1:60972_solr ] o.a.s.c.CorePropertiesLocator Cores are:
[MissingSegmentRecoveryTest_shard1_replica_n2]
[junit4] 2> 84571 INFO (zkCallback-131-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 84571 INFO (zkCallback-131-thread-5) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 84572 INFO (zkCallback-131-thread-3) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/MissingSegmentRecoveryTest/state.json] for collection
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 84594 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr ] o.a.s.c.SolrConfig Using Lucene MatchVersion:
8.5.0
[junit4] 2> 84611 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr ] o.a.s.s.IndexSchema
[MissingSegmentRecoveryTest_shard1_replica_n2] Schema name=minimal
[junit4] 2> 84614 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr ] o.a.s.s.IndexSchema Loaded schema minimal/1.1
with uniqueid field id
[junit4] 2> 84634 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrConfig Using
Lucene MatchVersion: 8.5.0
[junit4] 2> 84642 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema
[MissingSegmentRecoveryTest_shard1_replica_n2] Schema name=minimal
[junit4] 2> 84644 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded
schema minimal/1.1 with uniqueid field id
[junit4] 2> 84644 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating
SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n2' using configuration
from configset conf, trusted=true
[junit4] 2> 84645 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX
monitoring for
'solr_60972.solr.core.MissingSegmentRecoveryTest.shard1.replica_n2' (registry
'solr.core.MissingSegmentRecoveryTest.shard1.replica_n2') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 84646 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore
[[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at
[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/MissingSegmentRecoveryTest_shard1_replica_n2],
dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/./MissingSegmentRecoveryTest_shard1_replica_n2/data/]
[junit4] 2> 84749 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using
UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 84749 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 84763 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard
AutoCommit: disabled
[junit4] 2> 84763 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft
AutoCommit: disabled
[junit4] 2> 84767 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore
[MissingSegmentRecoveryTest_shard1_replica_n2] CLOSING SolrCore
org.apache.solr.core.SolrCore@107425c0
[junit4] 2> 84767 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.SolrMetricManager
Closing metric reporters for
registry=solr.core.MissingSegmentRecoveryTest.shard1.replica_n2,
tag=SolrCore@107425c0
[junit4] 2> 84767 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter
Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@dc44e0b:
rootName = solr_60972, domain =
solr.core.MissingSegmentRecoveryTest.shard1.replica_n2, service url = null,
agent id = null] for registry
solr.core.MissingSegmentRecoveryTest.shard1.replica_n2 /
com.codahale.metrics.MetricRegistry@7ae1bae2
[junit4] 2> 84779 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.SolrMetricManager
Closing metric reporters for
registry=solr.collection.MissingSegmentRecoveryTest.shard1.leader,
tag=SolrCore@107425c0
[junit4] 2> 84780 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2
Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 84789 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.CoreContainer Found
active leader, will attempt to create fresh core and recover.
[junit4] 2> 84789 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore Updating
index properties... index=index.20200302182325819
[junit4] 2> 84798 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkShardTerms
Successful update of terms at
/collections/MissingSegmentRecoveryTest/terms/shard1 to
Terms{values={core_node3=1, core_node4=0}, version=3}
[junit4] 2> 84845 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX
monitoring for
'solr_60972.solr.core.MissingSegmentRecoveryTest.shard1.replica_n2' (registry
'solr.core.MissingSegmentRecoveryTest.shard1.replica_n2') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@6ced9dd5
[junit4] 2> 84846 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore
[[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at
[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/MissingSegmentRecoveryTest_shard1_replica_n2],
dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/./MissingSegmentRecoveryTest_shard1_replica_n2/data/]
[junit4] 2> 84868 INFO
(OldIndexDirectoryCleanupThreadForCore-MissingSegmentRecoveryTest_shard1_replica_n2)
[ ] o.a.s.c.DirectoryFactory Found 1 old index directories to clean-up
under
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/./MissingSegmentRecoveryTest_shard1_replica_n2/data/
afterReload=false
[junit4] 2> 84875 INFO
(OldIndexDirectoryCleanupThreadForCore-MissingSegmentRecoveryTest_shard1_replica_n2)
[ ] o.a.s.c.DirectoryFactory Deleted old index directory:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.MissingSegmentRecoveryTest_F1593AF39497380B-001/tempDir-001/node2/./MissingSegmentRecoveryTest_shard1_replica_n2/data/index
[junit4] 2> 84985 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using
UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 84985 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100
maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 84986 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard
AutoCommit: disabled
[junit4] 2> 84986 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft
AutoCommit: disabled
[junit4] 2> 84990 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher
Opening [Searcher@270becbd[MissingSegmentRecoveryTest_shard1_replica_n2] main]
[junit4] 2> 84994 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 84995 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage
Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 84995 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.ReplicationHandler
Commits will be reserved for 10000ms.
[junit4] 2> 84995 INFO
(coreLoadExecutor-185-thread-1-processing-n:127.0.0.1:60972_solr)
[n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.ReplicationHandler
Commits will be reserved for 10000ms.
[junit4] 2> 84998 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase waitForState (MissingSegmentRecoveryTest):
Expected a collection with one shard and two replicas
[junit4] 2> 84999 INFO
(searcherExecutor-191-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2] Registered new
searcher Searcher@270becbd[MissingSegmentRecoveryTest_shard1_replica_n2]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 85001 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 2
[junit4] 2> 85001 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 2
[junit4] 2> 85001 INFO
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[F1593AF39497380B]) [
] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 2
[junit4] 2> 85001 INFO (watches-140-thread-1) [ ]
o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 2
[junit4] 2> 85003 INFO
(coreZkRegister-177-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created
/collections/MissingSegmentRecoveryTest/leaders/shard1
[junit4] 2> 85014 INFO
(coreZkRegister-177-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.ZkController Core needs to
recover:MissingSegmentRecoveryTest_shard1_replica_n2
[junit4] 2> 85018 INFO
(updateExecutor-154-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 85029 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 85030 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.RecoveryStrategy startupVersions size=10 range=[1660111608817385472 to
1660111608639127552]
[junit4] 2> 85079 INFO (qtp256129220-269) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.S.Request
[MissingSegmentRecoveryTest_shard1_replica_n1] webapp=/solr path=/admin/ping
params={wt=javabin&version=2} hits=10 status=0 QTime=35
[junit4] 2> 85079 INFO (qtp256129220-269) [n:127.0.0.1:60973_solr
c:MissingSegmentRecoveryTest s:shard1 r:core_node3
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.S.Request
[MissingSegmentRecoveryTest_shard1_replica_n1] webapp=/solr path=/admin/ping
params={wt=javabin&version=2} status=0 QTime=38
[junit4] 2> 85081 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.RecoveryStrategy Begin buffering updates.
core=[MissingSegmentRecoveryTest_shard1_replica_n2]
[junit4] 2> 85082 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE,
tlog=null}
[junit4] 2> 85082 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.RecoveryStrategy Publishing state of core
[MissingSegmentRecoveryTest_shard1_replica_n2] as recovering, leader is
[http://127.0.0.1:60973/solr/MissingSegmentRecoveryTest_shard1_replica_n1/] and
I am [http://127.0.0.1:60972/solr/MissingSegmentRecoveryTest_shard1_replica_n2/]
[junit4] 2> 85085 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.ZkShardTerms Successful update of terms at
/collections/MissingSegmentRecoveryTest/terms/shard1 to
Terms{values={core_node4_recovering=0, core_node3=1, core_node4=1}, version=4}
[junit4] 2> 85103 INFO
(recoveryExecutor-156-thread-1-processing-n:127.0.0.1:60972_solr
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest
s:shard1 r:core_node4) [n:127.0.0.1:60972_solr c:MissingSegmentRecoveryTest
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ]
o.a.s.c.RecoveryStrategy Sending prep recovery command to
[http://127.0.0.1:60973/solr]; [WaitForState:
action=PREPRECOVERY&core=MissingSegmentRecoveryTest_shard1_replica_n1&nodeName=127.0.0.1:60972_solr&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 85106 INFO (qtp256129220-266) [n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.PrepRecoveryOp Going
to wait for coreNodeName: core_node4, state: recovering, checkLive: true,
onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 85108 INFO (qtp256129220-266) [n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.PrepRecoveryOp In
WaitForState(recovering): collection=MissingSegmentRecoveryTest, shard=shard1,
thisCore=MissingSegmentRecoveryTest_shard1_replica_n1,
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true,
currentState=down, localState=active, nodeName=127.0.0.1:60972_solr,
coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{
[junit4] 2> "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:60972/solr";,
[junit4] 2> "node_name":"127.0.0.1:60972_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"}
[junit4] 2> 85108 INFO (qtp256129220-266) [n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.PrepRecoveryOp In
WaitForState(recovering): collection=MissingSegmentRecoveryTest, shard=shard1,
thisCore=MissingSegmentRecoveryTest_shard1_replica_n1,
leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true,
currentState=down, localState=active, nodeName=127.0.0.1:60972_solr,
coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{
[junit4] 2> "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
[junit4] 2> "base_url":"http://127.0.0.1:60972/solr";,
[junit4] 2> "node_name":"127.0.0.1:60972_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT",
[junit4] 2> "force_set_state":"false"}
[junit4] 2> 85108 INFO (qtp256129220-266) [n:127.0.0.1:60973_solr
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.PrepRecoveryOp In
WaitForState(recovering): collection=MissingSegmentRecoveryTest, shard=shard1,
thisCore=MissingSegmen
[...truncated too long message...]
hread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@4e0d0566: rootName =
solr_60972, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@39e950c2
[junit4] 2> 86556 INFO (jetty-closer-168-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 86556 INFO (jetty-closer-168-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@25a16a80: rootName =
solr_60973, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@1ddbbc74
[junit4] 2> 86556 INFO (jetty-closer-168-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 86557 INFO (jetty-closer-168-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 86558 INFO (closeThreadPool-175-thread-2) [ ]
o.a.s.c.Overseer Overseer
(id=72070067268681736-127.0.0.1:60973_solr-n_0000000000) closing
[junit4] 2> 86558 INFO (jetty-closer-168-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@16d05acb: rootName =
solr_60972, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@1ddbbc74
[junit4] 2> 86558 INFO (jetty-closer-168-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 86558 INFO
(OverseerStateUpdate-72070067268681736-127.0.0.1:60973_solr-n_0000000000)
[n:127.0.0.1:60973_solr ] o.a.s.c.Overseer Overseer Loop exiting :
127.0.0.1:60973_solr
[junit4] 2> 86566 INFO
(OverseerAutoScalingTriggerThread-72070067268681736-127.0.0.1:60973_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we
are closed, exiting.
[junit4] 2> 86572 INFO (closeThreadPool-175-thread-1) [ ]
o.a.s.c.Overseer Overseer
(id=72070067268681736-127.0.0.1:60973_solr-n_0000000000) closing
[junit4] 2> 86679 INFO (jetty-closer-168-thread-1) [ ]
o.a.s.c.Overseer Overseer
(id=72070067268681736-127.0.0.1:60973_solr-n_0000000000) closing
[junit4] 2> 86684 INFO (jetty-closer-168-thread-1) [ ]
o.e.j.s.AbstractConnector Stopped ServerConnector@183c75c{HTTP/1.1,[http/1.1,
h2c]}{127.0.0.1:0}
[junit4] 2> 86685 INFO (jetty-closer-168-thread-1) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@4286c442{/solr,null,UNAVAILABLE}
[junit4] 2> 86686 INFO (jetty-closer-168-thread-1) [ ]
o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 86691 INFO (jetty-closer-168-thread-2) [ ]
o.e.j.s.AbstractConnector Stopped ServerConnector@70731f57{HTTP/1.1,[http/1.1,
h2c]}{127.0.0.1:60972}
[junit4] 2> 86692 INFO (jetty-closer-168-thread-2) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@1b9cf7d8{/solr,null,UNAVAILABLE}
[junit4] 2> 86692 INFO (jetty-closer-168-thread-2) [ ]
o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 86694 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 86916 WARN (ZkTestServer Run Thread) [ ]
o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 17
/solr/collections/MissingSegmentRecoveryTest/terms/shard1
[junit4] 2> 7
/solr/collections/MissingSegmentRecoveryTest/state.json
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 3 /solr/packages.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/configs/conf
[junit4] 2> 3
/solr/collections/MissingSegmentRecoveryTest/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 46
/solr/collections/MissingSegmentRecoveryTest/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 2
/solr/overseer_elect/election/72070067268681736-127.0.0.1:60973_solr-n_0000000000
[junit4] 2> 2
/solr/collections/MissingSegmentRecoveryTest/leader_elect/shard1/election/72070067268681736-core_node3-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 30 /solr/overseer/queue
[junit4] 2> 12 /solr/live_nodes
[junit4] 2> 10 /solr/collections
[junit4] 2> 8 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 86921 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:60967
[junit4] 2> 86921 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:60967
[junit4] 2> 86921 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1 60967
[junit4] 2> 86922 INFO
(SUITE-MissingSegmentRecoveryTest-seed#[F1593AF39497380B]-worker) [ ]
o.a.s.SolrTestCaseJ4 -------------------------------------------------------
Done waiting for tracked resources to be released
[junit4] 2> Mar 03, 2020 3:23:28 AM
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked
thread(s).
[junit4] 2> Mar 03, 2020 3:23:38 AM
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at
org.apache.solr.cloud.MissingSegmentRecoveryTest:
[junit4] 2> 1) Thread[id=233, name=SessionTracker, state=TIMED_WAITING,
group=TGRP-MissingSegmentRecoveryTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] 2> Mar 03, 2020 3:23:38 AM
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=233, name=SessionTracker, state=TIMED_WAITING,
group=TGRP-MissingSegmentRecoveryTest]
[junit4] 2> 97215 ERROR (SessionTracker) [ ]
o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread :
SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) [?:1.8.0_201]
[junit4] 2> at
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
~[zookeeper-3.5.5.jar:3.5.5]
[junit4] 2> Mar 03, 2020 3:23:38 AM
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=CheapBastard,
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4afcee30),
locale=be, timezone=America/Metlakatla
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/Oracle Corporation 1.8.0_201
(64-bit)/cpus=6,threads=1,free=107584472,total=194641920
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrFieldCacheBean,
CSVRequestHandlerTest, SolrJmxReporterTest, TestConfigSetsAPIZkFailure,
TriggerEventQueueTest, DateRangeFieldTest, MinimalSchemaTest,
MissingSegmentRecoveryTest]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=MissingSegmentRecoveryTest -Dtests.seed=F1593AF39497380B
-Dtests.slow=true -Dtests.locale=be -Dtests.timezone=America/Metlakatla
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | MissingSegmentRecoveryTest (suite) <<<
[junit4] > Throwable #1:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE
scope at org.apache.solr.cloud.MissingSegmentRecoveryTest:
[junit4] > 1) Thread[id=233, name=SessionTracker, state=TIMED_WAITING,
group=TGRP-MissingSegmentRecoveryTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] > at
__randomizedtesting.SeedInfo.seed([F1593AF39497380B]:0)
[junit4] Completed [25/901 (1!)] on J2 in 24.36s, 1 test, 1 error <<<
FAILURES!
[...truncated 55625 lines...]
[repro] Jenkins log URL:
https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/706/consoleText
[repro] Revision: fa2ce13fde08a8cfbf4f18279a13e273039d6eb6
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC"
[repro] Repro line: ant test -Dtestcase=MissingSegmentRecoveryTest
-Dtests.seed=F1593AF39497380B -Dtests.slow=true -Dtests.locale=be
-Dtests.timezone=America/Metlakatla -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] MissingSegmentRecoveryTest
[repro] ant compile-test
[...truncated 3440 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5
-Dtests.class="*.MissingSegmentRecoveryTest" -Dtests.showOutput=onerror
"-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC"
-Dtests.seed=F1593AF39497380B -Dtests.slow=true -Dtests.locale=be
-Dtests.timezone=America/Metlakatla -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[...truncated 76 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.MissingSegmentRecoveryTest
[repro] Exiting with code 0
[...truncated 73 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
