Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/969/
Java: 64bit/jdk-10-ea+32 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED:
junit.framework.TestSuite.org.apache.solr.search.join.TestCloudNestedDocsSort
Error Message:
There are still nodes recoverying - waited for 30 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 30
seconds
at __randomizedtesting.SeedInfo.seed([C59CA7B9D7FEF37F]:0)
at org.junit.Assert.fail(Assert.java:93)
at
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
at
org.apache.solr.search.join.TestCloudNestedDocsSort.setupCluster(TestCloudNestedDocsSort.java:75)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 11867 lines...]
[junit4] Suite: org.apache.solr.search.join.TestCloudNestedDocsSort
[junit4] 2> Creating dataDir:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/init-core-data-001
[junit4] 2> 150950 WARN
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
[junit4] 2> 150950 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 150951 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via:
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0,
clientAuth=0.0/0.0)
[junit4] 2> 150951 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 150952 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001
[junit4] 2> 150952 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 150967 INFO (Thread-243) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 150967 INFO (Thread-243) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 150977 ERROR (Thread-243) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 151062 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.ZkTestServer start zk server on port:44441
[junit4] 2> 151064 INFO (zkConnectionManagerCallback-208-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151111 INFO (jetty-launcher-205-thread-2) [ ]
o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 151112 INFO (jetty-launcher-205-thread-1) [ ]
o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 151114 INFO (jetty-launcher-205-thread-4) [ ]
o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 151114 INFO (jetty-launcher-205-thread-3) [ ]
o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 151129 INFO (jetty-launcher-205-thread-3) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@68480687{/solr,null,AVAILABLE}
[junit4] 2> 151135 INFO (jetty-launcher-205-thread-1) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@2e3584e0{/solr,null,AVAILABLE}
[junit4] 2> 151137 INFO (jetty-launcher-205-thread-5) [ ]
o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 151137 INFO (jetty-launcher-205-thread-1) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@f2593e1{SSL,[ssl,
http/1.1]}{127.0.0.1:37099}
[junit4] 2> 151137 INFO (jetty-launcher-205-thread-1) [ ]
o.e.j.s.Server Started @152695ms
[junit4] 2> 151137 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=37099}
[junit4] 2> 151138 ERROR (jetty-launcher-205-thread-1) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 151138 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 151138 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 151138 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 151138 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-12-10T14:16:37.436692Z
[junit4] 2> 151147 INFO (jetty-launcher-205-thread-4) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@73039b82{/solr,null,AVAILABLE}
[junit4] 2> 151148 INFO (jetty-launcher-205-thread-2) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@53fd533d{/solr,null,AVAILABLE}
[junit4] 2> 151148 INFO (jetty-launcher-205-thread-4) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@36b079fc{SSL,[ssl,
http/1.1]}{127.0.0.1:38401}
[junit4] 2> 151148 INFO (jetty-launcher-205-thread-4) [ ]
o.e.j.s.Server Started @152706ms
[junit4] 2> 151148 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=38401}
[junit4] 2> 151148 ERROR (jetty-launcher-205-thread-4) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 151148 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 151148 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@1b0c7ce6{SSL,[ssl,
http/1.1]}{127.0.0.1:35185}
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-12-10T14:16:37.447036Z
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.e.j.s.Server Started @152706ms
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=35185}
[junit4] 2> 151149 ERROR (jetty-launcher-205-thread-2) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 151149 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-12-10T14:16:37.447459Z
[junit4] 2> 151154 INFO (jetty-launcher-205-thread-5) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@38df9287{/solr,null,AVAILABLE}
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@719e73a6{SSL,[ssl,
http/1.1]}{127.0.0.1:39757}
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.e.j.s.Server Started @152713ms
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=39757}
[junit4] 2> 151155 ERROR (jetty-launcher-205-thread-5) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 151155 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-12-10T14:16:37.453780Z
[junit4] 2> 151173 INFO (jetty-launcher-205-thread-3) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@5019895a{SSL,[ssl,
http/1.1]}{127.0.0.1:44031}
[junit4] 2> 151173 INFO (jetty-launcher-205-thread-3) [ ]
o.e.j.s.Server Started @152731ms
[junit4] 2> 151173 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=44031}
[junit4] 2> 151173 INFO (zkConnectionManagerCallback-214-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151174 ERROR (jetty-launcher-205-thread-3) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 151174 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.3.0
[junit4] 2> 151174 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 151174 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 151174 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2017-12-10T14:16:37.472279Z
[junit4] 2> 151176 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 151176 INFO (zkConnectionManagerCallback-212-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151180 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 151182 INFO (zkConnectionManagerCallback-210-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151188 INFO (zkConnectionManagerCallback-216-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151189 INFO (zkConnectionManagerCallback-218-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151188 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 151194 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44441/solr
[junit4] 2> 151198 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 151198 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 151207 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44441/solr
[junit4] 2> 151210 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44441/solr
[junit4] 2> 151215 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44441/solr
[junit4] 2> 151218 INFO (zkConnectionManagerCallback-222-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151218 INFO (zkConnectionManagerCallback-226-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151225 INFO (zkConnectionManagerCallback-231-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151227 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44441/solr
[junit4] 2> 151231 INFO (zkConnectionManagerCallback-234-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151240 INFO (zkConnectionManagerCallback-239-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151240 INFO (zkConnectionManagerCallback-238-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151264 INFO (zkConnectionManagerCallback-242-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151267 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from
client sessionid 0x16040c8ea93000c, likely client has closed socket
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 151270 INFO (zkConnectionManagerCallback-244-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151276 INFO (zkConnectionManagerCallback-248-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151293 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 151293 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 151294 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44031_solr
[junit4] 2> 151294 INFO (zkConnectionManagerCallback-250-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151295 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.Overseer Overseer
(id=99150423475290125-127.0.0.1:44031_solr-n_0000000000) starting
[junit4] 2> 151296 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:35185_solr
[junit4] 2> 151300 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 151302 INFO (zkCallback-247-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 151312 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 151315 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 151318 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:39757_solr
[junit4] 2> 151334 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 151345 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 151345 INFO (zkCallback-247-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 151347 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:44031_solr
[junit4] 2> 151354 INFO (zkCallback-247-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 151354 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 151354 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 151370 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 151373 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 151373 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 151375 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:38401_solr
[junit4] 2> 151378 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 151378 INFO (zkCallback-247-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 151378 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 151382 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 151383 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:37099_solr
[junit4] 2> 151384 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35185.solr.node' (registry
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151390 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 151390 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 151396 INFO (zkCallback-247-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 151396 INFO (zkCallback-237-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
[junit4] 2> 151409 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44031.solr.node' (registry
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151417 INFO (zkCallback-236-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
[junit4] 2> 151432 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35185.solr.jvm' (registry
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151432 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35185.solr.jetty' (registry
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151435 INFO (jetty-launcher-205-thread-2) [ ]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node2/.
[junit4] 2> 151449 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44031.solr.jvm' (registry
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151449 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44031.solr.jetty' (registry
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151451 INFO (jetty-launcher-205-thread-3) [ ]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node3/.
[junit4] 2> 151452 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39757.solr.node' (registry
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151454 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37099.solr.node' (registry
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151469 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37099.solr.jvm' (registry
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151470 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37099.solr.jetty' (registry
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151480 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39757.solr.jvm' (registry
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151480 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39757.solr.jetty' (registry
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151481 INFO (jetty-launcher-205-thread-5) [ ]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node5/.
[junit4] 2> 151485 INFO (jetty-launcher-205-thread-1) [ ]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node1/.
[junit4] 2> 151486 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38401.solr.node' (registry
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151519 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38401.solr.jvm' (registry
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151519 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38401.solr.jetty' (registry
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 151521 INFO (jetty-launcher-205-thread-4) [ ]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node4/.
[junit4] 2> 151746 INFO (zkConnectionManagerCallback-256-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151755 INFO (zkConnectionManagerCallback-260-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 151756 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 151756 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44441/solr ready
[junit4] 2> 152044 INFO (qtp411582425-1033) [ ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
replicationFactor=2&property.schema=schema.xml&property.config=solrconfig-minimal.xml&collection.configName=solrCloudCollectionConfig&name=collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 152103 INFO (OverseerThreadFactory-439-thread-1) [ ]
o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 152216 INFO
(OverseerStateUpdate-99150423475290125-127.0.0.1:44031_solr-n_0000000000) [
] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38401/solr";,
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 152218 INFO
(OverseerStateUpdate-99150423475290125-127.0.0.1:44031_solr-n_0000000000) [
] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37099/solr";,
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 152220 INFO
(OverseerStateUpdate-99150423475290125-127.0.0.1:44031_solr-n_0000000000) [
] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:44031/solr";,
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 152223 INFO
(OverseerStateUpdate-99150423475290125-127.0.0.1:44031_solr-n_0000000000) [
] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39757/solr";,
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 152465 INFO (qtp411582425-1048) [ ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node8&name=collection1_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 152465 INFO (qtp411582425-1048) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 152469 INFO (qtp834347419-1017) [ ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node7&name=collection1_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 152470 INFO (qtp834347419-1017) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 152475 INFO (qtp1280322367-1040) [ ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node3&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 152475 INFO (qtp1280322367-1040) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 152477 INFO (qtp1394383685-1027) [ ]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node5&name=collection1_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 152478 INFO (qtp1394383685-1027) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 152592 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152592 INFO (zkCallback-237-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152592 INFO (zkCallback-236-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152592 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152592 INFO (zkCallback-236-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152592 INFO (zkCallback-237-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152593 INFO (zkCallback-249-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 152593 INFO (zkCallback-243-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 153493 INFO (qtp411582425-1048) [ ] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.3.0
[junit4] 2> 153503 INFO (qtp411582425-1048) [ ] o.a.s.s.IndexSchema
[collection1_shard2_replica_n6] Schema name=test
[junit4] 2> 153515 INFO (qtp1280322367-1040) [ ] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.3.0
[junit4] 2> 153551 INFO (qtp834347419-1017) [ ] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.3.0
[junit4] 2> 153561 INFO (qtp1394383685-1027) [ ] o.a.s.c.SolrConfig
Using Lucene MatchVersion: 7.3.0
[junit4] 2> 153567 INFO (qtp1280322367-1040) [ ] o.a.s.s.IndexSchema
[collection1_shard1_replica_n1] Schema name=test
[junit4] 2> 153583 INFO (qtp834347419-1017) [ ] o.a.s.s.IndexSchema
[collection1_shard2_replica_n4] Schema name=test
[junit4] 2> 153609 INFO (qtp1394383685-1027) [ ] o.a.s.s.IndexSchema
[collection1_shard1_replica_n2] Schema name=test
[junit4] 2> 153738 INFO (qtp411582425-1048) [ ] o.a.s.s.IndexSchema
Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 153787 INFO (qtp411582425-1048) [ ] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard2_replica_n6' using configuration from
collection collection1, trusted=true
[junit4] 2> 153802 INFO (qtp411582425-1048) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_39757.solr.core.collection1.shard2.replica_n6' (registry
'solr.core.collection1.shard2.replica_n6') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 153802 INFO (qtp411582425-1048) [ ] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 153802 INFO (qtp411582425-1048) [ ] o.a.s.c.SolrCore
[[collection1_shard2_replica_n6] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node5/collection1_shard2_replica_n6],
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node5/./collection1_shard2_replica_n6/data/]
[junit4] 2> 153805 INFO (qtp411582425-1048) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=27, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=81.1728515625,
floorSegmentMB=0.8818359375, forceMergeDeletesPctAllowed=12.582238582113115,
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 153819 INFO (qtp1280322367-1040) [ ] o.a.s.s.IndexSchema
Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 153853 INFO (qtp834347419-1017) [ ] o.a.s.s.IndexSchema
Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 153860 INFO (qtp1394383685-1027) [ ] o.a.s.s.IndexSchema
Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 153905 INFO (qtp1280322367-1040) [ ] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard1_replica_n1' using configuration from
collection collection1, trusted=true
[junit4] 2> 153918 INFO (qtp1280322367-1040) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_38401.solr.core.collection1.shard1.replica_n1' (registry
'solr.core.collection1.shard1.replica_n1') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 153918 INFO (qtp1280322367-1040) [ ] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 153918 INFO (qtp1280322367-1040) [ ] o.a.s.c.SolrCore
[[collection1_shard1_replica_n1] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node4/collection1_shard1_replica_n1],
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node4/./collection1_shard1_replica_n1/data/]
[junit4] 2> 153921 INFO (qtp1280322367-1040) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=27, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=81.1728515625,
floorSegmentMB=0.8818359375, forceMergeDeletesPctAllowed=12.582238582113115,
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 153933 INFO (qtp834347419-1017) [ ] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard2_replica_n4' using configuration from
collection collection1, trusted=true
[junit4] 2> 153933 INFO (qtp834347419-1017) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_44031.solr.core.collection1.shard2.replica_n4' (registry
'solr.core.collection1.shard2.replica_n4') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 153933 INFO (qtp834347419-1017) [ ] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 153933 INFO (qtp834347419-1017) [ ] o.a.s.c.SolrCore
[[collection1_shard2_replica_n4] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node3/collection1_shard2_replica_n4],
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node3/./collection1_shard2_replica_n4/data/]
[junit4] 2> 153936 INFO (qtp834347419-1017) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=27, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=81.1728515625,
floorSegmentMB=0.8818359375, forceMergeDeletesPctAllowed=12.582238582113115,
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 153938 INFO (qtp1394383685-1027) [ ] o.a.s.c.CoreContainer
Creating SolrCore 'collection1_shard1_replica_n2' using configuration from
collection collection1, trusted=true
[junit4] 2> 153938 INFO (qtp1394383685-1027) [ ]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_37099.solr.core.collection1.shard1.replica_n2' (registry
'solr.core.collection1.shard1.replica_n2') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@3423aeb9
[junit4] 2> 153938 INFO (qtp1394383685-1027) [ ] o.a.s.c.SolrCore
solr.RecoveryStrategy.Builder
[junit4] 2> 153939 INFO (qtp1394383685-1027) [ ] o.a.s.c.SolrCore
[[collection1_shard1_replica_n2] ] Opening new SolrCore at
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node1/collection1_shard1_replica_n2],
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.join.TestCloudNestedDocsSort_C59CA7B9D7FEF37F-001/tempDir-001/node1/./collection1_shard1_replica_n2/data/]
[junit4] 2> 153941 INFO (qtp1394383685-1027) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy:
maxMergeAtOnce=27, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=81.1728515625,
floorSegmentMB=0.8818359375, forceMergeDeletesPctAllowed=12.582238582113115,
segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 154009 INFO (qtp411582425-1048) [ ] o.a.s.u.CommitTracker
Hard AutoCommit: disabled
[junit4] 2> 154010 INFO (qtp411582425-1048) [ ] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 154011 INFO (qtp411582425-1048) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 154015 INFO (qtp411582425-1048) [ ]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@27b16a02[collection1_shard2_replica_n6] main]
[junit4] 2> 154016 INFO (qtp411582425-1048) [ ]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/solrCloudCollectionConfig
[junit4] 2> 154016 INFO (qtp411582425-1048) [ ]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 154018 INFO (qtp1280322367-1040) [ ] o.a.s.u.CommitTracker
Hard AutoCommit: disabled
[junit4] 2> 154018 INFO (qtp1280322367-1040) [ ] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 154018 INFO (qtp411582425-1048) [ ]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 154022 INFO (qtp1280322367-1040) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 154024 INFO (qtp1280322367-1040) [ ]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@588901e8[collection1_shard1_replica_n1] main]
[junit4] 2> 154024 INFO (searcherExecutor-450-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard2_replica_n6] Registered new searcher
Searcher@27b16a02[collection1_shard2_replica_n6]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 154030 INFO (qtp1280322367-1040) [ ]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/solrCloudCollectionConfig
[junit4] 2> 154030 INFO (qtp1280322367-1040) [ ]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 154031 INFO (qtp1280322367-1040) [ ]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 154032 INFO (searcherExecutor-451-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher
Searcher@588901e8[collection1_shard1_replica_n1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 154033 INFO (qtp411582425-1048) [ ]
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for
shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 154034 INFO (qtp1280322367-1040) [ ]
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for
shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 154040 INFO (qtp834347419-1017) [ ] o.a.s.u.CommitTracker
Hard AutoCommit: disabled
[junit4] 2> 154040 INFO (qtp834347419-1017) [ ] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 154041 INFO (qtp834347419-1017) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 154042 INFO (qtp834347419-1017) [ ]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@5555c9b9[collection1_shard2_replica_n4] main]
[junit4] 2> 154045 INFO (qtp834347419-1017) [ ]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/solrCloudCollectionConfig
[junit4] 2> 154045 INFO (qtp834347419-1017) [ ]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 154046 INFO (qtp834347419-1017) [ ]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 154049 INFO (searcherExecutor-452-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard2_replica_n4] Registered new searcher
Searcher@5555c9b9[collection1_shard2_replica_n4]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 154059 INFO (qtp1394383685-1027) [ ] o.a.s.u.CommitTracker
Hard AutoCommit: disabled
[junit4] 2> 154059 INFO (qtp1394383685-1027) [ ] o.a.s.u.CommitTracker
Soft AutoCommit: disabled
[junit4] 2> 154060 INFO (qtp1394383685-1027) [ ]
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy:
minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807,
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true,
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12,
noCFSRatio=1.0]
[junit4] 2> 154060 INFO (qtp1394383685-1027) [ ]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@133c536c[collection1_shard1_replica_n2] main]
[junit4] 2> 154061 INFO (qtp1394383685-1027) [ ]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/solrCloudCollectionConfig
[junit4] 2> 154061 INFO (qtp1394383685-1027) [ ]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 154062 INFO (qtp1394383685-1027) [ ]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 154063 INFO (searcherExecutor-453-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher
Searcher@133c536c[collection1_shard1_replica_n2]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 154135 INFO (zkCallback-236-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154135 INFO (zkCallback-236-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154135 INFO (zkCallback-243-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154135 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154135 INFO (zkCallback-237-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154135 INFO (zkCallback-237-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154136 INFO (zkCallback-249-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154136 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154533 INFO (qtp411582425-1048) [ ]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 154533 INFO (qtp411582425-1048) [ ]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 154533 INFO (qtp411582425-1048) [ ] o.a.s.c.SyncStrategy
Sync replicas to https://127.0.0.1:39757/solr/collection1_shard2_replica_n6/
[junit4] 2> 154533 ERROR (qtp411582425-1048) [ ] o.a.s.c.SyncStrategy
No UpdateLog found - cannot sync
[junit4] 2> 154534 INFO (qtp411582425-1048) [ ]
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we
can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 154534 INFO (qtp411582425-1048) [ ]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 154535 INFO (qtp1280322367-1040) [ ]
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 154535 INFO (qtp1280322367-1040) [ ]
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 154535 INFO (qtp1280322367-1040) [ ] o.a.s.c.SyncStrategy
Sync replicas to https://127.0.0.1:38401/solr/collection1_shard1_replica_n1/
[junit4] 2> 154535 ERROR (qtp1280322367-1040) [ ] o.a.s.c.SyncStrategy
No UpdateLog found - cannot sync
[junit4] 2> 154535 INFO (qtp1280322367-1040) [ ]
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we
can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 154535 INFO (qtp1280322367-1040) [ ]
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in
election, clear LIR
[junit4] 2> 154536 INFO (qtp411582425-1048) [ ]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
https://127.0.0.1:39757/solr/collection1_shard2_replica_n6/ shard2
[junit4] 2> 154536 INFO (qtp1280322367-1040) [ ]
o.a.s.c.ShardLeaderElectionContext I am the new leader:
https://127.0.0.1:38401/solr/collection1_shard1_replica_n1/ shard1
[junit4] 2> 154637 INFO (zkCallback-236-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154637 INFO (zkCallback-237-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154637 INFO (zkCallback-237-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154637 INFO (zkCallback-236-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154637 INFO (zkCallback-243-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154638 INFO (zkCallback-249-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154638 INFO (zkCallback-249-thread-2) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154638 INFO (zkCallback-243-thread-1) [ ]
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/collections/collection1/state.json] for collection [collection1] has
occurred - updating... (live nodes size: [5])
[junit4] 2> 154687 INFO (qtp411582425-1048) [ ] o.a.s.c.ZkController I
am the leader, no recovery necessary
[junit4] 2> 154687 INFO (qtp1280322367-1040) [ ] o.a.s.c.ZkController
I am the leader, no recovery necessary
[junit4] 2> 154736 INFO (qtp1280322367-1040) [ ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node3&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin}
status=0 QTime=2261
[junit4] 2> 154736 INFO (qtp411582425-1048) [ ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node8&name=collection1_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin}
status=0 QTime=2271
[junit4] 2> 155095 INFO (qtp1394383685-1027) [ ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node5&name=collection1_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin}
status=0 QTime=2617
[junit4] 2> 155095 INFO (qtp834347419-1017) [ ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=collection1&version=2&replicaType=NRT&property.schema=schema.xml&property.config=solrconfig-minimal.xml&coreNodeName=core_node7&name=collection1_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin}
status=0 QTime=2625
[junit4] 2> 155098 INFO (qtp411582425-1033) [ ]
o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most
30 seconds. Check all shard replicas
[junit4] 2> 156105 INFO
(OverseerCollectionConfigSetProcessor-99150423475290125-127.0.0.1:44031_solr-n_0000000000)
[ ] o.a.s.c.OverseerTaskQueue Response ZK path:
/overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may
have disconnected from ZooKeeper
[junit4] 2> 185104 ERROR (qtp411582425-1033) [ ]
o.a.s.h.a.CollectionsHandler Timed out waiting for new collection's replicas to
become ACTIVE replica
https://127.0.0.1:38401/solr/collection1_shard1_replica_n1/ is in state of down
with timeout=30
[junit4] 2> 185104 INFO (qtp411582425-1033) [ ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/collections
params={replicationFactor=2&property.schema=schema.xml&property.config=solrconfig-minimal.xml&collection.configName=solrCloudCollectionConfig&name=collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2}
status=0 QTime=33059
[junit4] 2> 185104 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection:
collection1 failOnTimeout:true timeout (sec):30
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> -
[junit4] 1> replica:core_node3 rstate:down live:true
[junit4] 1> replica:core_node5 rstate:down live:true
[junit4] 1> replica:core_node7 rstate:down live:true
[junit4] 1> replica:core_node8 rstate:down live:true
[junit4] 1> Gave up waiting for recovery to finish..
[junit4] 2> 215278 ERROR
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.Diagnostics Gave up waiting for recovery to finish. THREAD DUMP:
[junit4] 2> "searcherExecutor-453-thread-1" prio=5 Id=1161 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45d7173
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45d7173
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "searcherExecutor-452-thread-1" prio=5 Id=1160 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@852f66
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@852f66
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "searcherExecutor-451-thread-1" prio=5 Id=1159 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6b0abc4d
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6b0abc4d
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "searcherExecutor-450-thread-1" prio=5 Id=1158 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2c37f1ab
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2c37f1ab
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "ScheduledTrigger-437-thread-4" prio=5 Id=1153 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "Scheduler-994265835" prio=5 Id=1144 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6ad922bf
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6ad922bf
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "Scheduler-1482007777" prio=5 Id=1143 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@548f137d
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@548f137d
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "Scheduler-1185431631" prio=5 Id=1142 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@47261aee
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@47261aee
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "ScheduledTrigger-437-thread-3" prio=5 Id=1137 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "OverseerThreadFactory-439-thread-1" prio=5 Id=1135 WAITING on
java.util.concurrent.SynchronousQueue$TransferStack@72c032de
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.SynchronousQueue$TransferStack@72c032de
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:920)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "Connection evictor" daemon prio=5 Id=1134 TIMED_WAITING
[junit4] 2> at java.base@10-ea/java.lang.Thread.sleep(Native Method)
[junit4] 2> at
app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "Scheduler-309351593" prio=5 Id=1133 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@51af2ae3
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@51af2ae3
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "zkConnectionManagerCallback-260-thread-1" prio=5 Id=1132
WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7d17df50
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7d17df50
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2>
"SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker-EventThread"
daemon prio=5 Id=1131 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@a114b76
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@a114b76
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] 2>
[junit4] 2>
"SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker-SendThread(127.0.0.1:44441)"
daemon prio=5 Id=1130 RUNNABLE (in native)
[junit4] 2> at
java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
[junit4] 2> at
java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)
[junit4] 2> at
java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
[junit4] 2> at
java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)
[junit4] 2> - locked sun.nio.ch.Util$2@7934ce28
[junit4] 2> - locked java.util.Collections$UnmodifiableSet@51641bdf
[junit4] 2> - locked sun.nio.ch.EPollSelectorImpl@124aa3fc
[junit4] 2> at
java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)
[junit4] 2> at
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
[junit4] 2> at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2>
[junit4] 2> "Connection evictor" daemon prio=5 Id=1129 TIMED_WAITING
[junit4] 2> at java.base@10-ea/java.lang.Thread.sleep(Native Method)
[junit4] 2> at
app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "Thread-288" prio=5 Id=1124 WAITING on
java.lang.Object@12000038
[junit4] 2> at java.base@10-ea/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.Object@12000038
[junit4] 2> at
java.base@10-ea/java.lang.Object.wait(Object.java:328)
[junit4] 2> at
app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
[junit4] 2>
[junit4] 2> "Thread-286" prio=5 Id=1122 WAITING on
java.lang.Object@12000038
[junit4] 2> at java.base@10-ea/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.Object@12000038
[junit4] 2> at
java.base@10-ea/java.lang.Object.wait(Object.java:328)
[junit4] 2> at
app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
[junit4] 2>
[junit4] 2> "Thread-287" prio=5 Id=1120 WAITING on
java.lang.Object@12000038
[junit4] 2> at java.base@10-ea/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.Object@12000038
[junit4] 2> at
java.base@10-ea/java.lang.Object.wait(Object.java:328)
[junit4] 2> at
app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
[junit4] 2>
[junit4] 2> "Thread-285" prio=5 Id=1118 WAITING on
java.lang.Object@12000038
[junit4] 2> at java.base@10-ea/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.Object@12000038
[junit4] 2> at
java.base@10-ea/java.lang.Object.wait(Object.java:328)
[junit4] 2> at
app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
[junit4] 2>
[junit4] 2> "Thread-284" prio=5 Id=1116 WAITING on
java.lang.Object@12000038
[junit4] 2> at java.base@10-ea/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.Object@12000038
[junit4] 2> at
java.base@10-ea/java.lang.Object.wait(Object.java:328)
[junit4] 2> at
app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
[junit4] 2>
[junit4] 2> "ScheduledTrigger-437-thread-2" prio=5 Id=1115 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2> "ScheduledTrigger-437-thread-1" prio=5 Id=1112 TIMED_WAITING
on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@438edbb7
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> ...
[junit4] 2>
[junit4] 2>
"OverseerAutoScalingTriggerThread-99150423475290125-127.0.0.1:44031_solr-n_0000000000"
prio=5 Id=1110 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4d1ad9de
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4d1ad9de
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:166)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2>
"OverseerCollectionConfigSetProcessor-99150423475290125-127.0.0.1:44031_solr-n_0000000000"
daemon prio=5 Id=1108 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3cd19941
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3cd19941
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)
[junit4] 2> at
app//org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:235)
[junit4] 2> at
app//org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:228)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2>
"OverseerStateUpdate-99150423475290125-127.0.0.1:44031_solr-n_0000000000"
daemon prio=5 Id=1107 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7b439864
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native
Method)
[junit4] 2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7b439864
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
[junit4] 2> at
app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)
[junit4] 2> at
app//org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:203)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> "Connection evictor" daemon prio=5 Id=1109 TIMED_WAITING
[junit4] 2> at java.base@10-ea/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//o
[...truncated too long message...]
olrMetricManager Closing metric reporters for
registry=solr.core.collection1.shard1.replica_n2, tag=829011688
[junit4] 2> 215609 INFO (coreCloseExecutor-467-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@4148935e: rootName =
solr_37099, domain = solr.core.collection1.shard1.replica_n2, service url =
null, agent id = null] for registry solr.core.collection1.shard1.replica_n2 /
com.codahale.metrics.MetricRegistry@639902e8
[junit4] 2> 215609 INFO (jetty-closer-206-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 215609 INFO (jetty-closer-206-thread-5) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 215612 INFO (zkCallback-237-thread-3) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 215635 INFO (coreCloseExecutor-470-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard1_replica_n1] CLOSING SolrCore
org.apache.solr.core.SolrCore@23265b99
[junit4] 2> 215635 INFO (coreCloseExecutor-470-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.core.collection1.shard1.replica_n1, tag=589716377
[junit4] 2> 215635 INFO (coreCloseExecutor-470-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@7a878556: rootName =
solr_38401, domain = solr.core.collection1.shard1.replica_n1, service url =
null, agent id = null] for registry solr.core.collection1.shard1.replica_n1 /
com.codahale.metrics.MetricRegistry@282110b4
[junit4] 2> 215636 INFO (coreCloseExecutor-468-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard2_replica_n6] CLOSING SolrCore
org.apache.solr.core.SolrCore@145cb8f5
[junit4] 2> 215636 INFO (coreCloseExecutor-468-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.core.collection1.shard2.replica_n6, tag=341620981
[junit4] 2> 215636 INFO (coreCloseExecutor-468-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@7ed85f9d: rootName =
solr_39757, domain = solr.core.collection1.shard2.replica_n6, service url =
null, agent id = null] for registry solr.core.collection1.shard2.replica_n6 /
com.codahale.metrics.MetricRegistry@4d67f2ce
[junit4] 2> 215636 INFO (zkCallback-249-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (0)
[junit4] 2> 215646 INFO (zkCallback-236-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (0)
[junit4] 2> 215646 INFO (zkCallback-243-thread-5) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (0)
[junit4] 2> 215642 INFO (coreCloseExecutor-469-thread-1) [ ]
o.a.s.c.SolrCore [collection1_shard2_replica_n4] CLOSING SolrCore
org.apache.solr.core.SolrCore@f01af9a
[junit4] 2> 215647 INFO (zkCallback-237-thread-4) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (0)
[junit4] 2> 215647 INFO (coreCloseExecutor-469-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.core.collection1.shard2.replica_n4, tag=251768730
[junit4] 2> 215636 INFO (zkCallback-247-thread-2) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (0)
[junit4] 2> 215647 INFO (coreCloseExecutor-469-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@78231f0f: rootName =
solr_44031, domain = solr.core.collection1.shard2.replica_n4, service url =
null, agent id = null] for registry solr.core.collection1.shard2.replica_n4 /
com.codahale.metrics.MetricRegistry@1176af9a
[junit4] 2> 215648 INFO (jetty-closer-206-thread-1) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@53fd533d{/solr,null,UNAVAILABLE}
[junit4] 2> 215666 INFO (coreCloseExecutor-467-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.collection.collection1.shard1.leader, tag=829011688
[junit4] 2> 215690 INFO (jetty-closer-206-thread-3) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@2e3584e0{/solr,null,UNAVAILABLE}
[junit4] 2> 215700 INFO (coreCloseExecutor-470-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.collection.collection1.shard1.leader, tag=589716377
[junit4] 2> 215703 INFO (coreCloseExecutor-468-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.collection.collection1.shard2.leader, tag=341620981
[junit4] 2> 215708 INFO (coreCloseExecutor-469-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.collection.collection1.shard2.leader, tag=251768730
[junit4] 2> 215710 INFO (jetty-closer-206-thread-4) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@38df9287{/solr,null,UNAVAILABLE}
[junit4] 2> 215718 INFO (jetty-closer-206-thread-5) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@73039b82{/solr,null,UNAVAILABLE}
[junit4] 2> 215719 INFO (jetty-closer-206-thread-2) [ ]
o.a.s.c.Overseer Overseer
(id=99150423475290125-127.0.0.1:44031_solr-n_0000000000) closing
[junit4] 2> 215719 INFO
(OverseerStateUpdate-99150423475290125-127.0.0.1:44031_solr-n_0000000000) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44031_solr
[junit4] 2> 215720 WARN
(OverseerAutoScalingTriggerThread-99150423475290125-127.0.0.1:44031_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we
are closed, exiting.
[junit4] 2> 215722 INFO (jetty-closer-206-thread-2) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@68480687{/solr,null,UNAVAILABLE}
[junit4] 2> 215723 ERROR
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper
server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 215723 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:44441 44441
[junit4] 2> 216549 INFO (Thread-243) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:44441 44441
[junit4] 2> 216550 WARN (Thread-243) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 4 /solr/configs/solrCloudCollectionConfig
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 20 /solr/collections/collection1/state.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 2
/solr/overseer_elect/election/99150423475290125-127.0.0.1:44031_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2>
[junit4] 2> 216550 INFO
(SUITE-TestCloudNestedDocsSort-seed#[C59CA7B9D7FEF37F]-worker) [ ]
o.a.s.SolrTestCaseJ4 -------------------------------------------------------
Done waiting for tracked resources to be released
[junit4] 2> Dec 10, 2017 2:17:42 PM
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked
thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {},
docValues:{}, maxPointsInLeafNode=1416, maxMBSortInHeap=7.468283715857792,
sim=RandomSimilarity(queryNorm=false): {}, locale=fr-RE,
timezone=America/Scoresbysund
[junit4] 2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 10-ea
(64-bit)/cpus=8,threads=1,free=148457688,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestExpandComponent,
TestNumericTokenStream, TestRTimerTree, TestComplexPhraseQParserPlugin,
MoveReplicaTest, TestRandomDVFaceting, TestAddFieldRealTimeGet,
SpellCheckCollatorTest, TestJoin, TestCloudSchemaless,
BigEndianAscendingWordSerializerTest, TestMultiValuedNumericRangeQuery,
DistributedExpandComponentTest, SpellCheckComponentTest,
LeaderInitiatedRecoveryOnShardRestartTest, TestUnifiedSolrHighlighter,
TestCloudNestedDocsSort]
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=TestCloudNestedDocsSort -Dtests.seed=C59CA7B9D7FEF37F
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-RE
-Dtests.timezone=America/Scoresbysund -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestCloudNestedDocsSort (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: There are still nodes
recoverying - waited for 30 seconds
[junit4] > at
__randomizedtesting.SeedInfo.seed([C59CA7B9D7FEF37F]:0)
[junit4] > at
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
[junit4] > at
org.apache.solr.search.join.TestCloudNestedDocsSort.setupCluster(TestCloudNestedDocsSort.java:75)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at
java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] Completed [99/751 (1!)] on J0 in 65.89s, 0 tests, 1 failure <<<
FAILURES!
[...truncated 42431 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
