Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/740/ Java: 64bit/jdk-12.0.2 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.cloud.RollingRestartTest Error Message: 1 thread leaked from SUITE scope at org.apache.solr.cloud.RollingRestartTest: 1) Thread[id=8020, name=SessionTracker, state=TIMED_WAITING, group=TGRP-RollingRestartTest] at [email protected]/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.RollingRestartTest: 1) Thread[id=8020, name=SessionTracker, state=TIMED_WAITING, group=TGRP-RollingRestartTest] at [email protected]/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) at __randomizedtesting.SeedInfo.seed([8D82D981CE7EDD33]:0) Build Log: [...truncated 14104 lines...] [junit4] Suite: org.apache.solr.cloud.RollingRestartTest [junit4] 2> 497208 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf' [junit4] 2> 497208 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 497209 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/data-dir-45-001 [junit4] 2> 497209 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 497209 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth [junit4] 2> 497209 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /rduq/xx [junit4] 2> 497218 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 497218 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 497218 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 497332 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer start zk server on port:59474 [junit4] 2> 497332 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59474 [junit4] 2> 497332 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59474 [junit4] 2> 497332 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59474 [junit4] 2> 497334 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 497336 INFO (zkConnectionManagerCallback-5063-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 497336 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 497339 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 497341 INFO (zkConnectionManagerCallback-5065-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 497341 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 497343 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 497345 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 497346 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 497348 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 497350 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 497352 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 497354 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 497355 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 497357 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 497358 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 497361 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 497363 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise [junit4] 2> 497624 WARN (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23 [junit4] 2> 497624 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) [junit4] 2> 497624 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ... [junit4] 2> 497624 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 12.0.2+10 [junit4] 2> 497626 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 497626 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 497626 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 497628 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2df5dff1{/rduq/xx,null,AVAILABLE} [junit4] 2> 497628 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@439fc901{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:59478} [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.s.Server Started @497694ms [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/rduq/xx, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/tempDir-001/control/data, hostPort=59478, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/control-001/cores} [junit4] 2> 497629 ERROR (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0 [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr [junit4] 2> 497629 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-13T10:16:05.552664Z [junit4] 2> 497630 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 497634 INFO (zkConnectionManagerCallback-5067-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 497634 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 497737 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 497737 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/control-001/solr.xml [junit4] 2> 497739 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 497739 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 497740 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 497807 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false] [junit4] 2> 497807 WARN (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@25476f6[provider=null,keyStore=null,trustStore=null] [junit4] 2> 497807 WARN (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@25476f6[provider=null,keyStore=null,trustStore=null] [junit4] 2> 497813 WARN (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4107c68e[provider=null,keyStore=null,trustStore=null] [junit4] 2> 497813 WARN (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4107c68e[provider=null,keyStore=null,trustStore=null] [junit4] 2> 497814 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59474/solr [junit4] 2> 497815 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 497818 INFO (zkConnectionManagerCallback-5074-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 497818 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 497928 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 497931 INFO (zkConnectionManagerCallback-5076-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 497931 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 498069 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59478_rduq%2Fxx [junit4] 2> 498071 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.Overseer Overseer (id=72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) starting [junit4] 2> 498079 INFO (OverseerStateUpdate-72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:59478_rduq%2Fxx [junit4] 2> 498079 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59478_rduq%2Fxx [junit4] 2> 498086 INFO (OverseerStateUpdate-72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 498091 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.p.PackageLoader /packages.json updated to version -1 [junit4] 2> 498092 WARN (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info [junit4] 2> 498107 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 498125 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 498134 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 498134 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 498136 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/control-001/cores [junit4] 2> 498148 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 498151 INFO (zkConnectionManagerCallback-5085-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 498151 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 498154 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 498157 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59474/solr ready [junit4] 2> 498161 INFO (qtp404474333-8046) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:59478_rduq%252Fxx&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 498172 INFO (OverseerThreadFactory-1667-thread-1-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection [junit4] 2> 498296 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 498296 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 499364 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0 [junit4] 2> 499389 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test [junit4] 2> 499508 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 499538 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true [junit4] 2> 499539 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 499539 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/control-001/cores/control_collection_shard1_replica_n1/data/] [junit4] 2> 499543 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=59.4375, floorSegmentMB=1.591796875, forceMergeDeletesPctAllowed=2.4071214364530444, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=42.44428947454499 [junit4] 2> 499590 WARN (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 499655 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 499655 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 499656 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 499656 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 499659 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=33.2119140625, floorSegmentMB=0.2265625, forceMergeDeletesPctAllowed=7.049334302744191, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=38.60828052283411 [junit4] 2> 499660 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@50de7214[control_collection_shard1_replica_n1] main] [junit4] 2> 499664 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 499664 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 499665 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 499665 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1661043545303154688 [junit4] 2> 499669 INFO (searcherExecutor-1672-thread-1-processing-n:127.0.0.1:59478_rduq%2Fxx x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@50de7214[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 499675 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0} [junit4] 2> 499675 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1 [junit4] 2> 499684 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 499684 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 499684 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59478/rduq/xx/control_collection_shard1_replica_n1/ [junit4] 2> 499684 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 499685 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:59478/rduq/xx/control_collection_shard1_replica_n1/ has no replicas [junit4] 2> 499685 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72128313774112772-core_node2-n_0000000000 [junit4] 2> 499690 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59478/rduq/xx/control_collection_shard1_replica_n1/ shard1 [junit4] 2> 499795 INFO (zkCallback-5075-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 499796 INFO (zkCallback-5075-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 499797 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 499802 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1506 [junit4] 2> 499807 INFO (qtp404474333-8046) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas [junit4] 2> 499912 INFO (zkCallback-5075-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 499912 INFO (zkCallback-5075-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 499912 INFO (zkCallback-5075-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 499914 INFO (qtp404474333-8046) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:59478_rduq%252Fxx&wt=javabin&version=2} status=0 QTime=1752 [junit4] 2> 499914 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection [junit4] 2> 500028 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500030 INFO (zkConnectionManagerCallback-5091-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500030 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500031 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 500033 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59474/solr ready [junit4] 2> 500033 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 500035 INFO (qtp404474333-8046) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 500043 INFO (OverseerThreadFactory-1667-thread-2-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1 [junit4] 2> 500044 INFO (OverseerCollectionConfigSetProcessor-72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 500264 WARN (OverseerThreadFactory-1667-thread-2-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores. [junit4] 2> 500266 INFO (qtp404474333-8046) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas [junit4] 2> 500268 INFO (qtp404474333-8046) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=233 [junit4] 2> 500269 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected:2 [junit4] 2> 500269 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0 [junit4] 2> 500269 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected:2 [junit4] 2> 500269 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0 [junit4] 2> 500270 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected:2 [junit4] 2> 500270 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0 [junit4] 2> 500270 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=2 [junit4] 2> 500521 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-1-001 of type NRT for shard2 [junit4] 2> 500522 WARN (closeThreadPool-5092-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23 [junit4] 2> 500522 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) [junit4] 2> 500522 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ... [junit4] 2> 500522 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 12.0.2+10 [junit4] 2> 500524 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 500524 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 500524 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 500524 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ab0c537{/rduq/xx,null,AVAILABLE} [junit4] 2> 500525 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@278a222e{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:59517} [junit4] 2> 500525 INFO (closeThreadPool-5092-thread-1) [ ] o.e.j.s.Server Started @500591ms [junit4] 2> 500525 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/rduq/xx, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/tempDir-001/jetty1, hostPort=59517, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-1-001/cores, replicaType=NRT} [junit4] 2> 500526 ERROR (closeThreadPool-5092-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 500526 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 500526 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0 [junit4] 2> 500526 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 500526 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr [junit4] 2> 500526 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-13T10:16:08.449346Z [junit4] 2> 500527 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500530 INFO (zkConnectionManagerCallback-5094-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500530 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500637 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 500637 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-1-001/solr.xml [junit4] 2> 500641 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 500641 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 500642 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 500729 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false] [junit4] 2> 500731 WARN (closeThreadPool-5092-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@27ce2497[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500731 WARN (closeThreadPool-5092-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@27ce2497[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500735 WARN (closeThreadPool-5092-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@65e8d3b[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500735 WARN (closeThreadPool-5092-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@65e8d3b[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500735 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59474/solr [junit4] 2> 500735 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500742 INFO (zkConnectionManagerCallback-5101-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500742 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500785 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-2-001 of type NRT for shard1 [junit4] 2> 500787 WARN (closeThreadPool-5092-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23 [junit4] 2> 500787 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) [junit4] 2> 500787 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ... [junit4] 2> 500787 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 12.0.2+10 [junit4] 2> 500790 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 500790 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 500790 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 500791 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55ff6a11{/rduq/xx,null,AVAILABLE} [junit4] 2> 500792 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@276d1929{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:59520} [junit4] 2> 500792 INFO (closeThreadPool-5092-thread-2) [ ] o.e.j.s.Server Started @500857ms [junit4] 2> 500792 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/rduq/xx, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/tempDir-001/jetty2, hostPort=59520, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-2-001/cores, replicaType=NRT} [junit4] 2> 500794 ERROR (closeThreadPool-5092-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 500794 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 500794 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.6.0 [junit4] 2> 500794 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 500794 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr [junit4] 2> 500794 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-03-13T10:16:08.717620Z [junit4] 2> 500795 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500799 INFO (zkConnectionManagerCallback-5103-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500799 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500851 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500854 INFO (zkConnectionManagerCallback-5105-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500854 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500907 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 500907 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-2-001/solr.xml [junit4] 2> 500910 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored [junit4] 2> 500910 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored [junit4] 2> 500911 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 500918 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 500925 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.ZkController Publish node=127.0.0.1:59517_rduq%2Fxx as DOWN [junit4] 2> 500927 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 500927 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59517_rduq%2Fxx [junit4] 2> 500929 INFO (zkCallback-5075-thread-4) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 500930 INFO (zkCallback-5090-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 500931 INFO (zkCallback-5104-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 500936 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.p.PackageLoader /packages.json updated to version -1 [junit4] 2> 500936 WARN (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info [junit4] 2> 500957 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false] [junit4] 2> 500958 WARN (closeThreadPool-5092-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3d9897e3[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500958 WARN (closeThreadPool-5092-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3d9897e3[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500961 WARN (closeThreadPool-5092-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@744d296b[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500962 WARN (closeThreadPool-5092-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@744d296b[provider=null,keyStore=null,trustStore=null] [junit4] 2> 500962 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 500962 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59474/solr [junit4] 2> 500963 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 500966 INFO (zkConnectionManagerCallback-5116-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 500966 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 500981 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 500990 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 500990 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 500991 INFO (closeThreadPool-5092-thread-1) [n:127.0.0.1:59517_rduq%2Fxx ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-1-001/cores [junit4] 2> 501012 INFO (closeThreadPool-5092-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:59517_rduq%2Fxx [junit4] 2> 501080 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 501082 INFO (zkConnectionManagerCallback-5118-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 501082 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 501092 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 501110 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.ZkController Publish node=127.0.0.1:59520_rduq%2Fxx as DOWN [junit4] 2> 501114 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 501114 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59520_rduq%2Fxx [junit4] 2> 501118 INFO (zkCallback-5090-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 501118 INFO (zkCallback-5075-thread-4) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 501119 INFO (zkCallback-5104-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 501120 INFO (zkCallback-5117-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 501125 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.p.PackageLoader /packages.json updated to version -1 [junit4] 2> 501126 WARN (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info [junit4] 2> 501140 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 501166 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 501180 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 501180 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 501182 INFO (closeThreadPool-5092-thread-2) [n:127.0.0.1:59520_rduq%2Fxx ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-2-001/cores [junit4] 2> 501210 INFO (closeThreadPool-5092-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:59520_rduq%2Fxx [junit4] 2> 501214 INFO (qtp404474333-8045) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:59517_rduq%252Fxx&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 501215 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:59520_rduq%252Fxx&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 501225 INFO (OverseerCollectionConfigSetProcessor-72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 501227 INFO (OverseerThreadFactory-1667-thread-3-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:59517_rduq%2Fxx for creating new replica of shard shard2 for collection collection1 [junit4] 2> 501230 INFO (OverseerThreadFactory-1667-thread-4-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:59520_rduq%2Fxx for creating new replica of shard shard1 for collection collection1 [junit4] 2> 501234 INFO (OverseerThreadFactory-1667-thread-3-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. [junit4] 2> 501236 INFO (OverseerThreadFactory-1667-thread-4-processing-n:127.0.0.1:59478_rduq%2Fxx) [n:127.0.0.1:59478_rduq%2Fxx c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. [junit4] 2> 501248 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx x:collection1_shard2_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n1&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT [junit4] 2> 501255 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx x:collection1_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n2&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 502305 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0 [junit4] 2> 502305 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.6.0 [junit4] 2> 502333 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=test [junit4] 2> 502333 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.s.IndexSchema Schema name=test [junit4] 2> 502527 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 502534 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 502631 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from configset conf1, trusted=true [junit4] 2> 502631 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 502632 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-2-001/cores/collection1_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-2-001/cores/collection1_shard1_replica_n2/data/] [junit4] 2> 502638 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=59.4375, floorSegmentMB=1.591796875, forceMergeDeletesPctAllowed=2.4071214364530444, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=42.44428947454499 [junit4] 2> 502646 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n1' using configuration from configset conf1, trusted=true [junit4] 2> 502647 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n1' (registry 'solr.core.collection1.shard2.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4eda6150 [junit4] 2> 502647 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-1-001/cores/collection1_shard2_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_8D82D981CE7EDD33-001/shard-1-001/cores/collection1_shard2_replica_n1/data/] [junit4] 2> 502660 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=59.4375, floorSegmentMB=1.591796875, forceMergeDeletesPctAllowed=2.4071214364530444, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=42.44428947454499 [junit4] 2> 502668 WARN (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 502683 WARN (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 502766 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 502766 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 502768 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 502768 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 502773 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=33.2119140625, floorSegmentMB=0.2265625, forceMergeDeletesPctAllowed=7.049334302744191, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=38.60828052283411 [junit4] 2> 502777 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5745db74[collection1_shard1_replica_n2] main] [junit4] 2> 502803 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 502803 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 502804 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 502807 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 502808 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 502808 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 502808 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 502809 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1661043548599877632 [junit4] 2> 502812 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=33.2119140625, floorSegmentMB=0.2265625, forceMergeDeletesPctAllowed=7.049334302744191, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=38.60828052283411 [junit4] 2> 502818 INFO (searcherExecutor-1695-thread-1-processing-n:127.0.0.1:59520_rduq%2Fxx x:collection1_shard1_replica_n2 c:collection1 s:shard1) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher Searcher@5745db74[collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 502821 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6611b936[collection1_shard2_replica_n1] main] [junit4] 2> 502828 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 502830 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 502832 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 502832 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1661043548623994880 [junit4] 2> 502837 INFO (searcherExecutor-1696-thread-1-processing-n:127.0.0.1:59517_rduq%2Fxx x:collection1_shard2_replica_n1 c:collection1 s:shard2) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SolrCore [collection1_shard2_replica_n1] Registered new searcher Searcher@6611b936[collection1_shard2_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 502837 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node4=0}, version=0} [junit4] 2> 502840 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 [junit4] 2> 502856 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node3=0}, version=0} [junit4] 2> 502856 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2 [junit4] 2> 502880 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 502880 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 502880 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59520/rduq/xx/collection1_shard1_replica_n2/ [junit4] 2> 502884 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 502886 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SyncStrategy http://127.0.0.1:59520/rduq/xx/collection1_shard1_replica_n2/ has no replicas [junit4] 2> 502886 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72128313774112780-core_node4-n_0000000000 [junit4] 2> 502889 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 502890 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 502890 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59517/rduq/xx/collection1_shard2_replica_n1/ [junit4] 2> 502892 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 502894 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:59517/rduq/xx/collection1_shard2_replica_n1/ has no replicas [junit4] 2> 502894 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/72128313774112778-core_node3-n_0000000000 [junit4] 2> 502907 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59520/rduq/xx/collection1_shard1_replica_n2/ shard1 [junit4] 2> 502916 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59517/rduq/xx/collection1_shard2_replica_n1/ shard2 [junit4] 2> 503031 INFO (zkCallback-5104-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503033 INFO (zkCallback-5117-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503034 INFO (zkCallback-5117-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503034 INFO (zkCallback-5104-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503039 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 503039 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 503058 INFO (qtp599106176-8104) [n:127.0.0.1:59517_rduq%2Fxx c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n1&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1811 [junit4] 2> 503061 INFO (qtp592615835-8124) [n:127.0.0.1:59520_rduq%2Fxx c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n2&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1806 [junit4] 2> 503071 INFO (qtp404474333-8045) [n:127.0.0.1:59478_rduq%2Fxx c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:59517_rduq%252Fxx&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1857 [junit4] 2> 503077 INFO (qtp404474333-8048) [n:127.0.0.1:59478_rduq%2Fxx c:collection1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:59520_rduq%252Fxx&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1862 [junit4] 2> 503078 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 2 active replicas in collection: collection1 [junit4] 2> 503078 INFO (OverseerCollectionConfigSetProcessor-72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 503082 INFO (OverseerCollectionConfigSetProcessor-72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000000) [n:127.0.0.1:59478_rduq%2Fxx ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000005 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 503160 INFO (zkCallback-5117-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503160 INFO (zkCallback-5104-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503160 INFO (zkCallback-5090-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503160 INFO (zkCallback-5104-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503160 INFO (zkCallback-5117-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503161 INFO (zkCallback-5117-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503162 INFO (zkCallback-5104-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 503179 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test [junit4] 2> 503179 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330 [junit4] 2> 503183 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1 [junit4] 2> 503188 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.RollingRestartTest Current overseer leader = 127.0.0.1:59478_rduq%2Fxx [junit4] 1> / (11) [junit4] 1> /configs (2) [junit4] 1> /configs/_default (6) [junit4] 1> /configs/_default/managed-schema (0) [junit4] 1> DATA: [junit4] 1> <?xml version="1.0" encoding="UTF-8" ?> [junit4] 1> <!-- [junit4] 1> Licensed to the Apache Software Foundation (ASF) under one or more [junit4] 1> contributor license agreements. See the NOTICE file distributed with [junit4] 1> this work for additional information regarding copyright ownership. [junit4] 1> The ASF licenses this file to You under the Apache License, Version 2.0 [junit4] 1> (the "License"); you may not use this file except in compliance with [junit4] 1> the License. You may obtain a copy of the License at [junit4] 1> [junit4] 1> http://www.apache.org/licenses/LICENSE-2.0 [junit4] 1> [junit4] 1> Unless required by applicable law or agreed to in writing, software [junit4] 1> distributed under the License is distributed on an "AS IS" BASIS, [junit4] 1> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. [junit4] 1> See the License for the specific language governing permissions and [junit4] 1> limitations under the License. [junit4] 1> --> [junit4] 1> [junit4] 1> <!-- [junit4] 1> [junit4] 1> This example schema is the recommended starting point for users. [junit4] 1> It should be kept correct and concise, usable out-of-the-box. [junit4] 1> [junit4] 1> [junit4] 1> For more information, on how to customize this file, please see [junit4] 1> http://lucene.apache.org/solr/guide/documents-fields-and-schema-design.html [junit4] 1> [junit4] 1> PERFORMANCE NOTE: this schema includes many optional features and should not [junit4] 1> be used for benchmarking. To improve performance one could [junit4] 1> - set stored="false" for all fields possible (esp large fields) when you [junit4] 1> only need to search on the field but don't need to return the original [junit4] 1> value. [junit4] 1> - set indexed="false" if you don't need to search on the field, but only [junit4] 1> return the field as a result of searching on other indexed fields. [junit4] 1> - remove all unneeded copyField statements [junit4] 1> - for best index size and searching performance, set "index" to false [junit4] 1> for all general text fields, use copyField to copy them to the [junit4] 1> catchall "text" field, and use that for searching. [junit4] 1> --> [junit4] 1> [junit4] 1> <schema name="default-config" version="1.6"> [junit4] 1> <!-- attribute "name" is the name of this schema and is only used for display purposes. [junit4] 1> version="x.y" is Solr's version number for the schema syntax and [junit4] 1> semantics. It should not normally be changed by applications. [junit4] 1> [junit4] 1> 1.0: multiValued attribute did not exist, all fields are multiValued [junit4] 1> by nature [junit4] 1> 1.1: multiValued attribute introduced, false by default [junit4] 1> 1.2: omitTermFreqAndPositions attribute introduced, true by default [junit4] 1> except for text fields. [junit4] 1> 1.3: removed optional field compress feature [junit4] 1> 1.4: autoGeneratePhraseQueries attribute introduced to drive QueryParser [junit4] 1> behavior when a single string produces multiple tokens. Defaults [junit4] 1> to off for version >= 1.4 [junit4] 1> 1.5: omitNorms defaults to true for primitive field types [junit4] 1> (int, float, boolean, string...) [junit4] 1> 1.6: useDocValuesAsStored defaults to true. [junit4] 1> --> [junit4] 1> [junit4] 1> <!-- Valid attributes for fields: [junit4] 1> name: mandatory - the name for the field [junit4] 1> type: mandatory - the name of a field type from the [junit4] 1> fieldTypes section [junit4] 1> indexed: true if this field should be indexed (searchable or sortable) [junit4] 1> stored: true if this field should be retrievable [junit4] 1> docValues: true if this field should have doc values. Doc Values is [junit4] 1> recommended (required, if you are using *Point fields) for faceting, [junit4] 1> grouping, sorting and function queries. Doc Values will make the index [junit4] 1> faster to load, more NRT-friendly and more memory-efficient. [junit4] 1> They are currently only supported by StrField, UUIDField, all [junit4] 1> *PointFields, and depending on the field type, they might require [junit4] 1> the field to be single-valued, be required or have a default value [junit4] 1> (check the documentation of the field type you're interested in for [junit4] 1> more information) [junit4] 1> multiValued: true if this field may contain multiple values per document [junit4] 1> omitNorms: (expert) set to true to omit the norms associated with [junit4] 1> this field (this disables length normalization and index-time [junit4] 1> boosting for the field, and saves some memory). Only full-text [junit4] 1> fields or fields that need an index-time boost need norms. [junit4] 1> Norms are omitted for primitive (non-analyzed) types by default. [junit4] 1> termVectors: [false] set to true to store the term vector for a [junit4] 1> given field. [junit4] 1> When using MoreLikeThis, fields used for similarity should be [junit4] 1> stored for best performance. [junit4] 1> termPositions: Store position information with the term vector. [junit4] 1> This will increase storage costs. [junit4] 1> termOffsets: Store offset information with the term vector. This [junit4] 1> will increase storage costs. [junit4] 1> required: The field is required. It will throw an error if the [junit4] 1> value does not exist [junit4] 1> default: a value that should be used if no value is specified [junit4] 1> when adding a document. [junit4] 1> --> [junit4] 1> [junit4] 1> <!-- field names should consist of alphanumeric or underscore characters only and [junit4] 1> not start with a digit. This is not currently strictly enforced, [junit4] 1> but other field names will not have first class support from all components [junit4] 1> and back compatibility is not guaranteed. Names with both leading and [junit4] 1> trailing underscores (e.g. _version_) are reserved. [junit4] 1> --> [junit4] 1> [junit4] 1> <!-- In this _default configset, only four fields are pre-declared: [junit4] 1> id, _version_, and _text_ and _root_. All other fields will be type guessed and added via the [junit4] 1> "add-unknown-fields-to-the-schema" update request processor chain declared in solrconfig.xml. [junit4] 1> [junit4] 1> Note that many dynamic fields are also defined - you can use them to specify a [junit4] 1> field's type via field naming conventions - see below. [junit4] 1> [junit4] 1> WARNING: The _text_ catch-all field will significantly increase your index size. [junit4] 1> If you don't need it, consider removing it and the corresponding copyField directive. [junit4] 1> --> [junit4] 1> [junit4] 1> <field name="id" type="string" indexed="true" stored="true" required="true" multiValued="false" /> [junit4] 1> <!-- docValues are enabled by default for long type so we don't need to index the version field --> [junit4] 1> <field name="_version_" type="plong" indexed="false" stored="false"/> [junit4] 1> [junit4] 1> <!-- If you don't use child/nested documents, then you should remove the next two fields: --> [junit4] 1> <!-- for nested documents (minimal; points to root document) --> [junit4] 1> <field name="_root_" type="string" indexed="true" stored="false" docValues="false" /> [junit4] 1> <!-- for nested documents (relationship tracking) --> [junit4] 1> <field name="_nest_path_" type="_nest_path_" /><fieldType name="_nest_path_" class="solr.NestPathField" /> [junit4] 1> [junit4] 1> <field name="_text_" type="text_general" indexed="true" stored="false" multiValued="true"/> [junit4] 1> [junit4] 1> <!-- This can be enabled, in case the client does not know what fields may be searched. It isn't enabled by default [junit4] 1> because it's very expensive to index everything twice. --> [junit4] 1> <!-- <copyField source="*" dest="_text_"/> --> [junit4] 1> [junit4] 1> <!-- Dynamic field definitions allow using convention over configuration [junit4] 1> for fields via the specification of patterns to match field names. [junit4] 1> EXAMPLE: name="*_i" will [...truncated too long message...] 15) closing [junit4] 2> 527912 INFO (zkCallback-5075-thread-4) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 527934 INFO (closeThreadPool-5208-thread-4) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5f60f0e3{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:59517} [junit4] 2> 527935 INFO (closeThreadPool-5208-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3579f7e7{/rduq/xx,null,UNAVAILABLE} [junit4] 2> 527936 INFO (closeThreadPool-5208-thread-4) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 528034 INFO (closeThreadPool-5208-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000014) closing [junit4] 2> 528037 INFO (closeThreadPool-5208-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@439fc901{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0} [junit4] 2> 528037 INFO (closeThreadPool-5208-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2df5dff1{/rduq/xx,null,UNAVAILABLE} [junit4] 2> 528040 INFO (closeThreadPool-5208-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 528043 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 528256 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 9 /solr/aliases.json [junit4] 2> 7 /solr/packages.json [junit4] 2> 7 /solr/security.json [junit4] 2> 7 /solr/configs/conf1 [junit4] 2> 6 /solr/collections/collection1/terms/shard2 [junit4] 2> 2 /solr/collections/collection1/terms/shard1 [junit4] 2> 2 /solr/collections/control_collection/terms/shard1 [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 111 /solr/collections/collection1/state.json [junit4] 2> 12 /solr/collections/control_collection/state.json [junit4] 2> 10 /solr/autoscaling.json [junit4] 2> 9 /solr/clusterprops.json [junit4] 2> 9 /solr/clusterstate.json [junit4] 2> 2 /solr/overseer_elect/election/72128313774112780-127.0.0.1:59520_rduq%2Fxx-n_0000000007 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112792-127.0.0.1:59517_rduq%2Fxx-n_0000000015 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112780-127.0.0.1:59520_rduq%2Fxx-n_0000000015 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112780-127.0.0.1:59520_rduq%2Fxx-n_0000000010 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112780-127.0.0.1:59520_rduq%2Fxx-n_0000000002 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000006 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000011 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000003 [junit4] 2> 2 /solr/overseer_elect/election/72128313774112772-127.0.0.1:59478_rduq%2Fxx-n_0000000014 [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 72 /solr/overseer/queue [junit4] 2> 48 /solr/live_nodes [junit4] 2> 35 /solr/overseer/collection-queue-work [junit4] 2> 10 /solr/autoscaling/events/.scheduled_maintenance [junit4] 2> 10 /solr/autoscaling/events/.auto_add_replicas [junit4] 2> 10 /solr/overseer/queue-work [junit4] 2> 9 /solr/collections [junit4] 2> [junit4] 2> 528267 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:59474 [junit4] 2> 528267 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59474 [junit4] 2> 528267 INFO (TEST-RollingRestartTest.test-seed#[8D82D981CE7EDD33]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59474 [junit4] 2> 528269 INFO (SUITE-RollingRestartTest-seed#[8D82D981CE7EDD33]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released [junit4] 2> Mar 13, 2020 10:16:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> Mar 13, 2020 10:16:47 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.RollingRestartTest: [junit4] 2> 1) Thread[id=8020, name=SessionTracker, state=TIMED_WAITING, group=TGRP-RollingRestartTest] [junit4] 2> at [email protected]/java.lang.Thread.sleep(Native Method) [junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) [junit4] 2> Mar 13, 2020 10:16:47 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> INFO: Starting to interrupt leaked threads: [junit4] 2> 1) Thread[id=8020, name=SessionTracker, state=TIMED_WAITING, group=TGRP-RollingRestartTest] [junit4] 2> 539123 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker [junit4] 2> => java.lang.InterruptedException: sleep interrupted [junit4] 2> at java.base/java.lang.Thread.sleep(Native Method) [junit4] 2> java.lang.InterruptedException: sleep interrupted [junit4] 2> at java.lang.Thread.sleep(Native Method) [?:?] [junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.5.jar:3.5.5] [junit4] 2> Mar 13, 2020 10:16:47 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> INFO: All leaked threads terminated. [junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=1344, maxMBSortInHeap=5.027603073351898, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@61f32586), locale=en-JM, timezone=SystemV/AST4ADT [junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 12.0.2 (64-bit)/cpus=6,threads=1,free=215601144,total=448958464 [junit4] 2> NOTE: All tests run in this JVM: [BadCopyFieldTest, TestCharFilters, TestExpandComponent, HdfsUnloadDistributedZkTest, AtomicUpdatesTest, BufferStoreTest, TestLegacyField, DistribJoinFromCollectionTest, DistributedFacetExistsSmallTest, TestHashPartitioner, AddBlockUpdateTest, TestSolrTestCaseJ4, DocumentBuilderTest, TaggingAttributeTest, TestSimpleTextCodec, CloneFieldUpdateProcessorFactoryTest, UnloadDistributedZkTest, TestMinHashQParser, BigEndianAscendingWordSerializerTest, TestSQLHandler, TestDynamicFieldCollectionResource, JWTAuthPluginIntegrationTest, HLLUtilTest, TestSimClusterStateProvider, SolrInfoBeanTest, TestTestInjection, TestPayloadCheckQParserPlugin, TestConfigSets, SubstringBytesRefFilterTest, TestJsonFacetsStatsParsing, HdfsRecoveryZkTest, TestTlogReplayVsRecovery, TestRawResponseWriter, CacheHeaderTest, TestDirectoryFactory, FieldMutatingUpdateProcessorTest, TestRequestStatusCollectionAPI, NodeLostTriggerIntegrationTest, TestCloudConsistency, OutOfBoxZkACLAndCredentialsProvidersTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, PropertiesRequestHandlerTest, SolrXmlInZkTest, AnalysisAfterCoreReloadTest, MetricsConfigTest, ScheduledTriggerIntegrationTest, TestSimExtremeIndexing, PreAnalyzedFieldManagedSchemaCloudTest, TestRTGBase, TestManagedResource, RollingRestartTest] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RollingRestartTest -Dtests.seed=8D82D981CE7EDD33 -Dtests.slow=true -Dtests.locale=en-JM -Dtests.timezone=SystemV/AST4ADT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 0.00s J0 | RollingRestartTest (suite) <<< [junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.RollingRestartTest: [junit4] > 1) Thread[id=8020, name=SessionTracker, state=TIMED_WAITING, group=TGRP-RollingRestartTest] [junit4] > at [email protected]/java.lang.Thread.sleep(Native Method) [junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) [junit4] > at __randomizedtesting.SeedInfo.seed([8D82D981CE7EDD33]:0) [junit4] Completed [254/901 (1!)] on J0 in 42.18s, 1 test, 1 error <<< FAILURES! [...truncated 50227 lines...] [repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/740/consoleText [repro] Revision: 57849d0756ab819d3d4c5d9a9caa3e2aa0a77b64 [repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" [repro] Repro line: ant test -Dtestcase=RollingRestartTest -Dtests.seed=8D82D981CE7EDD33 -Dtests.slow=true -Dtests.locale=en-JM -Dtests.timezone=SystemV/AST4ADT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [repro] JUnit rest result XML files will be moved to: ./repro-reports [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] RollingRestartTest [repro] ant compile-test [...truncated 3448 lines...] [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.RollingRestartTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=8D82D981CE7EDD33 -Dtests.slow=true -Dtests.locale=en-JM -Dtests.timezone=SystemV/AST4ADT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [...truncated 81 lines...] [repro] Failures w/original seeds: [repro] 0/5 failed: org.apache.solr.cloud.RollingRestartTest [repro] Exiting with code 0 [...truncated 73 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
