Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Windows/572/
Java: 64bit/jdk-13 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.MissingSegmentRecoveryTest.testLeaderRecovery

Error Message:
IOException occurred when talking to server at: https://127.0.0.1:50287/solr

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occurred when 
talking to server at: https://127.0.0.1:50287/solr
        at 
__randomizedtesting.SeedInfo.seed([E04714A784B16A6C:B0128CA4DD90DC71]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:679)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
        at 
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
        at 
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
        at 
org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1127)
        at 
org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:896)
        at 
org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:828)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
        at 
org.apache.solr.cloud.MissingSegmentRecoveryTest.teardown(MissingSegmentRecoveryTest.java:87)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:830)
Caused by: javax.net.ssl.SSLException: An established connection was aborted by 
the software in your host machine
        at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:127)
        at 
java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:324)
        at 
java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:267)
        at 
java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:262)
        at 
java.base/sun.security.ssl.SSLSocketImpl.handleException(SSLSocketImpl.java:1652)
        at 
java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1038)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at 
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at 
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at 
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at 
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at 
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
        at 
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
        ... 46 more
        Suppressed: java.net.SocketException: An established connection was 
aborted by the software in your host machine
                at 
java.base/sun.nio.ch.NioSocketImpl.implWrite(NioSocketImpl.java:421)
                at 
java.base/sun.nio.ch.NioSocketImpl.write(NioSocketImpl.java:441)
                at 
java.base/sun.nio.ch.NioSocketImpl$2.write(NioSocketImpl.java:825)
                at 
java.base/java.net.Socket$SocketOutputStream.write(Socket.java:989)
                at 
java.base/sun.security.ssl.SSLSocketOutputRecord.encodeAlert(SSLSocketOutputRecord.java:82)
                at 
java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:355)
                ... 68 more
Caused by: java.net.SocketException: An established connection was aborted by 
the software in your host machine
        at java.base/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:326)
        at java.base/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:351)
        at java.base/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:802)
        at java.base/java.net.Socket$SocketInputStream.read(Socket.java:919)
        at 
java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:450)
        at 
java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
        at 
java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1409)
        at 
java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1022)
        ... 64 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.core.ConfigureRecoveryStrategyTest

Error Message:
Could not remove the following files (in the order of attempts):    
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001:
 java.nio.file.AccessDeniedException: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001
    
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001:
 java.nio.file.DirectoryNotEmptyException: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001
 

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of 
attempts):
   
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001:
 java.nio.file.AccessDeniedException: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001
   
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001:
 java.nio.file.DirectoryNotEmptyException: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001

        at __randomizedtesting.SeedInfo.seed([E04714A784B16A6C]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:319)
        at 
org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at 
com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:830)




Build Log:
[...truncated 13740 lines...]
   [junit4] Suite: org.apache.solr.core.ConfigureRecoveryStrategyTest
   [junit4]   2> 849117 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001
   [junit4]   2> 849118 WARN  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=102 numCloses=102
   [junit4]   2> 849118 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 849121 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 849121 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 849122 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 849123 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: 
[/C:/Users/jenkins/workspace/Lucene-Solr-8.x-Windows/solr/core/src/test-files/solr/collection1/lib,
 
/C:/Users/jenkins/workspace/Lucene-Solr-8.x-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 849179 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.4.0
   [junit4]   2> 849196 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 849519 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 849659 WARN  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.f.DistribPackageStore Unable to create 
[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr\filestore]
 directory in SOLR_HOME 
[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr].
  Features requiring this directory may fail.
   [junit4]   2>           => java.security.AccessControlException: access 
denied ("java.io.FilePermission" 
"C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr\filestore"
 "write")
   [junit4]   2>        at 
java.base/java.security.AccessControlContext.checkPermission(AccessControlContext.java:472)
   [junit4]   2> java.security.AccessControlException: access denied 
("java.io.FilePermission" 
"C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr\filestore"
 "write")
   [junit4]   2>        at 
java.security.AccessControlContext.checkPermission(AccessControlContext.java:472)
 ~[?:?]
   [junit4]   2>        at 
java.security.AccessController.checkPermission(AccessController.java:1036) 
~[?:?]
   [junit4]   2>        at 
java.lang.SecurityManager.checkPermission(SecurityManager.java:408) ~[?:?]
   [junit4]   2>        at 
java.lang.SecurityManager.checkWrite(SecurityManager.java:838) ~[?:?]
   [junit4]   2>        at java.io.File.mkdir(File.java:1323) ~[?:?]
   [junit4]   2>        at java.io.File.mkdirs(File.java:1355) ~[?:?]
   [junit4]   2>        at 
org.apache.solr.filestore.DistribPackageStore.ensurePackageStoreDir(DistribPackageStore.java:476)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.filestore.DistribPackageStore.<init>(DistribPackageStore.java:65)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.filestore.PackageStoreAPI.<init>(PackageStoreAPI.java:77) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.load(CoreContainer.java:619) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.util.TestHarness.<init>(TestHarness.java:180) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.util.TestHarness.<init>(TestHarness.java:143) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.util.TestHarness.<init>(TestHarness.java:149) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.util.TestHarness.<init>(TestHarness.java:112) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:797) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:787) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:648) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:637) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.core.ConfigureRecoveryStrategyTest.beforeClass(ConfigureRecoveryStrategyTest.java:43)
 ~[test/:?]
   [junit4]   2>        at 
jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
   [junit4]   2>        at 
jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 ~[?:?]
   [junit4]   2>        at 
jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 ~[?:?]
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:567) 
~[?:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:878)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
 ~[java/:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
 ~[java/:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
 ~[java/:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
 ~[randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:830) [?:?]
   [junit4]   2> 849662 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 849673 WARN  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@1b5ff8c6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 849673 WARN  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@1b5ff8c6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 849698 WARN  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@335efef0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 849698 WARN  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@335efef0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 849759 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 849759 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 849801 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 849811 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 849813 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 849815 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, 
from paths: 
[/C:/Users/jenkins/workspace/Lucene-Solr-8.x-Windows/solr/core/src/test-files/solr/collection1/lib,
 
/C:/Users/jenkins/workspace/Lucene-Solr-8.x-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 849902 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.4.0
   [junit4]   2> 849908 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 850073 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field 
id
   [junit4]   2> 850112 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using 
configuration from instancedir 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr\collection1,
 trusted=true
   [junit4]   2> 850112 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 850112 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.c.SolrCore 
org.apache.solr.core.ConfigureRecoveryStrategyTest$CustomRecoveryStrategyBuilder
   [junit4]   2> 850124 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr\collection1],
 
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001\]
   [junit4]   2> 850133 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 850326 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 850326 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 850330 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=25, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.3154296875, 
floorSegmentMB=0.2705078125, forceMergeDeletesPctAllowed=5.189229965072606, 
segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, 
deletesPctAllowed=21.223915954183067
   [junit4]   2> 850330 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@812598f[collection1] main]
   [junit4]   2> 850340 WARN  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.r.ManagedResourceStorage Cannot write to config directory 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\core\src\test-files\solr\collection1\conf;
 switching to use InMemory storage instead.
   [junit4]   2> 850340 INFO  (coreLoadExecutor-3076-thread-1) [    
x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 850342 INFO  
(searcherExecutor-3077-thread-1-processing-x:collection1) [    x:collection1 ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@812598f[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 850344 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 850363 INFO  
(TEST-ConfigureRecoveryStrategyTest.testAlmostAllMethodsAreFinal-seed#[E04714A784B16A6C])
 [     ] o.a.s.SolrTestCaseJ4 ###Starting testAlmostAllMethodsAreFinal
   [junit4]   2> 850364 INFO  
(TEST-ConfigureRecoveryStrategyTest.testAlmostAllMethodsAreFinal-seed#[E04714A784B16A6C])
 [     ] o.a.s.SolrTestCaseJ4 ###Ending testAlmostAllMethodsAreFinal
   [junit4]   2> 850369 INFO  
(TEST-ConfigureRecoveryStrategyTest.testBuilder-seed#[E04714A784B16A6C]) [     
] o.a.s.SolrTestCaseJ4 ###Starting testBuilder
   [junit4]   2> 850369 INFO  
(TEST-ConfigureRecoveryStrategyTest.testBuilder-seed#[E04714A784B16A6C]) [     
] o.a.s.SolrTestCaseJ4 ###Ending testBuilder
   [junit4]   2> 850369 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 850369 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1503196665
   [junit4]   2> 850376 INFO  (coreCloseExecutor-3081-thread-1) [    
x:collection1 ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5683f602
   [junit4]   2> 850377 INFO  (coreCloseExecutor-3081-thread-1) [    
x:collection1 ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.collection1, tag=SolrCore@5683f602
   [junit4]   2> 850377 INFO  (coreCloseExecutor-3081-thread-1) [    
x:collection1 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@633c0d4e: rootName = null, 
domain = solr.core.collection1, service url = null, agent id = null] for 
registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@160f4c64
   [junit4]   2> 850389 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 850389 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@7428bba8: rootName = null, 
domain = solr.node, service url = null, agent id = null] for registry solr.node 
/ com.codahale.metrics.MetricRegistry@15730980
   [junit4]   2> 850393 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 850393 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@308cfc0a: rootName = null, 
domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / 
com.codahale.metrics.MetricRegistry@610c02a1
   [junit4]   2> 850397 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 850397 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@65d2f28d: rootName = null, 
domain = solr.jetty, service url = null, agent id = null] for registry 
solr.jetty / com.codahale.metrics.MetricRegistry@210108a1
   [junit4]   2> 850452 INFO  
(SUITE-ConfigureRecoveryStrategyTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 ------------------------------------------------------- 
Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84): {}, 
docValues:{}, maxPointsInLeafNode=1016, maxMBSortInHeap=7.649274251499495, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@171a24d3),
 locale=tt-RU, timezone=America/Indiana/Winamac
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 13 
(64-bit)/cpus=3,threads=1,free=195676792,total=384827392
   [junit4]   2> NOTE: All tests run in this JVM: 
[ProtectedTermFilterFactoryTest, JavaBinAtomicUpdateMultivalueTest, 
SolrMetricsIntegrationTest, RequiredFieldsTest, TestFieldCache, 
TestJsonRequest, TestSolrIndexConfig, RequestHandlersTest, ZkFailoverTest, 
RestartWhileUpdatingTest, QueryParsingTest, TestFieldCollectionResource, 
MetricsHistoryHandlerTest, TestInfoStreamLogging, 
SimpleCollectionCreateDeleteTest, TestExportWriter, HttpTriggerListenerTest, 
TestSimpleQParserPlugin, MultiDestinationAuditLoggerTest, 
TestMaxScoreQueryParser, TestUtilizeNode, MergeStrategyTest, 
RequestLoggingTest, TestOmitPositions, TestValueSourceCache, TestSolrCachePerf, 
TestShortCircuitedRequests, TestSweetSpotSimilarityFactory, 
TestPostingsSolrHighlighter, IndexSizeEstimatorTest, TestCollectionAPI, 
XMLAtomicUpdateMultivalueTest, TestMergePolicyConfig, ReplaceNodeTest, 
TestDeprecatedFilters, ScriptEngineTest, ChangedSchemaMergeTest, TestUtils, 
TestRandomCollapseQParserPlugin, ShardRoutingTest, TestSolrCloudSnapshots, 
LeaderVoteWaitTimeoutTest, SolrCloudExampleTest, TestCSVResponseWriter, 
SolrMetricManagerTest, TestConfigSetsAPIZkFailure, TestHdfsCloudBackupRestore, 
GraphQueryTest, ClusterStateUpdateTest, TestDistributedMap, 
TestSimpleTextCodec, HdfsDirectoryFactoryTest, UtilsToolTest, 
SpellCheckComponentTest, TestUseDocValuesAsStored, TestPerFieldSimilarity, 
TestCloudPivotFacet, DistribDocExpirationUpdateProcessorTest, 
TestWithCollection, ChaosMonkeySafeLeaderTest, DocValuesNotIndexedTest, 
TestAnalyzedSuggestions, TestJsonFacetRefinement, MoveReplicaHDFSFailoverTest, 
TestPivotHelperCode, TestEmbeddedSolrServerSchemaAPI, 
TestChildDocTransformerHierarchy, SimpleMLTQParserTest, 
TestHdfsBackupRestoreCore, TermsComponentTest, ConfigureRecoveryStrategyTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=ConfigureRecoveryStrategyTest -Dtests.seed=E04714A784B16A6C 
-Dtests.slow=true -Dtests.locale=tt-RU -Dtests.timezone=America/Indiana/Winamac 
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | ConfigureRecoveryStrategyTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the 
following files (in the order of attempts):
   [junit4]    >    
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001:
 java.nio.file.AccessDeniedException: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001\data-dir-80-001
   [junit4]    >    
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001:
 java.nio.file.DirectoryNotEmptyException: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_E04714A784B16A6C-001
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([E04714A784B16A6C]:0)
   [junit4]    >        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:319)
   [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:830)
   [junit4] Completed [133/887 (1!)] on J1 in 1.61s, 2 tests, 1 error <<< 
FAILURES!

[...truncated 1334 lines...]
   [junit4] Suite: org.apache.solr.cloud.MissingSegmentRecoveryTest
   [junit4]   2> 2871656 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\data-dir-265-001
   [junit4]   2> 2871656 WARN  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=22 numCloses=22
   [junit4]   2> 2871656 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2871658 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 2871659 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2871659 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001
   [junit4]   2> 2871659 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2871659 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2871659 INFO  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2871760 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer start zk server on port:50274
   [junit4]   2> 2871760 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:50274
   [junit4]   2> 2871760 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:50274
   [junit4]   2> 2871760 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 50274
   [junit4]   2> 2871762 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2871768 INFO  (zkConnectionManagerCallback-16495-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2871768 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2871771 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2871773 INFO  (zkConnectionManagerCallback-16497-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2871773 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2871774 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2871776 INFO  (zkConnectionManagerCallback-16499-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2871776 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2871882 WARN  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2871882 WARN  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2871882 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 2871882 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 2871882 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2871882 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2871883 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: 
afcf563148970e98786327af5e07c261fda175d3; jvm 13+33
   [junit4]   2> 2871883 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: 
afcf563148970e98786327af5e07c261fda175d3; jvm 13+33
   [junit4]   2> 2871883 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2871883 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2871884 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2871884 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2871884 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2871884 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2871884 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@59486292{/solr,null,AVAILABLE}
   [junit4]   2> 2871884 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7317556a{/solr,null,AVAILABLE}
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@5cb4d044{ssl,[ssl, alpn, 
http/1.1, h2]}{127.0.0.1:50288}
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.s.Server Started @2871912ms
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=50288}
   [junit4]   2> 2871885 ERROR (jetty-launcher-16500-thread-1) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.4.0
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-11-30T12:07:33.735797800Z
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.AbstractConnector Started ServerConnector@6e7948a9{ssl,[ssl, alpn, 
http/1.1, h2]}{127.0.0.1:50287}
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.s.Server Started @2871912ms
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=50287}
   [junit4]   2> 2871885 ERROR (jetty-launcher-16500-thread-2) [     ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.4.0
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2871885 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-11-30T12:07:33.735797800Z
   [junit4]   2> 2871887 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2871887 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2871889 INFO  (zkConnectionManagerCallback-16504-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2871889 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2871889 INFO  (zkConnectionManagerCallback-16502-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2871889 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2871890 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2871890 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2872087 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2872087 WARN  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@4023d8e1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872087 WARN  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@4023d8e1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872092 WARN  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@408a65ab[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872092 WARN  (jetty-launcher-16500-thread-1) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@408a65ab[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872093 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50274/solr
   [junit4]   2> 2872093 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2872115 INFO  (zkConnectionManagerCallback-16511-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2872115 INFO  (jetty-launcher-16500-thread-1) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2872222 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2872224 INFO  (zkConnectionManagerCallback-16514-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2872224 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 2872332 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:50288_solr
   [junit4]   2> 2872333 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.Overseer Overseer 
(id=72079262497112070-127.0.0.1:50288_solr-n_0000000000) starting
   [junit4]   2> 2872337 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50288_solr
   [junit4]   2> 2872337 INFO  
(OverseerStateUpdate-72079262497112070-127.0.0.1:50288_solr-n_0000000000) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:50288_solr
   [junit4]   2> 2872338 INFO  
(OverseerStateUpdate-72079262497112070-127.0.0.1:50288_solr-n_0000000000) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 2872361 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2872362 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 2872362 WARN  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@424d64d2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872362 WARN  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@424d64d2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872366 WARN  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.u.s.S.config Trusting all certificates configured for 
Client@7ac4382f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872366 WARN  (jetty-launcher-16500-thread-2) [     ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
Client@7ac4382f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2872366 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50274/solr
   [junit4]   2> 2872368 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2872370 INFO  (zkConnectionManagerCallback-16524-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2872371 INFO  (jetty-launcher-16500-thread-2) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2872397 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_50288.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2872407 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_50288.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2872407 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_50288.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2872409 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 2872410 INFO  (jetty-launcher-16500-thread-1) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001\node1\.
   [junit4]   2> 2872474 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2872478 INFO  (zkConnectionManagerCallback-16526-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2872478 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 2872487 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 2872494 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.ZkController Publish 
node=127.0.0.1:50287_solr as DOWN
   [junit4]   2> 2872496 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 2872496 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50287_solr
   [junit4]   2> 2872497 INFO  (zkCallback-16513-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2872498 INFO  (zkCallback-16525-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2872539 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 2872571 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_50287.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2872584 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_50287.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2872584 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_50287.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2872587 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.p.PackageLoader /packages.json updated to 
version -1
   [junit4]   2> 2872588 INFO  (jetty-launcher-16500-thread-2) 
[n:127.0.0.1:50287_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001\node2\.
   [junit4]   2> 2872625 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 2872627 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2872631 INFO  (zkConnectionManagerCallback-16535-thread-1) [   
  ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2872631 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2872632 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2872635 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50274/solr ready
   [junit4]   2> 2872667 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.SolrTestCaseJ4 ###Starting testLeaderRecovery
   [junit4]   2> 2872686 INFO  (qtp1686184921-50778) [n:127.0.0.1:50287_solr    
 ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf&maxShardsPerNode=1&name=MissingSegmentRecoveryTest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 2872696 INFO  
(OverseerThreadFactory-11784-thread-1-processing-n:127.0.0.1:50288_solr) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection 
MissingSegmentRecoveryTest
   [junit4]   2> 2872828 INFO  
(OverseerStateUpdate-72079262497112070-127.0.0.1:50288_solr-n_0000000000) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"MissingSegmentRecoveryTest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"MissingSegmentRecoveryTest_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:50287/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2872849 INFO  
(OverseerStateUpdate-72079262497112070-127.0.0.1:50288_solr-n_0000000000) 
[n:127.0.0.1:50288_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"MissingSegmentRecoveryTest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:50288/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2873065 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr    
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation 
core create command 
qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n2&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2873065 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr    
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 2873066 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr    
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation 
core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n1&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2874092 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 8.4.0
   [junit4]   2> 2874100 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema 
[MissingSegmentRecoveryTest_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 2874101 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 8.4.0
   [junit4]   2> 2874103 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2874103 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating 
SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n2' using configuration 
from collection MissingSegmentRecoveryTest, trusted=true
   [junit4]   2> 2874104 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 
'solr_50288.solr.core.MissingSegmentRecoveryTest.shard1.replica_n2' (registry 
'solr.core.MissingSegmentRecoveryTest.shard1.replica_n2') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2874104 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore 
[[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at 
[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001\node1\MissingSegmentRecoveryTest_shard1_replica_n2],
 
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001\node1\.\MissingSegmentRecoveryTest_shard1_replica_n2\data\]
   [junit4]   2> 2874108 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.IndexSchema 
[MissingSegmentRecoveryTest_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2874113 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2874113 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating 
SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n1' using configuration 
from collection MissingSegmentRecoveryTest, trusted=true
   [junit4]   2> 2874113 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 
'solr_50287.solr.core.MissingSegmentRecoveryTest.shard1.replica_n1' (registry 
'solr.core.MissingSegmentRecoveryTest.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4d59292f
   [junit4]   2> 2874113 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrCore 
[[MissingSegmentRecoveryTest_shard1_replica_n1] ] Opening new SolrCore at 
[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001\node2\MissingSegmentRecoveryTest_shard1_replica_n1],
 
dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001\tempDir-001\node2\.\MissingSegmentRecoveryTest_shard1_replica_n1\data\]
   [junit4]   2> 2874248 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2874248 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2874251 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 2874251 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 2874255 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2874255 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2874256 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 2874256 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 2874261 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@1868284[MissingSegmentRecoveryTest_shard1_replica_n2] main]
   [junit4]   2> 2874261 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2874261 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2874261 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 2874264 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1651628474225393664
   [junit4]   2> 2874270 INFO  
(searcherExecutor-11796-thread-1-processing-n:127.0.0.1:50288_solr 
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest 
s:shard1 r:core_node4) [n:127.0.0.1:50288_solr c:MissingSegmentRecoveryTest 
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2] Registered new 
searcher Searcher@1868284[MissingSegmentRecoveryTest_shard1_replica_n2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2874270 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkShardTerms 
Successful update of terms at 
/collections/MissingSegmentRecoveryTest/terms/shard1 to 
Terms{values={core_node4=0}, version=0}
   [junit4]   2> 2874271 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/MissingSegmentRecoveryTest/leaders/shard1
   [junit4]   2> 2874271 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@62f2f329[MissingSegmentRecoveryTest_shard1_replica_n1] main]
   [junit4]   2> 2874276 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for 
shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2874276 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2874276 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2874276 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 2874276 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1651628474237976576
   [junit4]   2> 2874281 INFO  
(searcherExecutor-11797-thread-1-processing-n:127.0.0.1:50287_solr 
x:MissingSegmentRecoveryTest_shard1_replica_n1 c:MissingSegmentRecoveryTest 
s:shard1 r:core_node3) [n:127.0.0.1:50287_solr c:MissingSegmentRecoveryTest 
s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] 
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n1] Registered new 
searcher Searcher@62f2f329[MissingSegmentRecoveryTest_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2874284 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkShardTerms 
Successful update of terms at 
/collections/MissingSegmentRecoveryTest/terms/shard1 to 
Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 2874284 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/MissingSegmentRecoveryTest/leaders/shard1
   [junit4]   2> 2874779 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2874779 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2874779 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync 
replicas to 
https://127.0.0.1:50288/solr/MissingSegmentRecoveryTest_shard1_replica_n2/
   [junit4]   2> 2874780 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: 
core=MissingSegmentRecoveryTest_shard1_replica_n2 
url=https://127.0.0.1:50288/solr START 
replicas=[https://127.0.0.1:50287/solr/MissingSegmentRecoveryTest_shard1_replica_n1/]
 nUpdates=100
   [junit4]   2> 2874780 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: 
core=MissingSegmentRecoveryTest_shard1_replica_n2 
url=https://127.0.0.1:50288/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2874787 INFO  (qtp1686184921-50770) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.S.Request 
[MissingSegmentRecoveryTest_shard1_replica_n1]  webapp=/solr path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 2874788 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's 
attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2874788 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2874788 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/MissingSegmentRecoveryTest/leaders/shard1/leader after winning as 
/collections/MissingSegmentRecoveryTest/leader_elect/shard1/election/72079262497112070-core_node4-n_0000000000
   [junit4]   2> 2874790 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
https://127.0.0.1:50288/solr/MissingSegmentRecoveryTest_shard1_replica_n2/ 
shard1
   [junit4]   2> 2874893 INFO  (zkCallback-16513-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2874894 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkController I am the 
leader, no recovery necessary
   [junit4]   2> 2874900 INFO  (qtp1447869236-50773) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n2&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=1837
   [junit4]   2> 2874998 INFO  (zkCallback-16513-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2874998 INFO  (zkCallback-16513-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2875312 INFO  (qtp1686184921-50774) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] 
webapp=null path=/admin/cores 
params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n1&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT}
 status=0 QTime=2245
   [junit4]   2> 2875315 INFO  (qtp1686184921-50778) [n:127.0.0.1:50287_solr    
 ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at 
most 45 seconds. Check all shard replicas
   [junit4]   2> 2875394 INFO  (zkCallback-16513-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2875394 INFO  (zkCallback-16513-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2875394 INFO  (zkCallback-16525-thread-1) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2875396 INFO  (qtp1686184921-50778) [n:127.0.0.1:50287_solr    
 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={collection.configName=conf&maxShardsPerNode=1&name=MissingSegmentRecoveryTest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2}
 status=0 QTime=2709
   [junit4]   2> 2875396 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.SolrCloudTestCase waitForState (MissingSegmentRecoveryTest): 
Expected a collection with one shard and two replicas
   [junit4]   2> 2875396 INFO  (zkCallback-16525-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2875396 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 2875396 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 2875396 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 2875411 INFO  (qtp1447869236-50783) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkShardTerms 
Successful update of terms at 
/collections/MissingSegmentRecoveryTest/terms/shard1 to 
Terms{values={core_node3=1, core_node4=1}, version=2}
   [junit4]   2> 2875442 INFO  (qtp1686184921-50776) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[MissingSegmentRecoveryTest_shard1_replica_n1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:50288/solr/MissingSegmentRecoveryTest_shard1_replica_n2/&wt=javabin&version=2}{add=[0
 (1651628475422867456), 1 (1651628475428110336), 2 (1651628475428110337), 3 
(1651628475428110338), 4 (1651628475428110339), 5 (1651628475428110340), 6 
(1651628475428110341), 7 (1651628475428110342), 8 (1651628475428110343), 9 
(1651628475428110344)]} 0 5
   [junit4]   2> 2875443 INFO  (qtp1447869236-50783) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[MissingSegmentRecoveryTest_shard1_replica_n2]  webapp=/solr path=/update 
params={wt=javabin&version=2}{add=[0 (1651628475422867456), 1 
(1651628475428110336), 2 (1651628475428110337), 3 (1651628475428110338), 4 
(1651628475428110339), 5 (1651628475428110340), 6 (1651628475428110341), 7 
(1651628475428110342), 8 (1651628475428110343), 9 (1651628475428110344)]} 0 37
   [junit4]   2> 2875447 INFO  (qtp1447869236-50775) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 
start 
commit{_version_=1651628475464810496,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2875447 INFO  (qtp1447869236-50775) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter 
Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7e16f2a3 
commitCommandVersion:1651628475464810496
   [junit4]   2> 2875448 INFO  (qtp1686184921-50770) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 
start 
commit{_version_=1651628475466907648,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2875448 INFO  (qtp1686184921-50770) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter 
Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4e40bda2 
commitCommandVersion:1651628475466907648
   [junit4]   2> 2875550 INFO  (qtp1447869236-50775) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@567cbc6d[MissingSegmentRecoveryTest_shard1_replica_n2] main]
   [junit4]   2> 2875551 INFO  (qtp1447869236-50775) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 
end_commit_flush
   [junit4]   2> 2875551 INFO  (qtp1686184921-50770) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@4503c27c[MissingSegmentRecoveryTest_shard1_replica_n1] main]
   [junit4]   2> 2875552 INFO  
(searcherExecutor-11796-thread-1-processing-n:127.0.0.1:50288_solr 
x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest 
s:shard1 r:core_node4) [n:127.0.0.1:50288_solr c:MissingSegmentRecoveryTest 
s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2] Registered new 
searcher Searcher@567cbc6d[MissingSegmentRecoveryTest_shard1_replica_n2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.4.0):C10:[diagnostics={os=Windows
 10, java.vendor=Oracle Corporation, java.version=13, java.vm.version=13+33, 
lucene.version=8.4.0, os.arch=amd64, java.runtime.version=13+33, source=flush, 
os.version=10.0, 
timestamp=1575115657354}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 2875552 INFO  (qtp1686184921-50770) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 
end_commit_flush
   [junit4]   2> 2875554 INFO  
(searcherExecutor-11797-thread-1-processing-n:127.0.0.1:50287_solr 
x:MissingSegmentRecoveryTest_shard1_replica_n1 c:MissingSegmentRecoveryTest 
s:shard1 r:core_node3) [n:127.0.0.1:50287_solr c:MissingSegmentRecoveryTest 
s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] 
o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n1] Registered new 
searcher Searcher@4503c27c[MissingSegmentRecoveryTest_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.4.0):C10:[diagnostics={os=Windows
 10, java.vendor=Oracle Corporation, java.version=13, java.vm.version=13+33, 
lucene.version=8.4.0, os.arch=amd64, java.runtime.version=13+33, source=flush, 
os.version=10.0, 
timestamp=1575115657354}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 2875554 INFO  (qtp1686184921-50770) [n:127.0.0.1:50287_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[MissingSegmentRecoveryTest_shard1_replica_n1]  webapp=/solr path=/update 
params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:50288/solr/MissingSegmentRecoveryTest_shard1_replica_n2/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=}
 0 106
   [junit4]   2> 2875555 INFO  (qtp1447869236-50775) [n:127.0.0.1:50288_solr 
c:MissingSegmentRecoveryTest s:shard1 r:core_node4 
x:MissingSegmentRecoveryTest_shard1_replica_n2 ] 
o.a.s.u.p.LogUpdateProcessorFactory 
[MissingSegmentRecoveryTest_shard1_replica_n2]  webapp=/solr path=/update 
params={_stateVer_=MissingSegmentRecoveryTest:6&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 110
   [junit4]   2> 2875561 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1589369044
   [junit4]   2> 2875561 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:50287_solr
   [junit4]   2> 2875563 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 2875563 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.ZkController Publish node=127.0.0.1:50287_solr as DOWN
   [junit4]   2> 2875566 INFO  (coreCloseExecutor-11806-thread-1) 
[n:127.0.0.1:50287_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrCore 
[MissingSegmentRecoveryTest_shard1_replica_n1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@61ad56bc
   [junit4]   2> 2875566 INFO  (coreCloseExecutor-11806-thread-1) 
[n:127.0.0.1:50287_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.core.MissingSegmentRecoveryTest.shard1.replica_n1, 
tag=SolrCore@61ad56bc
   [junit4]   2> 2875566 INFO  (coreCloseExecutor-11806-thread-1) 
[n:127.0.0.1:50287_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter 
Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@368a4d67: 
rootName = solr_50287, domain = 
solr.core.MissingSegmentRecoveryTest.shard1.replica_n1, service url = null, 
agent id = null] for registry 
solr.core.MissingSegmentRecoveryTest.shard1.replica_n1 / 
com.codahale.metrics.MetricRegistry@71634da0
   [junit4]   2> 2875575 INFO  (coreCloseExecutor-11806-thread-1) 
[n:127.0.0.1:50287_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 
x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.collection.MissingSegmentRecoveryTest.shard1.leader, 
tag=SolrCore@61ad56bc
   [junit4]   2> 2875594 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 2875594 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@76f34dfc: rootName = 
solr_50287, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@6b223d8b
   [junit4]   2> 2875602 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 2875602 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@64d9d898: rootName = 
solr_50287, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@610c02a1
   [junit4]   2> 2875605 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 2875605 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@44dc5932: rootName = 
solr_50287, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@210108a1
   [junit4]   2> 2875605 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 2875733 INFO  (zkCallback-16513-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 2875734 INFO  (zkCallback-16534-thread-1) [     ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 2875736 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.e.j.s.AbstractConnector Stopped ServerConnector@6e7948a9{ssl,[ssl, alpn, 
http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 2875748 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@59486292{/solr,null,UNAVAILABLE}
   [junit4]   2> 2875748 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 2875751 INFO  (zkCallback-16513-thread-3) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2875751 INFO  (zkCallback-16513-thread-2) [     ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/MissingSegmentRecoveryTest/state.json] for collection 
[MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2875754 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding 
port=50287)
   [junit4]   2> 2875757 WARN  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2875759 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 50287 try number 
1 ...
   [junit4]   2> 2875759 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; 
git: afcf563148970e98786327af5e07c261fda175d3; jvm 13+33
   [junit4]   2> 2875759 INFO  
(TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[E04714A784B16A6C]) [  
   ] o.e.j.s.session DefaultSessionId

[...truncated too long message...]

.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        14      
/solr/collections/MissingSegmentRecoveryTest/terms/shard1
   [junit4]   2>        4       /solr/aliases.json
   [junit4]   2>        3       /solr/packages.json
   [junit4]   2>        3       /solr/security.json
   [junit4]   2>        3       /solr/configs/conf
   [junit4]   2>        3       
/solr/collections/MissingSegmentRecoveryTest/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        39      
/solr/collections/MissingSegmentRecoveryTest/state.json
   [junit4]   2>        4       /solr/clusterstate.json
   [junit4]   2>        4       /solr/clusterprops.json
   [junit4]   2>        2       
/solr/overseer_elect/election/72079262497112070-127.0.0.1:50288_solr-n_0000000000
   [junit4]   2>        2       
/solr/collections/MissingSegmentRecoveryTest/leader_elect/shard1/election/72079262497112070-core_node4-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        27      /solr/overseer/queue
   [junit4]   2>        13      /solr/live_nodes
   [junit4]   2>        7       /solr/collections
   [junit4]   2>        4       /solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 2878384 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:50274
   [junit4]   2> 2878384 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:50274
   [junit4]   2> 2878384 INFO  
(SUITE-MissingSegmentRecoveryTest-seed#[E04714A784B16A6C]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 50274
   [junit4]   2> NOTE: leaving temporary files on disk at: 
C:\Users\jenkins\workspace\Lucene-Solr-8.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.MissingSegmentRecoveryTest_E04714A784B16A6C-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84), 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@24f60879),
 locale=nl-BQ, timezone=US/Central
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 13 
(64-bit)/cpus=3,threads=1,free=250472296,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: 
[ProtectedTermFilterFactoryTest, JavaBinAtomicUpdateMultivalueTest, 
SolrMetricsIntegrationTest, RequiredFieldsTest, TestFieldCache, 
TestJsonRequest, TestSolrIndexConfig, RequestHandlersTest, ZkFailoverTest, 
RestartWhileUpdatingTest, QueryParsingTest, TestFieldCollectionResource, 
MetricsHistoryHandlerTest, TestInfoStreamLogging, 
SimpleCollectionCreateDeleteTest, TestExportWriter, HttpTriggerListenerTest, 
TestSimpleQParserPlugin, MultiDestinationAuditLoggerTest, 
TestMaxScoreQueryParser, TestUtilizeNode, MergeStrategyTest, 
RequestLoggingTest, TestOmitPositions, TestValueSourceCache, TestSolrCachePerf, 
TestShortCircuitedRequests, TestSweetSpotSimilarityFactory, 
TestPostingsSolrHighlighter, IndexSizeEstimatorTest, TestCollectionAPI, 
XMLAtomicUpdateMultivalueTest, TestMergePolicyConfig, ReplaceNodeTest, 
TestDeprecatedFilters, ScriptEngineTest, ChangedSchemaMergeTest, TestUtils, 
TestRandomCollapseQParserPlugin, ShardRoutingTest, TestSolrCloudSnapshots, 
LeaderVoteWaitTimeoutTest, SolrCloudExampleTest, TestCSVResponseWriter, 
SolrMetricManagerTest, TestConfigSetsAPIZkFailure, TestHdfsCloudBackupRestore, 
GraphQueryTest, ClusterStateUpdateTest, TestDistributedMap, 
TestSimpleTextCodec, HdfsDirectoryFactoryTest, UtilsToolTest, 
SpellCheckComponentTest, TestUseDocValuesAsStored, TestPerFieldSimilarity, 
TestCloudPivotFacet, DistribDocExpirationUpdateProcessorTest, 
TestWithCollection, ChaosMonkeySafeLeaderTest, DocValuesNotIndexedTest, 
TestAnalyzedSuggestions, TestJsonFacetRefinement, MoveReplicaHDFSFailoverTest, 
TestPivotHelperCode, TestEmbeddedSolrServerSchemaAPI, 
TestChildDocTransformerHierarchy, SimpleMLTQParserTest, 
TestHdfsBackupRestoreCore, TermsComponentTest, ConfigureRecoveryStrategyTest, 
SimpleFacetsTest, TestInPlaceUpdatesDistrib, TestHashQParserPlugin, 
HighlighterMaxOffsetTest, TestWriterPerf, CoreAdminOperationTest, 
TestExportTool, ConnectionReuseTest, TestDocumentBuilder, 
UniqFieldsUpdateProcessorFactoryTest, DocValuesMultiTest, 
SystemInfoHandlerTest, CdcrOpsAndBoundariesTest, TestCloudRecovery, 
TestLegacyField, TestZkAclsWithHadoopAuth, JWTAuthPluginIntegrationTest, 
URLClassifyProcessorTest, TestFileDictionaryLookup, SliceStateTest, 
CollectionStateFormat2Test, SuggesterTSTTest, TestDFRSimilarityFactory, 
AuditLoggerPluginTest, DistributedFacetPivotLongTailTest, 
TestSerializedLuceneMatchVersion, BlockJoinFacetRandomTest, 
HdfsTlogReplayBufferedWhileIndexingTest, 
CategoryRoutedAliasUpdateProcessorTest, TestCursorMarkWithoutUniqueKey, 
TriggerEventQueueTest, TestNoOpRegenerator, LeaderElectionContextKeyTest, 
TestSchemaNameResource, TestCloudInspectUtil, ByteBuffersDirectoryFactoryTest, 
TestLegacyFieldCache, XmlUpdateRequestHandlerTest, 
TestJavabinTupleStreamParser, TestDeleteCollectionOnDownNodes, 
ShowFileRequestHandlerTest, TestFastLRUCache, TestSchemaSimilarityResource, 
FastVectorHighlighterTest, OverseerTest, TestSchemalessBufferedUpdates, 
TestXmlQParserPlugin, TestDynamicURP, TestFieldTypeCollectionResource, 
TestConfig, SolrCoreTest, TestJsonFacetsStatsParsing, TestStressLiveNodes, 
SuggesterWFSTTest, TestConfigSetsAPI, BlobRepositoryCloudTest, 
SearchHandlerTest, RulesTest, SolrLogAuditLoggerPluginTest, 
TestReversedWildcardFilterFactory, WrapperMergePolicyFactoryTest, HLLUtilTest, 
TestStressThreadBackup, TestRebalanceLeaders, TestPullReplicaErrorHandling, 
TlogReplayBufferedWhileIndexingTest, CdcrUpdateLogTest, RemoteQueryErrorTest, 
SplitShardTest, TestCloudJSONFacetJoinDomain, TestSSLRandomization, 
TestFilteredDocIdSet, SolrRequestParserTest, HdfsSyncSliceTest, 
ConcurrentCreateRoutedAliasTest, TestGeoJSONResponseWriter, 
TestComplexPhraseQParserPlugin, TestSubQueryTransformerDistrib, EnumFieldTest, 
AutoScalingHandlerTest, SuggestComponentContextFilterQueryTest, AssignTest, 
BasicDistributedZkTest, NodeMarkersRegistrationTest, 
LeaderFailureAfterFreshStartTest, TestSha256AuthenticationProvider, 
SortSpecParsingTest, TestReloadAndDeleteDocs, CurrencyFieldTypeTest, 
OverseerModifyCollectionTest, CreateRoutedAliasTest, CdcrRequestHandlerTest, 
CoreMergeIndexesAdminHandlerTest, TestLeaderElectionZkExpiry, 
TestPKIAuthenticationPlugin, MetricTriggerIntegrationTest, 
AtomicUpdateRemovalJavabinTest, DocExpirationUpdateProcessorFactoryTest, 
ScheduledTriggerTest, TestMissingGroups, TestExpandComponent, 
DateMathParserTest, TestSQLHandler, DistributedMLTComponentTest, 
SchemaVersionSpecificBehaviorTest, TestDynamicFieldCollectionResource, 
TestManagedSynonymGraphFilterFactory, PreAnalyzedFieldTest, NoCacheHeaderTest, 
CoreAdminCreateDiscoverTest, TestNamedUpdateProcessors, BitVectorTest, 
DistributedQueryComponentOptimizationTest, DistributedTermsComponentTest, 
ReturnFieldsTest, BasicAuthOnSingleNodeTest, TestSimComputePlanAction, 
CloneFieldUpdateProcessorFactoryTest, ParsingFieldUpdateProcessorsTest, 
TriggerSetPropertiesIntegrationTest, TestBulkSchemaAPI, CursorPagingTest, 
ForceLeaderWithTlogReplicasTest, TestNumericTerms64, 
DistributedDebugComponentTest, TestXIncludeConfig, EmbeddedSolrNoSerializeTest, 
ScheduledMaintenanceTriggerTest, ImplicitSnitchTest, 
TestSolrCloudWithKerberosAlt, TestCloudSearcherWarming, MoveReplicaTest, 
DirectUpdateHandlerTest, TestPushWriter, TestAtomicUpdateErrorCases, 
TestDocTermOrds, DateRangeFieldTest, SpellCheckCollatorWithCollapseTest, 
TestManagedSchemaAPI, TestDistributedTracing, TestCoreDiscovery, 
DistributedIntervalFacetingTest, TaggingAttributeTest, 
TestHalfAndHalfDocValues, TestSimLargeCluster, HdfsBasicDistributedZk2Test, 
TestReplicationHandlerBackup, AnalysisAfterCoreReloadTest, 
BasicFunctionalityTest, MinimalSchemaTest, OutputWriterTest, SampleTest, 
SolrInfoBeanTest, SolrTestCaseJ4Test, TestCrossCoreJoin, 
TestDistributedMissingSort, TestDistributedSearch, TestGroupingSearch, 
TestHighlightDedupGrouping, TestJoin, TestRandomDVFaceting, 
TestSimpleTrackingShardHandler, TestSolrCoreProperties, TestSolrTestCaseJ4, 
TestTolerantSearch, TestTrie, PathHierarchyTokenizerFactoryTest, 
TestCharFilters, TestLuceneMatchVersion, TokenizerChainTest, 
TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, 
ActionThrottleTest, AddReplicaTest, AliasIntegrationTest, 
AssignBackwardCompatibilityTest, BasicDistributedZk2Test, BasicZkTest, 
ChaosMonkeyNothingIsSafeTest, CloudExitableDirectoryReaderTest, 
ClusterStateTest, CollectionPropsTest, DeleteLastCustomShardedReplicaTest, 
DeleteReplicaTest, HealthCheckHandlerTest, HttpPartitionTest, 
MissingSegmentRecoveryTest]
   [junit4] Completed [496/887 (2!)] on J1 in 8.89s, 1 test, 1 error <<< 
FAILURES!

[...truncated 46192 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Windows/572/consoleText

[repro] Revision: ba95111d71cc4d24b5ab4e8c022a3cbde42fd283

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr\core
[repro]       MissingSegmentRecoveryTest
[repro]       ConfigureRecoveryStrategyTest
[repro] ant compile-test

[...truncated 3647 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 
-Dtests.class="*.MissingSegmentRecoveryTest|*.ConfigureRecoveryStrategyTest" 
-Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" 
-Dtests.seed=E04714A784B16A6C -Dtests.slow=true -Dtests.locale=nl-BQ 
-Dtests.timezone=US/Central -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[...truncated 98 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.MissingSegmentRecoveryTest
[repro]   0/5 failed: org.apache.solr.core.ConfigureRecoveryStrategyTest
[repro] Exiting with code 0

[...truncated 78 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to