The BasicAuthIntegrationTest failures seem to be due to SOLR-13545
(FYI, Mikhail).

On Tue, Jul 23, 2019 at 12:15 PM Noble Paul <[email protected]> wrote:
>
> I'm looking into the failures
>
> On Tue, Jul 23, 2019 at 9:21 AM Apache Jenkins Server
> <[email protected]> wrote:
> >
> > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-8.x/158/
> >
> > 4 tests failed.
> > FAILED:  
> > org.apache.solr.cloud.cdcr.CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
> >
> > Error Message:
> > Timeout while trying to assert number of documents @ source_collection
> >
> > Stack Trace:
> > java.lang.AssertionError: Timeout while trying to assert number of 
> > documents @ source_collection
> >         at 
> > __randomizedtesting.SeedInfo.seed([4C51580235DFBD67:9F58081C704C21F0]:0)
> >         at 
> > org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:277)
> >         at 
> > org.apache.solr.cloud.cdcr.CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates(CdcrReplicationHandlerTest.java:233)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at 
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at 
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
> >         at 
> > org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
> >         at 
> > org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at java.lang.Thread.run(Thread.java:748)
> > Caused by: java.lang.AssertionError: expected:<260> but was:<270>
> >         at org.junit.Assert.fail(Assert.java:88)
> >         at org.junit.Assert.failNotEquals(Assert.java:834)
> >         at org.junit.Assert.assertEquals(Assert.java:645)
> >         at org.junit.Assert.assertEquals(Assert.java:631)
> >         at 
> > org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:268)
> >         ... 42 more
> >
> >
> > FAILED:  
> > org.apache.solr.handler.TestContainerReqHandler.testRuntimeLibWithSig2048
> >
> > Error Message:
> > No live SolrServers available to handle this 
> > request:[http://127.0.0.1:43123/solr]
> >
> > Stack Trace:
> > org.apache.solr.client.solrj.SolrServerException: No live SolrServers 
> > available to handle this request:[http://127.0.0.1:43123/solr]
> >         at 
> > __randomizedtesting.SeedInfo.seed([4C51580235DFBD67:913C7BAA956B2706]:0)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
> >         at 
> > org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
> >         at 
> > org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
> >         at 
> > org.apache.solr.handler.TestContainerReqHandler.testRuntimeLibWithSig2048(TestContainerReqHandler.java:309)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at 
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at 
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at java.lang.Thread.run(Thread.java:748)
> > Caused by: 
> > org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
> > from server at http://127.0.0.1:43123/solr: Expected mime type 
> > application/octet-stream but got text/html. <html>
> > <head>
> > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
> > <title>Error 500 Server Error</title>
> > </head>
> > <body><h2>HTTP ERROR 500</h2>
> > <p>Problem accessing /solr/____v2/cluster. Reason:
> > <pre>    Server Error</pre></p><h3>Caused 
> > by:</h3><pre>java.lang.UnsupportedClassVersionError: 
> > org/apache/solr/core/RuntimeLibReqHandler has been compiled by a more 
> > recent version of the Java Runtime (class file version 55.0), this version 
> > of the Java Runtime only recognizes class file versions up to 52.0
> >         at java.lang.ClassLoader.defineClass1(Native Method)
> >         at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> >         at 
> > org.apache.solr.core.MemClassLoader.loadFromRuntimeLibs(MemClassLoader.java:127)
> >         at 
> > org.apache.solr.core.MemClassLoader.findClass(MemClassLoader.java:100)
> >         at 
> > org.apache.solr.core.MemClassLoader.findClass(MemClassLoader.java:181)
> >         at org.apache.solr.core.LibListener.newInstance(LibListener.java:79)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.lambda$updateReqHandlers$3(LibListener.java:232)
> >         at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.updateReqHandlers(LibListener.java:228)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.access$000(LibListener.java:173)
> >         at org.apache.solr.core.LibListener.onChange(LibListener.java:105)
> >         at 
> > org.apache.solr.handler.admin.CollectionHandlerApi.lambda$wrap$0(CollectionHandlerApi.java:120)
> >         at 
> > org.apache.solr.handler.admin.CollectionHandlerApi$2.invoke(CollectionHandlerApi.java:305)
> >         at 
> > org.apache.solr.handler.admin.BaseHandlerApiSupport$1.call(BaseHandlerApiSupport.java:100)
> >         at org.apache.solr.api.V2HttpCall.handleAdmin(V2HttpCall.java:341)
> >         at 
> > org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:786)
> >         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:546)
> >         at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:423)
> >         at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:350)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
> >         at 
> > org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:165)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
> >         at 
> > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
> >         at 
> > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
> >         at 
> > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
> >         at 
> > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
> >         at 
> > org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
> >         at 
> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
> >         at org.eclipse.jetty.server.Server.handle(Server.java:505)
> >         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
> >         at 
> > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
> >         at 
> > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
> >         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
> >         at 
> > org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
> >         at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
> >         at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
> >         at java.lang.Thread.run(Thread.java:748)
> > </pre>
> > <hr><a href="http://eclipse.org/jetty";>Powered by Jetty:// 
> > 9.4.19.v20190610</a><hr/>
> >
> > </body>
> > </html>
> >
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:620)
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
> >         ... 45 more
> >
> >
> > FAILED:  
> > org.apache.solr.handler.TestContainerReqHandler.testRuntimeLibWithSig512
> >
> > Error Message:
> > No live SolrServers available to handle this 
> > request:[http://127.0.0.1:42667/solr]
> >
> > Stack Trace:
> > org.apache.solr.client.solrj.SolrServerException: No live SolrServers 
> > available to handle this request:[http://127.0.0.1:42667/solr]
> >         at 
> > __randomizedtesting.SeedInfo.seed([4C51580235DFBD67:B340BB3A432558A5]:0)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
> >         at 
> > org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
> >         at 
> > org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
> >         at 
> > org.apache.solr.handler.TestContainerReqHandler.testRuntimeLibWithSig512(TestContainerReqHandler.java:386)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at 
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at 
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at java.lang.Thread.run(Thread.java:748)
> > Caused by: 
> > org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
> > from server at http://127.0.0.1:42667/solr: Expected mime type 
> > application/octet-stream but got text/html. <html>
> > <head>
> > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
> > <title>Error 500 Server Error</title>
> > </head>
> > <body><h2>HTTP ERROR 500</h2>
> > <p>Problem accessing /solr/____v2/cluster. Reason:
> > <pre>    Server Error</pre></p><h3>Caused 
> > by:</h3><pre>java.lang.UnsupportedClassVersionError: 
> > org/apache/solr/core/RuntimeLibReqHandler has been compiled by a more 
> > recent version of the Java Runtime (class file version 55.0), this version 
> > of the Java Runtime only recognizes class file versions up to 52.0
> >         at java.lang.ClassLoader.defineClass1(Native Method)
> >         at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> >         at 
> > org.apache.solr.core.MemClassLoader.loadFromRuntimeLibs(MemClassLoader.java:127)
> >         at 
> > org.apache.solr.core.MemClassLoader.findClass(MemClassLoader.java:100)
> >         at 
> > org.apache.solr.core.MemClassLoader.findClass(MemClassLoader.java:181)
> >         at org.apache.solr.core.LibListener.newInstance(LibListener.java:79)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.lambda$updateReqHandlers$3(LibListener.java:232)
> >         at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.updateReqHandlers(LibListener.java:228)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.access$000(LibListener.java:173)
> >         at org.apache.solr.core.LibListener.onChange(LibListener.java:105)
> >         at 
> > org.apache.solr.handler.admin.CollectionHandlerApi.lambda$wrap$0(CollectionHandlerApi.java:120)
> >         at 
> > org.apache.solr.handler.admin.CollectionHandlerApi$2.invoke(CollectionHandlerApi.java:305)
> >         at 
> > org.apache.solr.handler.admin.BaseHandlerApiSupport$1.call(BaseHandlerApiSupport.java:100)
> >         at org.apache.solr.api.V2HttpCall.handleAdmin(V2HttpCall.java:341)
> >         at 
> > org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:786)
> >         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:546)
> >         at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:423)
> >         at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:350)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
> >         at 
> > org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:165)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
> >         at 
> > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
> >         at 
> > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
> >         at 
> > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
> >         at 
> > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
> >         at 
> > org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
> >         at 
> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
> >         at org.eclipse.jetty.server.Server.handle(Server.java:505)
> >         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
> >         at 
> > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
> >         at 
> > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
> >         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
> >         at 
> > org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
> >         at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
> >         at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
> >         at java.lang.Thread.run(Thread.java:748)
> > </pre>
> > <hr><a href="http://eclipse.org/jetty";>Powered by Jetty:// 
> > 9.4.19.v20190610</a><hr/>
> >
> > </body>
> > </html>
> >
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:620)
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
> >         ... 45 more
> >
> >
> > FAILED:  org.apache.solr.handler.TestContainerReqHandler.testRuntimeLib
> >
> > Error Message:
> > No live SolrServers available to handle this 
> > request:[http://127.0.0.1:44027/solr]
> >
> > Stack Trace:
> > org.apache.solr.client.solrj.SolrServerException: No live SolrServers 
> > available to handle this request:[http://127.0.0.1:44027/solr]
> >         at 
> > __randomizedtesting.SeedInfo.seed([4C51580235DFBD67:7FF6CC56C64F4CD3]:0)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1128)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897)
> >         at 
> > org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829)
> >         at 
> > org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
> >         at 
> > org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228)
> >         at 
> > org.apache.solr.handler.TestContainerReqHandler.testRuntimeLib(TestContainerReqHandler.java:201)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at 
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at 
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
> >         at 
> > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> >         at 
> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> >         at 
> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >         at 
> > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> >         at 
> > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at 
> > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
> >         at java.lang.Thread.run(Thread.java:748)
> > Caused by: 
> > org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
> > from server at http://127.0.0.1:44027/solr: Expected mime type 
> > application/octet-stream but got text/html. <html>
> > <head>
> > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
> > <title>Error 500 Server Error</title>
> > </head>
> > <body><h2>HTTP ERROR 500</h2>
> > <p>Problem accessing /solr/____v2/cluster. Reason:
> > <pre>    Server Error</pre></p><h3>Caused 
> > by:</h3><pre>java.lang.UnsupportedClassVersionError: 
> > org/apache/solr/core/RuntimeLibReqHandler has been compiled by a more 
> > recent version of the Java Runtime (class file version 55.0), this version 
> > of the Java Runtime only recognizes class file versions up to 52.0
> >         at java.lang.ClassLoader.defineClass1(Native Method)
> >         at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> >         at 
> > org.apache.solr.core.MemClassLoader.loadFromRuntimeLibs(MemClassLoader.java:127)
> >         at 
> > org.apache.solr.core.MemClassLoader.findClass(MemClassLoader.java:100)
> >         at 
> > org.apache.solr.core.MemClassLoader.findClass(MemClassLoader.java:181)
> >         at org.apache.solr.core.LibListener.newInstance(LibListener.java:79)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.lambda$updateReqHandlers$3(LibListener.java:232)
> >         at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.updateReqHandlers(LibListener.java:228)
> >         at 
> > org.apache.solr.core.LibListener$ExtHandler.access$000(LibListener.java:173)
> >         at org.apache.solr.core.LibListener.onChange(LibListener.java:105)
> >         at 
> > org.apache.solr.handler.admin.CollectionHandlerApi.lambda$wrap$0(CollectionHandlerApi.java:120)
> >         at 
> > org.apache.solr.handler.admin.CollectionHandlerApi$2.invoke(CollectionHandlerApi.java:305)
> >         at 
> > org.apache.solr.handler.admin.BaseHandlerApiSupport$1.call(BaseHandlerApiSupport.java:100)
> >         at org.apache.solr.api.V2HttpCall.handleAdmin(V2HttpCall.java:341)
> >         at 
> > org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:786)
> >         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:546)
> >         at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:423)
> >         at 
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:350)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
> >         at 
> > org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:165)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
> >         at 
> > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
> >         at 
> > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
> >         at 
> > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
> >         at 
> > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
> >         at 
> > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
> >         at 
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
> >         at 
> > org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
> >         at 
> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
> >         at org.eclipse.jetty.server.Server.handle(Server.java:505)
> >         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
> >         at 
> > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
> >         at 
> > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
> >         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
> >         at 
> > org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
> >         at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
> >         at 
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
> >         at java.lang.Thread.run(Thread.java:748)
> > </pre>
> > <hr><a href="http://eclipse.org/jetty";>Powered by Jetty:// 
> > 9.4.19.v20190610</a><hr/>
> >
> > </body>
> > </html>
> >
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:620)
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
> >         at 
> > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
> >         at 
> > org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
> >         ... 45 more
> >
> >
> >
> >
> > Build Log:
> > [...truncated 14037 lines...]
> >    [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrReplicationHandlerTest
> >    [junit4]   2> Creating dataDir: 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/init-core-data-001
> >    [junit4]   2> 476715 WARN  
> > (SUITE-CdcrReplicationHandlerTest-seed#[4C51580235DFBD67]-worker) [     ] 
> > o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=36 numCloses=36
> >    [junit4]   2> 476715 INFO  
> > (SUITE-CdcrReplicationHandlerTest-seed#[4C51580235DFBD67]-worker) [     ] 
> > o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
> > w/NUMERIC_DOCVALUES_SYSPROP=true
> >    [junit4]   2> 476717 INFO  
> > (SUITE-CdcrReplicationHandlerTest-seed#[4C51580235DFBD67]-worker) [     ] 
> > o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
> > @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, 
> > clientAuth=NaN)
> >    [junit4]   2> 476717 INFO  
> > (SUITE-CdcrReplicationHandlerTest-seed#[4C51580235DFBD67]-worker) [     ] 
> > o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
> > test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
> >    [junit4]   2> 476717 INFO  
> > (SUITE-CdcrReplicationHandlerTest-seed#[4C51580235DFBD67]-worker) [     ] 
> > o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: 
> > /jsq/o
> >    [junit4]   2> 476752 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
> >    [junit4]   2> 476752 INFO  (ZkTestServer Run Thread) [     ] 
> > o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
> >    [junit4]   2> 476753 INFO  (ZkTestServer Run Thread) [     ] 
> > o.a.s.c.ZkTestServer Starting server
> >    [junit4]   2> 476856 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer start zk server on port:38122
> >    [junit4]   2> 476856 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38122
> >    [junit4]   2> 476856 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 38122
> >    [junit4]   2> 476858 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 476860 INFO  (zkConnectionManagerCallback-3057-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 476860 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 476906 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 476907 INFO  (zkConnectionManagerCallback-3059-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 476907 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 476917 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml
> >  to /configs/conf1/solrconfig.xml
> >    [junit4]   2> 476918 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema15.xml
> >  to /configs/conf1/schema.xml
> >    [junit4]   2> 476919 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> >  to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> >    [junit4]   2> 476920 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> >  to /configs/conf1/stopwords.txt
> >    [junit4]   2> 476921 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> >  to /configs/conf1/protwords.txt
> >    [junit4]   2> 476922 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml
> >  to /configs/conf1/currency.xml
> >    [junit4]   2> 476923 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> >  to /configs/conf1/enumsConfig.xml
> >    [junit4]   2> 476924 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> >  to /configs/conf1/open-exchange-rates.json
> >    [junit4]   2> 476924 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> >  to /configs/conf1/mapping-ISOLatin1Accent.txt
> >    [junit4]   2> 476934 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> >  to /configs/conf1/old_synonyms.txt
> >    [junit4]   2> 476934 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkTestServer put 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> >  to /configs/conf1/synonyms.txt
> >    [junit4]   2> 476936 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.SolrTestCaseJ4 ###Starting 
> > testPartialReplicationAfterPeerSync
> >    [junit4]   2> 477348 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger 
> > time
> >    [junit4]   2> 477348 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured 
> > port=0)
> >    [junit4]   2> 477348 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try 
> > number 1 ...
> >    [junit4]   2> 477348 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 
> > 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; 
> > jvm 1.8.0_191-b12
> >    [junit4]   2> 477349 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
> >    [junit4]   2> 477349 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.session No SessionScavenger set, using defaults
> >    [junit4]   2> 477349 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.session node0 Scavenging every 600000ms
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.h.ContextHandler Started 
> > o.e.j.s.ServletContextHandler@7076909b{/jsq/o,null,AVAILABLE}
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.AbstractConnector Started 
> > ServerConnector@2cff6ac4{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:39587}
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.Server Started @477424ms
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, 
> > hostContext=/jsq/o, hostPort=39587, 
> > coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-001/cores}
> >    [junit4]   2> 477363 ERROR 
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. 
> > Logging may be missing or incomplete.
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter Using logger factory 
> > org.apache.logging.slf4j.Log4jLoggerFactory
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache 
> > Solr? version 8.3.0
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud 
> > mode on port null
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
> >    [junit4]   2> 477363 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
> > 2019-07-23T10:28:36.125Z
> >    [junit4]   2> 477364 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 477365 INFO  (zkConnectionManagerCallback-3061-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 477366 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 477472 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not 
> > found in ZooKeeper)
> >    [junit4]   2> 477472 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig Loading container configuration from 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-001/solr.xml
> >    [junit4]   2> 477476 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig Configuration parameter 
> > autoReplicaFailoverWorkLoopDelay is ignored
> >    [junit4]   2> 477476 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig Configuration parameter 
> > autoReplicaFailoverBadNodeExpiration is ignored
> >    [junit4]   2> 477477 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig MBean server found: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb, but no JMX reporters were 
> > configured - adding default JMX reporter.
> >    [junit4]   2> 477828 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
> > WhitelistHostChecker [whitelistHosts=null, 
> > whitelistHostCheckingEnabled=false]
> >    [junit4]   2> 477864 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config Trusting all certificates configured for 
> > Client@74bd0240[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 477864 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm 
> > configured for Client@74bd0240[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 477905 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config Trusting all certificates configured for 
> > Client@7dc196a8[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 477905 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm 
> > configured for Client@7dc196a8[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 477906 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38122/solr
> >    [junit4]   2> 477921 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 478022 INFO  (zkConnectionManagerCallback-3068-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 478030 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 478150 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.c.ConnectionManager Waiting for 
> > client to connect to ZooKeeper
> >    [junit4]   2> 478151 INFO  (zkConnectionManagerCallback-3070-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 478151 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.c.ConnectionManager Client is 
> > connected to ZooKeeper
> >    [junit4]   2> 478352 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.OverseerElectionContext I am 
> > going to be the leader 127.0.0.1:39587_jsq%2Fo
> >    [junit4]   2> 478353 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.Overseer Overseer 
> > (id=75086347910709252-127.0.0.1:39587_jsq%2Fo-n_0000000000) starting
> >    [junit4]   2> 478379 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.c.ConnectionManager Waiting for 
> > client to connect to ZooKeeper
> >    [junit4]   2> 478379 INFO  (zkConnectionManagerCallback-3077-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 478379 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.c.ConnectionManager Client is 
> > connected to ZooKeeper
> >    [junit4]   2> 478381 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.s.i.ZkClientClusterStateProvider 
> > Cluster at 127.0.0.1:38122/solr ready
> >    [junit4]   2> 478391 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.ZkController Register node as 
> > live in ZooKeeper:/live_nodes/127.0.0.1:39587_jsq%2Fo
> >    [junit4]   2> 478391 INFO  
> > (OverseerStateUpdate-75086347910709252-127.0.0.1:39587_jsq%2Fo-n_0000000000)
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.Overseer Starting to work on the 
> > main queue : 127.0.0.1:39587_jsq%2Fo
> >    [junit4]   2> 478406 INFO  (zkCallback-3069-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
> >    [junit4]   2> 478419 INFO  (zkCallback-3076-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
> >    [junit4]   2> 478420 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.LibListener clusterprops.json 
> > changed , version 0
> >    [junit4]   2> 478512 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.h.a.MetricsHistoryHandler No 
> > .system collection, keeping metrics history in memory.
> >    [junit4]   2> 481296 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.m.r.SolrJmxReporter JMX monitoring 
> > for 'solr.node' (registry 'solr.node') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 481333 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.m.r.SolrJmxReporter JMX monitoring 
> > for 'solr.jvm' (registry 'solr.jvm') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 481333 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.m.r.SolrJmxReporter JMX monitoring 
> > for 'solr.jetty' (registry 'solr.jetty') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 481334 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.CorePropertiesLocator Found 0 
> > core definitions underneath 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-001/cores
> >    [junit4]   2> 481861 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger 
> > time
> >    [junit4]   2> 481862 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured 
> > port=0)
> >    [junit4]   2> 481862 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try 
> > number 1 ...
> >    [junit4]   2> 481862 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.Server jetty-9.4.19.v20190610; built: 
> > 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; 
> > jvm 1.8.0_191-b12
> >    [junit4]   2> 481888 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
> >    [junit4]   2> 481888 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.session No SessionScavenger set, using defaults
> >    [junit4]   2> 481888 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.session node0 Scavenging every 660000ms
> >    [junit4]   2> 481888 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.h.ContextHandler Started 
> > o.e.j.s.ServletContextHandler@6144426c{/jsq/o,null,AVAILABLE}
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.AbstractConnector Started 
> > ServerConnector@c77cd5{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:45009}
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.s.Server Started @481950ms
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, 
> > hostContext=/jsq/o, hostPort=45009, 
> > coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-002/cores}
> >    [junit4]   2> 481889 ERROR 
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. 
> > Logging may be missing or incomplete.
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter Using logger factory 
> > org.apache.logging.slf4j.Log4jLoggerFactory
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache 
> > Solr? version 8.3.0
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud 
> > mode on port null
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
> >    [junit4]   2> 481889 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
> > 2019-07-23T10:28:40.651Z
> >    [junit4]   2> 481903 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 481904 INFO  (zkConnectionManagerCallback-3080-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 481904 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 482006 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not 
> > found in ZooKeeper)
> >    [junit4]   2> 482006 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig Loading container configuration from 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-002/solr.xml
> >    [junit4]   2> 482010 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig Configuration parameter 
> > autoReplicaFailoverWorkLoopDelay is ignored
> >    [junit4]   2> 482010 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig Configuration parameter 
> > autoReplicaFailoverBadNodeExpiration is ignored
> >    [junit4]   2> 482011 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.SolrXmlConfig MBean server found: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb, but no JMX reporters were 
> > configured - adding default JMX reporter.
> >    [junit4]   2> 482520 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
> > WhitelistHostChecker [whitelistHosts=null, 
> > whitelistHostCheckingEnabled=false]
> >    [junit4]   2> 482521 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config Trusting all certificates configured for 
> > Client@6a79aa43[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 482521 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm 
> > configured for Client@6a79aa43[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 482541 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config Trusting all certificates configured for 
> > Client@63758dd2[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 482541 WARN  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm 
> > configured for Client@63758dd2[provider=null,keyStore=null,trustStore=null]
> >    [junit4]   2> 482541 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38122/solr
> >    [junit4]   2> 482542 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 482543 INFO  (zkConnectionManagerCallback-3087-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 482551 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 482655 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 482656 INFO  (zkConnectionManagerCallback-3089-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 482656 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 482677 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) 
> > -> (1)
> >    [junit4]   2> 482685 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkController Publish node=127.0.0.1:45009_jsq%2Fo as DOWN
> >    [junit4]   2> 482702 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache 
> > for 4 transient cores
> >    [junit4]   2> 482702 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.ZkController Register node as live in 
> > ZooKeeper:/live_nodes/127.0.0.1:45009_jsq%2Fo
> >    [junit4]   2> 482704 INFO  (zkCallback-3076-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
> >    [junit4]   2> 482704 INFO  (zkCallback-3069-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
> >    [junit4]   2> 482704 INFO  (zkCallback-3088-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
> >    [junit4]   2> 482713 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 482722 INFO  (zkConnectionManagerCallback-3096-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 482722 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 482723 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) 
> > -> (2)
> >    [junit4]   2> 482724 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
> > 127.0.0.1:38122/solr ready
> >    [junit4]   2> 482725 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.LibListener clusterprops.json changed , version 0
> >    [junit4]   2> 482783 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping 
> > metrics history in memory.
> >    [junit4]   2> 482832 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 
> > 'solr.node') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 482850 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 
> > 'solr.jvm') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 482850 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' 
> > (registry 'solr.jetty') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 482872 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-002/cores
> >    [junit4]   2> 482968 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to 
> > ZooKeeper
> >    [junit4]   2> 482970 INFO  (zkConnectionManagerCallback-3102-thread-1) [ 
> >     ] o.a.s.c.c.ConnectionManager zkClient has connected
> >    [junit4]   2> 482970 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
> >    [junit4]   2> 482971 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) 
> > -> (2)
> >    [junit4]   2> 482972 INFO  
> > (TEST-CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync-seed#[4C51580235DFBD67])
> >  [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
> > 127.0.0.1:38122/solr ready
> >    [junit4]   2> 482974 INFO  (qtp1169878413-7685) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.h.a.CollectionsHandler Invoked 
> > Collection Action :create with params 
> > collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2
> >  and sendToOCPQueue=true
> >    [junit4]   2> 482985 INFO  
> > (OverseerThreadFactory-2012-thread-1-processing-n:127.0.0.1:39587_jsq%2Fo) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.a.c.CreateCollectionCmd Create 
> > collection tmp_collection
> >    [junit4]   2> 483089 WARN  
> > (OverseerThreadFactory-2012-thread-1-processing-n:127.0.0.1:39587_jsq%2Fo) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.a.c.CreateCollectionCmd It is 
> > unusual to create a collection (tmp_collection) without cores.
> >    [junit4]   2> 483091 INFO  (qtp1169878413-7685) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.h.a.CollectionsHandler Wait for new 
> > collection to be active for at most 45 seconds. Check all shard replicas
> >    [junit4]   2> 483092 INFO  (qtp1169878413-7685) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.s.HttpSolrCall [admin] webapp=null 
> > path=/admin/collections 
> > params={collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2}
> >  status=0 QTime=118
> >    [junit4]   2> 483094 INFO  (qtp1169878413-7686) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.h.a.CollectionsHandler Invoked 
> > Collection Action :addreplica with params 
> > node=127.0.0.1:39587_jsq%252Fo&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2
> >  and sendToOCPQueue=true
> >    [junit4]   2> 483097 INFO  
> > (OverseerCollectionConfigSetProcessor-75086347910709252-127.0.0.1:39587_jsq%2Fo-n_0000000000)
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.OverseerTaskQueue Response ZK 
> > path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  
> > Requestor may have disconnected from ZooKeeper
> >    [junit4]   2> 483098 INFO  
> > (OverseerThreadFactory-2012-thread-2-processing-n:127.0.0.1:39587_jsq%2Fo) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1   ] 
> > o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:39587_jsq%2Fo for 
> > creating new replica of shard shard1 for collection tmp_collection
> >    [junit4]   2> 483123 INFO  
> > (OverseerThreadFactory-2012-thread-2-processing-n:127.0.0.1:39587_jsq%2Fo) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1   ] 
> > o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
> >    [junit4]   2> 483158 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo    x:tmp_collection_shard1_replica_n1 ] 
> > o.a.s.h.a.CoreAdminOperation core create command 
> > qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n1&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
> >    [junit4]   2> 483158 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo    x:tmp_collection_shard1_replica_n1 ] 
> > o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 
> > transient cores
> >    [junit4]   2> 484286 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene 
> > MatchVersion: 8.3.0
> >    [junit4]   2> 484381 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema 
> > [tmp_collection_shard1_replica_n1] Schema name=test
> >    [junit4]   2> 484772 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema 
> > test/1.6 with uniqueid field id
> >    [junit4]   2> 485312 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating 
> > SolrCore 'tmp_collection_shard1_replica_n1' using configuration from 
> > collection tmp_collection, trusted=true
> >    [junit4]   2> 485312 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX 
> > monitoring for 'solr.core.tmp_collection.shard1.replica_n1' (registry 
> > 'solr.core.tmp_collection.shard1.replica_n1') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 485350 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SolrCore 
> > [[tmp_collection_shard1_replica_n1] ] Opening new SolrCore at 
> > [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-001/cores/tmp_collection_shard1_replica_n1],
> >  
> > dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-001/cores/tmp_collection_shard1_replica_n1/data/]
> >    [junit4]   2> 485385 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy 
> > RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: 
> > [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, 
> > maxMergeSize=9223372036854775807, 
> > maxMergeSizeForForcedMerge=9223372036854775807, 
> > calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
> > maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
> >    [junit4]   2> 485821 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog 
> > implementation: org.apache.solr.update.CdcrUpdateLog
> >    [junit4]   2> 485821 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing 
> > UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
> > maxNumLogsToKeep=10 numVersionBuckets=65536
> >    [junit4]   2> 485822 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: 
> > disabled
> >    [junit4]   2> 485822 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: 
> > disabled
> >    [junit4]   2> 485823 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy 
> > RandomMergePolicy wrapping class 
> > org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
> > minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, 
> > maxMergeSizeForForcedMerge=9223372036854775807, 
> > calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
> > maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> >    [junit4]   2> 485824 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening 
> > [Searcher@603d60b5[tmp_collection_shard1_replica_n1] main]
> >    [junit4]   2> 485834 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage 
> > Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
> >    [junit4]   2> 485834 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded 
> > null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> >    [junit4]   2> 485834 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits 
> > will be reserved for 10000ms.
> >    [junit4]   2> 485850 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.h.CdcrBufferStateManager Created 
> > znode /collections/tmp_collection/cdcr/state/buffer
> >    [junit4]   2> 485863 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.h.CdcrProcessStateManager 
> > Created znode /collections/tmp_collection/cdcr/state/process
> >    [junit4]   2> 485893 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max 
> > version in index or recent updates, using new clock 1639844649007841280
> >    [junit4]   2> 485896 INFO  
> > (searcherExecutor-2026-thread-1-processing-n:127.0.0.1:39587_jsq%2Fo 
> > x:tmp_collection_shard1_replica_n1 c:tmp_collection s:shard1) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SolrCore 
> > [tmp_collection_shard1_replica_n1] Registered new searcher 
> > Searcher@603d60b5[tmp_collection_shard1_replica_n1] 
> > main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> >    [junit4]   2> 485907 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update 
> > of terms at /collections/tmp_collection/terms/shard1 to 
> > Terms{values={core_node2=0}, version=0}
> >    [junit4]   2> 485907 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase 
> > make sure parent is created /collections/tmp_collection/leaders/shard1
> >    [junit4]   2> 485910 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext 
> > Enough replicas found to continue.
> >    [junit4]   2> 485910 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I 
> > may be the new leader - try and sync
> >    [junit4]   2> 485910 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to 
> > http://127.0.0.1:39587/jsq/o/tmp_collection_shard1_replica_n1/
> >    [junit4]   2> 485910 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - 
> > now sync replicas to me
> >    [junit4]   2> 485910 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy 
> > http://127.0.0.1:39587/jsq/o/tmp_collection_shard1_replica_n1/ has no 
> > replicas
> >    [junit4]   2> 485910 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase 
> > Creating leader registration node 
> > /collections/tmp_collection/leaders/shard1/leader after winning as 
> > /collections/tmp_collection/leader_elect/shard1/election/75086347910709252-core_node2-n_0000000000
> >    [junit4]   2> 485911 INFO  (zkCallback-3069-thread-1) [     ] 
> > o.a.s.h.CdcrLeaderStateManager Received new leader state @ 
> > tmp_collection:shard1
> >    [junit4]   2> 485913 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I 
> > am the new leader: 
> > http://127.0.0.1:39587/jsq/o/tmp_collection_shard1_replica_n1/ shard1
> >    [junit4]   2> 485922 INFO  (zkCallback-3069-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
> > state:SyncConnected type:NodeDataChanged 
> > path:/collections/tmp_collection/state.json] for collection 
> > [tmp_collection] has occurred - updating... (live nodes size: [2])
> >    [junit4]   2> 485922 INFO  (zkCallback-3069-thread-2) [     ] 
> > o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
> > state:SyncConnected type:NodeDataChanged 
> > path:/collections/tmp_collection/state.json] for collection 
> > [tmp_collection] has occurred - updating... (live nodes size: [2])
> >    [junit4]   2> 485923 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, 
> > no recovery necessary
> >    [junit4]   2> 485939 INFO  (qtp1169878413-7684) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] 
> > webapp=null path=/admin/cores 
> > params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n1&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
> >  status=0 QTime=2781
> >    [junit4]   2> 485955 INFO  (qtp1169878413-7686) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection    ] o.a.s.s.HttpSolrCall 
> > [admin] webapp=null path=/admin/collections 
> > params={node=127.0.0.1:39587_jsq%252Fo&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2}
> >  status=0 QTime=2861
> >    [junit4]   2> 485956 INFO  (qtp1169878413-7685) 
> > [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.h.a.CollectionsHandler Invoked 
> > Collection Action :addreplica with params 
> > node=127.0.0.1:45009_jsq%252Fo&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2
> >  and sendToOCPQueue=true
> >    [junit4]   2> 485958 INFO  
> > (OverseerCollectionConfigSetProcessor-75086347910709252-127.0.0.1:39587_jsq%2Fo-n_0000000000)
> >  [n:127.0.0.1:39587_jsq%2Fo     ] o.a.s.c.OverseerTaskQueue Response ZK 
> > path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  
> > Requestor may have disconnected from ZooKeeper
> >    [junit4]   2> 485987 INFO  
> > (OverseerThreadFactory-2012-thread-3-processing-n:127.0.0.1:39587_jsq%2Fo) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1   ] 
> > o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:45009_jsq%2Fo for 
> > creating new replica of shard shard1 for collection tmp_collection
> >    [junit4]   2> 485988 INFO  
> > (OverseerThreadFactory-2012-thread-3-processing-n:127.0.0.1:39587_jsq%2Fo) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1   ] 
> > o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
> >    [junit4]   2> 486000 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo    x:tmp_collection_shard1_replica_n3 ] 
> > o.a.s.h.a.CoreAdminOperation core create command 
> > qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n3&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
> >    [junit4]   2> 486105 INFO  (zkCallback-3069-thread-3) [     ] 
> > o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
> > state:SyncConnected type:NodeDataChanged 
> > path:/collections/tmp_collection/state.json] for collection 
> > [tmp_collection] has occurred - updating... (live nodes size: [2])
> >    [junit4]   2> 486105 INFO  (zkCallback-3069-thread-1) [     ] 
> > o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
> > state:SyncConnected type:NodeDataChanged 
> > path:/collections/tmp_collection/state.json] for collection 
> > [tmp_collection] has occurred - updating... (live nodes size: [2])
> >    [junit4]   2> 486105 INFO  (zkCallback-3069-thread-2) [     ] 
> > o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
> > state:SyncConnected type:NodeDataChanged 
> > path:/collections/tmp_collection/state.json] for collection 
> > [tmp_collection] has occurred - updating... (live nodes size: [2])
> >    [junit4]   2> 487025 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.SolrConfig Using Lucene 
> > MatchVersion: 8.3.0
> >    [junit4]   2> 487156 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.s.IndexSchema 
> > [tmp_collection_shard1_replica_n3] Schema name=test
> >    [junit4]   2> 487418 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.s.IndexSchema Loaded schema 
> > test/1.6 with uniqueid field id
> >    [junit4]   2> 487653 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.CoreContainer Creating 
> > SolrCore 'tmp_collection_shard1_replica_n3' using configuration from 
> > collection tmp_collection, trusted=true
> >    [junit4]   2> 487653 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.m.r.SolrJmxReporter JMX 
> > monitoring for 'solr.core.tmp_collection.shard1.replica_n3' (registry 
> > 'solr.core.tmp_collection.shard1.replica_n3') enabled at server: 
> > com.sun.jmx.mbeanserver.JmxMBeanServer@aaaeedb
> >    [junit4]   2> 487654 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.SolrCore 
> > [[tmp_collection_shard1_replica_n3] ] Opening new SolrCore at 
> > [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-002/cores/tmp_collection_shard1_replica_n3],
> >  
> > dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrReplicationHandlerTest_4C51580235DFBD67-001/jetty-002/cores/tmp_collection_shard1_replica_n3/data/]
> >    [junit4]   2> 487656 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.RandomMergePolicy 
> > RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: 
> > [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, 
> > maxMergeSize=9223372036854775807, 
> > maxMergeSizeForForcedMerge=9223372036854775807, 
> > calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
> > maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
> >    [junit4]   2> 487833 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.UpdateHandler Using UpdateLog 
> > implementation: org.apache.solr.update.CdcrUpdateLog
> >    [junit4]   2> 487833 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.UpdateLog Initializing 
> > UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
> > maxNumLogsToKeep=10 numVersionBuckets=65536
> >    [junit4]   2> 487834 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.CommitTracker Hard AutoCommit: 
> > disabled
> >    [junit4]   2> 487834 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.CommitTracker Soft AutoCommit: 
> > disabled
> >    [junit4]   2> 487847 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.RandomMergePolicy 
> > RandomMergePolicy wrapping class 
> > org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
> > minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, 
> > maxMergeSizeForForcedMerge=9223372036854775807, 
> > calibrateSizeByDeletes=false, maxMergeDocs=2147483647, 
> > maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> >    [junit4]   2> 487847 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.s.SolrIndexSearcher Opening 
> > [Searcher@2a6df150[tmp_collection_shard1_replica_n3] main]
> >    [junit4]   2> 487866 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.r.ManagedResourceStorage 
> > Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
> >    [junit4]   2> 487867 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.r.ManagedResourceStorage Loaded 
> > null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> >    [junit4]   2> 487867 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.h.ReplicationHandler Commits 
> > will be reserved for 10000ms.
> >    [junit4]   2> 487903 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.UpdateLog Could not find max 
> > version in index or recent updates, using new clock 1639844651115479040
> >    [junit4]   2> 487907 INFO  (qtp1169878413-7688) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1 r:core_node2 
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.S.Request 
> > [tmp_collection_shard1_replica_n1]  webapp=/jsq/o path=/cdcr 
> > params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=1
> >    [junit4]   2> 487909 INFO  
> > (searcherExecutor-2032-thread-1-processing-n:127.0.0.1:45009_jsq%2Fo 
> > x:tmp_collection_shard1_replica_n3 c:tmp_collection s:shard1) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.SolrCore 
> > [tmp_collection_shard1_replica_n3] Registered new searcher 
> > Searcher@2a6df150[tmp_collection_shard1_replica_n3] 
> > main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> >    [junit4]   2> 487934 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.ZkShardTerms Successful update 
> > of terms at /collections/tmp_collection/terms/shard1 to 
> > Terms{values={core_node2=0, core_node4=0}, version=1}
> >    [junit4]   2> 487934 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.ShardLeaderElectionContextBase 
> > make sure parent is created /collections/tmp_collection/leaders/shard1
> >    [junit4]   2> 487937 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.ZkController Core needs to 
> > recover:tmp_collection_shard1_replica_n3
> >    [junit4]   2> 487937 INFO  
> > (updateExecutor-3083-thread-1-processing-n:127.0.0.1:45009_jsq%2Fo 
> > x:tmp_collection_shard1_replica_n3 c:tmp_collection s:shard1) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1 r:core_node4 
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.u.DefaultSolrCoreState Running 
> > recovery
> >    [junit4]   2> 487938 INFO  (qtp375642532-7724) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1  
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.s.HttpSolrCall [admin] 
> > webapp=null path=/admin/cores 
> > params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n3&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT}
> >  status=0 QTime=1938
> >    [junit4]   2> 487964 INFO  
> > (recoveryExecutor-3085-thread-1-processing-n:127.0.0.1:45009_jsq%2Fo 
> > x:tmp_collection_shard1_replica_n3 c:tmp_collection s:shard1 r:core_node4) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1 r:core_node4 
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.RecoveryStrategy Starting 
> > recovery process. recoveringAfterStartup=true
> >    [junit4]   2> 487965 INFO  
> > (recoveryExecutor-3085-thread-1-processing-n:127.0.0.1:45009_jsq%2Fo 
> > x:tmp_collection_shard1_replica_n3 c:tmp_collection s:shard1 r:core_node4) 
> > [n:127.0.0.1:45009_jsq%2Fo c:tmp_collection s:shard1 r:core_node4 
> > x:tmp_collection_shard1_replica_n3 ] o.a.s.c.RecoveryStrategy 
> > startupVersions is empty
> >    [junit4]   2> 487976 INFO  (qtp1169878413-7688) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1 r:core_node2 
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.S.Request 
> > [tmp_collection_shard1_replica_n1]  webapp=/jsq/o path=/admin/ping 
> > params={wt=javabin&version=2} hits=0 status=0 QTime=9
> >    [junit4]   2> 487976 INFO  (qtp1169878413-7688) 
> > [n:127.0.0.1:39587_jsq%2Fo c:tmp_collection s:shard1 r:core_node2 
> > x:tmp_collection_shard1_replica_n1 ] o.a.s.c.S.Request 
> > [tmp_collection_shard1_replica_n1]  webapp=/jsq/o path=/admin/ping pa
> >
> > [...truncated too long message...]
> >
> > -configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > ivy-availability-check:
> > [loadresource] Do not set property disallowed.ivy.jars.list as its length 
> > is 0.
> >
> > -ivy-fail-disallowed-ivy-version:
> >
> > ivy-fail:
> >
> > ivy-fail:
> >
> > ivy-configure:
> > [ivy:configure] :: loading settings :: file = 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/lucene/top-level-ivy-settings.xml
> >
> > resolve:
> >
> > jar-checksums:
> >     [mkdir] Created dir: 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/null1667021365
> >      [copy] Copying 249 files to 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/null1667021365
> >    [delete] Deleting directory 
> > /home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-8.x/checkout/solr/null1667021365
> >
> > check-working-copy:
> > [ivy:cachepath] :: resolving dependencies :: 
> > #;[email protected]
> > [ivy:cachepath]         confs: [default]
> > [ivy:cachepath]         found 
> > org.eclipse.jgit#org.eclipse.jgit;5.3.0.201903130848-r in public
> > [ivy:cachepath]         found com.jcraft#jsch;0.1.54 in public
> > [ivy:cachepath]         found com.jcraft#jzlib;1.1.1 in public
> > [ivy:cachepath]         found com.googlecode.javaewah#JavaEWAH;1.1.6 in 
> > public
> > [ivy:cachepath]         found org.slf4j#slf4j-api;1.7.2 in public
> > [ivy:cachepath]         found org.bouncycastle#bcpg-jdk15on;1.60 in public
> > [ivy:cachepath]         found org.bouncycastle#bcprov-jdk15on;1.60 in public
> > [ivy:cachepath]         found org.bouncycastle#bcpkix-jdk15on;1.60 in public
> > [ivy:cachepath]         found org.slf4j#slf4j-nop;1.7.2 in public
> > [ivy:cachepath] :: resolution report :: resolve 48ms :: artifacts dl 4ms
> >         
> > ---------------------------------------------------------------------
> >         |                  |            modules            ||   artifacts   
> > |
> >         |       conf       | number| search|dwnlded|evicted|| 
> > number|dwnlded|
> >         
> > ---------------------------------------------------------------------
> >         |      default     |   9   |   0   |   0   |   0   ||   9   |   0   
> > |
> >         
> > ---------------------------------------------------------------------
> > [wc-checker] Initializing working copy...
> > [wc-checker] Checking working copy status...
> >
> > -jenkins-base:
> >
> > BUILD SUCCESSFUL
> > Total time: 505 minutes 10 seconds
> > Archiving artifacts
> > java.lang.InterruptedException: no matches found within 10000
> >         at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2847)
> >         at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2726)
> >         at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2707)
> >         at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3086)
> > Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
> >                 at 
> > hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
> >                 at 
> > hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
> >                 at hudson.remoting.Channel.call(Channel.java:955)
> >                 at hudson.FilePath.act(FilePath.java:1072)
> >                 at hudson.FilePath.act(FilePath.java:1061)
> >                 at hudson.FilePath.validateAntFileMask(FilePath.java:2705)
> >                 at 
> > hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
> >                 at 
> > hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
> >                 at 
> > hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> >                 at 
> > hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
> >                 at 
> > hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
> >                 at hudson.model.Build$BuildExecution.post2(Build.java:186)
> >                 at 
> > hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
> >                 at hudson.model.Run.execute(Run.java:1835)
> >                 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> >                 at 
> > hudson.model.ResourceController.execute(ResourceController.java:97)
> >                 at hudson.model.Executor.run(Executor.java:429)
> > Caused: hudson.FilePath$TunneledInterruptedException
> >         at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3088)
> >         at hudson.remoting.UserRequest.perform(UserRequest.java:212)
> >         at hudson.remoting.UserRequest.perform(UserRequest.java:54)
> >         at hudson.remoting.Request$2.run(Request.java:369)
> >         at 
> > hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
> >         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >         at 
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> >         at 
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> >         at java.lang.Thread.run(Thread.java:748)
> > Caused: java.lang.InterruptedException: java.lang.InterruptedException: no 
> > matches found within 10000
> >         at hudson.FilePath.act(FilePath.java:1074)
> >         at hudson.FilePath.act(FilePath.java:1061)
> >         at hudson.FilePath.validateAntFileMask(FilePath.java:2705)
> >         at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
> >         at 
> > hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
> >         at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> >         at 
> > hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
> >         at 
> > hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
> >         at hudson.model.Build$BuildExecution.post2(Build.java:186)
> >         at 
> > hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
> >         at hudson.model.Run.execute(Run.java:1835)
> >         at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> >         at 
> > hudson.model.ResourceController.execute(ResourceController.java:97)
> >         at hudson.model.Executor.run(Executor.java:429)
> > No artifacts found that match the file pattern 
> > "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
> > Recording test results
> > Build step 'Publish JUnit test result report' changed build result to 
> > UNSTABLE
> > Email was triggered for: Unstable (Test Failures)
> > Sending email for trigger: Unstable (Test Failures)
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [email protected]
> > For additional commands, e-mail: [email protected]
>
>
>
> --
> -----------------------------------------------------
> Noble Paul
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to