[JENKINS] Solr » Solr-NightlyTests-main - Build # 1798 - Still Unstable!

[Apache Jenkins Server]

Build: https://ci-builds.apache.org/job/Solr/job/Solr-NightlyTests-main/1798/

16 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.classMethod

Error Message:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not 
released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@2055716927
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@409312053
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@1926090181
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

 expected null, but was:<ObjectTracker found 3 object(s) that were not 
released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@2055716927
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@409312053
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@1926090181
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

>

Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not 
released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@2055716927
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@409312053
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@1926090181
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

 expected null, but was:<ObjectTracker found 3 object(s) that were not 
released!!! [RawDirectoryWrapper, RawDirectoryWrapper, RawDirectoryWrapper]
org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@2055716927
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@409312053
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

org.apache.lucene.tests.store.RawDirectoryWrapper:org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException:
 org.apache.lucene.tests.store.RawDirectoryWrapper@1926090181
        at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:57)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:397)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:588)
        at 
org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:393)
        at 
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:499)
        at 
org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:258)
        at 
org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:721)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:351)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:327)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:408)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.Exception: Submitter stack trace
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:375)
        at 
java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService.submit(OtelInstrumentedExecutorService.java:162)
        at 
org.apache.solr.update.DefaultSolrCoreState$2.run(DefaultSolrCoreState.java:350)
        at 
org.apache.solr.util.stats.OtelInstrumentedExecutorService$InstrumentedRunnable.run(OtelInstrumentedExecutorService.java:256)
        ... 4 more

>
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotNull(Assert.java:756)
        at org.junit.Assert.assertNull(Assert.java:738)
        at 
org.apache.solr.SolrTestCase$1.afterIfSuccessful(SolrTestCase.java:100)
        at 
com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterIfSuccessful(TestRuleAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:37)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base/java.lang.Thread.run(Thread.java:1583)


FAILED:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test

Error Message:
org.apache.solr.client.solrj.SolrServerException: Timeout occurred while 
waiting response from server at: http://127.0.0.1:40005/solr

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occurred while 
waiting response from server at: http://127.0.0.1:40005/solr
        at 
__randomizedtesting.SeedInfo.seed([DC605CDECB583C08:5434630465A451F0]:0)
        at 
app//org.apache.solr.client.solrj.apache.HttpSolrClient.executeMethod(HttpSolrClient.java:693)
        at 
app//org.apache.solr.client.solrj.apache.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
app//org.apache.solr.client.solrj.apache.HttpSolrClient.request(HttpSolrClient.java:234)
        at 
app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:629)
        at 
app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:613)
        at 
app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:638)
        at 
app//org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:582)
        at 
app//org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1596)
        at 
app//org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1231)
        at 
app//org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1153)
        at 
app//org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1194)
        at 
app//org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:2358)
        at 
app//org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:2418)
        at 
app//org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test(ChaosMonkeyNothingIsSafeWithPullReplicasTest.java:340)
        at 
java.base@21.0.4/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base@21.0.4/java.lang.reflect.Method.invoke(Method.java:580)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at 
app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1063)
        at 
app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1034)
        at 
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at 
app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
        at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
        at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at 
app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base@21.0.4/java.lang.Thread.run(Thread.java:1583)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.base/sun.nio.ch.NioSocketImpl.timedRead(NioSocketImpl.java:278)
        at java.base/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:304)
        at java.base/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:346)
        at java.base/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:796)
        at java.base/java.net.Socket$SocketInputStream.read(Socket.java:1099)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at 
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at 
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at 
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at 
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at 
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
        at 
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at 
org.apache.solr.client.solrj.apache.HttpSolrClient.executeMethod(HttpSolrClient.java:568)
        ... 59 more


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test

Error Message:
java.lang.AssertionError: expected:<0> but was:<3>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<3>
        at 
__randomizedtesting.SeedInfo.seed([DC605CDECB583C08:5434630465A451F0]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:209)
        at 
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1063)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1034)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base/java.lang.Thread.run(Thread.java:1583)


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test

Error Message:
java.lang.AssertionError: expected:<0> but was:<3>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<3>
        at 
__randomizedtesting.SeedInfo.seed([DC605CDECB583C08:5434630465A451F0]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:209)
        at 
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1063)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1034)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base/java.lang.Thread.run(Thread.java:1583)


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test

Error Message:
java.lang.AssertionError: expected:<0> but was:<3>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<3>
        at 
__randomizedtesting.SeedInfo.seed([DC605CDECB583C08:5434630465A451F0]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:209)
        at 
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1063)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1034)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base/java.lang.Thread.run(Thread.java:1583)


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test

Error Message:
java.lang.AssertionError: expected:<0> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
        at 
__randomizedtesting.SeedInfo.seed([DC605CDECB583C08:5434630465A451F0]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:209)
        at 
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1063)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1034)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at 
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at 
org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
        at java.base/java.lang.Thread.run(Thread.java:1583)


FAILED:  
org.apache.solr.crossdc.manager.RetryQueueIntegrationTest.testRetryQueueZKDown

Error Message:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=286, name=OverseerExitThread, state=RUNNABLE, 
group=Overseer state updater.]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=286, name=OverseerExitThread, state=RUNNABLE, 
group=Overseer state updater.]
        at 
__randomizedtesting.SeedInfo.seed([DC605CDECB583C08:7E56E0909C59481F]:0)
Caused by: java.lang.StackOverflowError
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)
        at java.base/java.lang.String.startsWith(String.java:2297)
        at java.base/java.lang.String.startsWith(String.java:2327)
        at 
org.apache.logging.slf4j.Log4jLoggerFactory.lambda$static$0(Log4jLoggerFactory.java:37)
        at 
org.apache.logging.log4j.util.StackLocator.lambda$getCallerClass$1(StackLocator.java:51)
        at 
java.base/java.util.stream.WhileOps$1Op$1OpSink.accept(WhileOps.java:376)
        at 
java.base/java.util.stream.WhileOps$1Op$1OpSink.accept(WhileOps.java:386)
        at 
java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
        at 
java.base/java.lang.StackStreamFactory$StackFrameTraverser.tryAdvance(StackStreamFactory.java:647)
        at 
java.base/java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129)
        at 
java.base/java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527)
        at 
java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513)
        at 
java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
        at 
java.base/java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150)
        at 
java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at 
java.base/java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647)
        at 
org.apache.logging.log4j.util.StackLocator.lambda$getCallerClass$2(StackLocator.java:52)
        at 
java.base/java.lang.StackStreamFactory$StackFrameTraverser.consumeFrames(StackStreamFactory.java:586)
        at 
java.base/java.lang.StackStreamFactory$AbstractStackWalker.doStackWalk(StackStreamFactory.java:324)
        at 
java.base/java.lang.StackStreamFactory$AbstractStackWalker.callStackWalk(Native 
Method)
        at 
java.base/java.lang.StackStreamFactory$AbstractStackWalker.beginStackWalk(StackStreamFactory.java:410)
        at 
java.base/java.lang.StackStreamFactory$AbstractStackWalker.walkHelper(StackStreamFactory.java:261)
        at 
java.base/java.lang.StackStreamFactory$AbstractStackWalker.walk(StackStreamFactory.java:253)
        at java.base/java.lang.StackWalker.walk(StackWalker.java:589)
        at 
org.apache.logging.log4j.util.StackLocator.getCallerClass(StackLocator.java:47)
        at 
org.apache.logging.log4j.util.StackLocatorUtil.getCallerClass(StackLocatorUtil.java:107)
        at 
org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
        at 
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46)
        at 
org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:32)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:447)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:472)
        at org.apache.curator.RetryLoopImpl.<init>(RetryLoopImpl.java:33)
        at 
org.apache.curator.CuratorZookeeperClient.newRetryLoop(CuratorZookeeperClient.java:189)
        at 
org.apache.curator.connection.ThreadLocalRetryLoop.getRetryLoop(ThreadLocalRetryLoop.java:123)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:84)
        at 
org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:229)
        at 
org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:222)
        at 
org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:42)
        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$3(SolrZkClient.java:373)
        at 
org.apache.solr.common.cloud.SolrZkClient.runWithCorrectThrows(SolrZkClient.java:975)
        at 
org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:371)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:97)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:387)
        at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:132)
        at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:302)
        at org.apache.solr.cloud.LeaderElector.retryEle

[...truncated too long message...]

Info.seed([DC605CDECB583C08]:0)


FAILED:  
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.testSingleLexicalQuery

Error Message:
java.lang.Exception: Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)


FAILED:  
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.testSingleLexicalQuery

Error Message:
java.lang.Exception: Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)


FAILED:  
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.classMethod

Error Message:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)


FAILED:  
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.classMethod

Error Message:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)


FAILED:  
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.classMethod

Error Message:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)


FAILED:  
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.classMethod

Error Message:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([DC605CDECB583C08]:0)




Build Log:
[...truncated 3838467 lines...]
ERROR: The following test(s) have failed:
  - 
org.apache.solr.crossdc.manager.RetryQueueIntegrationTest.testRetryQueueZKDown 
(:solr:cross-dc-manager)
    Test history: 
https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.crossdc.manager.RetryQueueIntegrationTest&tests.test=testRetryQueueZKDown
 
http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.crossdc.manager.RetryQueueIntegrationTest.testRetryQueueZKDown
    Test output: 
/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/solr/cross-dc-manager/build/test-results/test/outputs/OUTPUT-org.apache.solr.crossdc.manager.RetryQueueIntegrationTest.txt
    Reproduce with: ./gradlew :solr:cross-dc-manager:test --tests 
"org.apache.solr.crossdc.manager.RetryQueueIntegrationTest.testRetryQueueZKDown"
 -Ptests.haltonfailure=false "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=DC605CDECB583C08 -Ptests.multiplier=2 
-Ptests.useSecurityManager=true -Ptests.nightly=true -Ptests.badapples=false 
-Ptests.file.encoding=ISO-8859-1 
-Ptests.linedocsfile=/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt

  - org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test 
(:solr:core)
    Test history: 
https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest&tests.test=test
 
http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
    Test output: 
/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.txt
    Reproduce with: ./gradlew :solr:core:test --tests 
"org.apache.solr.cloud.ChaosMonkeyNothingIsSafeWithPullReplicasTest.test" 
-Ptests.haltonfailure=false "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=DC605CDECB583C08 -Ptests.multiplier=2 
-Ptests.useSecurityManager=true -Ptests.nightly=true -Ptests.badapples=false 
-Ptests.file.encoding=ISO-8859-1 
-Ptests.linedocsfile=/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt

  - org.apache.solr.cloud.BasicDistributedZkTest (:solr:core)
    Test history: 
https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.cloud.BasicDistributedZkTest
    Test output: 
/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.BasicDistributedZkTest.txt
    Reproduce with: ./gradlew :solr:core:test --tests 
"org.apache.solr.cloud.BasicDistributedZkTest" -Ptests.haltonfailure=false 
"-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC 
-XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=DC605CDECB583C08 -Ptests.multiplier=2 
-Ptests.useSecurityManager=true -Ptests.nightly=true -Ptests.badapples=false 
-Ptests.file.encoding=ISO-8859-1 
-Ptests.linedocsfile=/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt

  - org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test 
(:solr:core)
    Test history: 
https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest&tests.test=test
 
http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test
    Test output: 
/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.txt
    Reproduce with: ./gradlew :solr:core:test --tests 
"org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test" 
-Ptests.haltonfailure=false "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=DC605CDECB583C08 -Ptests.multiplier=2 
-Ptests.useSecurityManager=true -Ptests.nightly=true -Ptests.badapples=false 
-Ptests.file.encoding=ISO-8859-1 
-Ptests.linedocsfile=/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt

  - 
org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.testSingleLexicalQuery
 (:solr:core)
    Test history: 
https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.handler.component.DistributedCombinedQueryComponentTest&tests.test=testSingleLexicalQuery
 
http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.testSingleLexicalQuery
    Test output: 
/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.txt
    Reproduce with: ./gradlew :solr:core:test --tests 
"org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.testSingleLexicalQuery"
 -Ptests.haltonfailure=false "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=DC605CDECB583C08 -Ptests.multiplier=2 
-Ptests.useSecurityManager=true -Ptests.nightly=true -Ptests.badapples=false 
-Ptests.file.encoding=ISO-8859-1 
-Ptests.linedocsfile=/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt

  - org.apache.solr.handler.component.DistributedCombinedQueryComponentTest 
(:solr:core)
    Test history: 
https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.handler.component.DistributedCombinedQueryComponentTest
    Test output: 
/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.handler.component.DistributedCombinedQueryComponentTest.txt
    Reproduce with: ./gradlew :solr:core:test --tests 
"org.apache.solr.handler.component.DistributedCombinedQueryComponentTest" 
-Ptests.haltonfailure=false "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=DC605CDECB583C08 -Ptests.multiplier=2 
-Ptests.useSecurityManager=true -Ptests.nightly=true -Ptests.badapples=false 
-Ptests.file.encoding=ISO-8859-1 
-Ptests.linedocsfile=/home/jenkins/jenkins-agent/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt


Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

For more on this, please refer to 
https://docs.gradle.org/8.10/userguide/command_line_interface.html#sec:command_line_warnings
 in the Gradle documentation.

BUILD SUCCESSFUL in 8h 55m 37s
152 actionable tasks: 152 executed

Publishing Build Scan to Develocity...
https://develocity.apache.org/s/rhdbf2hs4s2aa

Build step 'Invoke Gradle script' changed build result to SUCCESS
Archiving artifacts
‘**/*.events’ doesn’t match anything: ‘**’ exists but not ‘**/*.events’
No artifacts found that match the file pattern 
"**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
[Checks API] No suitable checks publisher found.
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@solr.apache.org
For additional commands, e-mail: builds-h...@solr.apache.org