Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-7.x/16/

7 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue:     1) 
Thread[id=33, name=sdqtest--5-thread-1, state=TIMED_WAITING, 
group=TGRP-TestGenericDistributedQueue]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:194)
         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:167)
         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.lambda$testDistributedQueueBlocking$0(TestSimDistributedQueue.java:92)
         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue$$Lambda$199/34673378.call(Unknown
 Source)         at java.util.concurrent.FutureTask.run(FutureTask.java:266)    
     at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/1574893378.run(Unknown
 Source)         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
        at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue: 
   1) Thread[id=33, name=sdqtest--5-thread-1, state=TIMED_WAITING, 
group=TGRP-TestGenericDistributedQueue]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:194)
        at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:167)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.lambda$testDistributedQueueBlocking$0(TestSimDistributedQueue.java:92)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue$$Lambda$199/34673378.call(Unknown
 Source)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/1574893378.run(Unknown
 Source)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849]:0)


FAILED:  org.apache.solr.cloud.CollectionPropsTest.testReadWriteCached

Error Message:
Could not see value change after setting collection property. Name: property2, 
current value: value2, expected value: newValue

Stack Trace:
java.lang.AssertionError: Could not see value change after setting collection 
property. Name: property2, current value: value2, expected value: newValue
        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849:AB79436B652824BA]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.CollectionPropsTest.waitForValue(CollectionPropsTest.java:146)
        at 
org.apache.solr.cloud.CollectionPropsTest.testReadWriteCached(CollectionPropsTest.java:115)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue.testDistributedQueueBlocking

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849:894FCDCB34CE43D]:0)
        at java.util.concurrent.FutureTask.get(FutureTask.java:205)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.testDistributedQueueBlocking(TestSimDistributedQueue.java:101)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestLargeCluster:     1) Thread[id=29027, 
name=AutoscalingActionExecutor-9740-thread-1, state=RUNNABLE, 
group=TGRP-TestLargeCluster]         at 
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)       
  at 
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)  
       at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) 
        at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)    
     at 
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)      
   at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)     
    at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)   
      at 
org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)     
    at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
         at 
org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)
         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$382/636823270.run(Unknown
 Source)         at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         
at java.util.concurrent.FutureTask.run(FutureTask.java:266)         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/109587478.run(Unknown
 Source)         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
        at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   1) Thread[id=29027, name=AutoscalingActionExecutor-9740-thread-1, 
state=RUNNABLE, group=TGRP-TestLargeCluster]
        at 
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
        at 
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
        at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
        at 
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at 
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at 
org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)
        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$382/636823270.run(Unknown
 Source)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/109587478.run(Unknown
 Source)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestLargeCluster

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=29027, name=AutoscalingActionExecutor-9740-thread-1, state=RUNNABLE, 
group=TGRP-TestLargeCluster]         at 
java.util.ArrayList$Itr.<init>(ArrayList.java:840)         at 
java.util.ArrayList$Itr.<init>(ArrayList.java:840)         at 
java.util.ArrayList.iterator(ArrayList.java:834)         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$null$4(Row.java:189)  
       at 
org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$401/1590787792.accept(Unknown
 Source)         at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)     
    at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$forEachReplica$5(Row.java:188)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$400/1847711884.accept(Unknown
 Source)         at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)     
    at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:187) 
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:183) 
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggestion$ConditionType$1.projectAddReplica(Suggestion.java:185)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:131)     
    at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
         at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
         at 
org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)
         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$382/636823270.run(Unknown
 Source)         at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         
at java.util.concurrent.FutureTask.run(FutureTask.java:266)         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/109587478.run(Unknown
 Source)         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
        at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=29027, name=AutoscalingActionExecutor-9740-thread-1, 
state=RUNNABLE, group=TGRP-TestLargeCluster]
        at java.util.ArrayList$Itr.<init>(ArrayList.java:840)
        at java.util.ArrayList$Itr.<init>(ArrayList.java:840)
        at java.util.ArrayList.iterator(ArrayList.java:834)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$null$4(Row.java:189)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$401/1590787792.accept(Unknown
 Source)
        at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$forEachReplica$5(Row.java:188)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$400/1847711884.accept(Unknown
 Source)
        at java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:187)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:183)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggestion$ConditionType$1.projectAddReplica(Suggestion.java:185)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:131)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
        at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
        at 
org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)
        at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$382/636823270.run(Unknown
 Source)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/109587478.run(Unknown
 Source)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849]:0)


FAILED:  
org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849:610CF9287BDA2ECD]:0)
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
        at 
org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: 
xpath=//result[@numFound=1]
        xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int 
name="QTime">0</int></lst><result name="response" numFound="0" 
start="0"></result>
</response>

        request 
was:q=cat:aeotk798gxd9fc8fomoo+djllhvzek8hl8xz2racf+y1fn07tleh9zxhl0chnv+glzcj2lh4yz2xjmgevl8+a0828fiem5n2nr0e7p4d&wt=xml
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
        ... 40 more


FAILED:  org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN

Error Message:
expected:<1.0> but was:<0.0>

Stack Trace:
java.lang.AssertionError: expected:<1.0> but was:<0.0>
        at 
__randomizedtesting.SeedInfo.seed([69F2C55B7DEE55D9:9853B70B48559F4B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:443)
        at org.junit.Assert.assertEquals(Assert.java:512)
        at 
org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 1768 lines...]
   [junit4] JVM J0: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20180317_190331_8812910541049671944911.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] codec: Asserting, pf: LuceneVarGapFixedInterval, dvf: Memory
   [junit4] <<< JVM J0: EOF ----

[...truncated 10349 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestGenericDistributedQueue_4D3E8EA5F71E5849-001/init-core-data-001
   [junit4]   2> 10985 WARN  
(SUITE-TestGenericDistributedQueue-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 10986 INFO  
(SUITE-TestGenericDistributedQueue-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 10988 INFO  
(SUITE-TestGenericDistributedQueue-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 10989 INFO  
(SUITE-TestGenericDistributedQueue-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 11018 INFO  
(TEST-TestGenericDistributedQueue.testDistributedQueueBlocking-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueBlocking
   [junit4]   2> 13056 INFO  
(TEST-TestGenericDistributedQueue.testDistributedQueueBlocking-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueBlocking
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestGenericDistributedQueue 
-Dtests.method=testDistributedQueueBlocking -Dtests.seed=4D3E8EA5F71E5849 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.badapples=true 
-Dtests.locale=nl-NL -Dtests.timezone=America/Marigot -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   2.07s J1 | 
TestGenericDistributedQueue.testDistributedQueueBlocking <<<
   [junit4]    > Throwable #1: java.util.concurrent.TimeoutException
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849:894FCDCB34CE43D]:0)
   [junit4]    >        at 
java.util.concurrent.FutureTask.get(FutureTask.java:205)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.testDistributedQueueBlocking(TestSimDistributedQueue.java:101)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 13085 INFO  
(TEST-TestGenericDistributedQueue.testDistributedQueue-seed#[4D3E8EA5F71E5849]) 
[    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueue
   [junit4]   2> 15123 INFO  
(TEST-TestGenericDistributedQueue.testDistributedQueue-seed#[4D3E8EA5F71E5849]) 
[    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueue
   [junit4]   2> 15126 INFO  
(TEST-TestGenericDistributedQueue.testPeekElements-seed#[4D3E8EA5F71E5849]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testPeekElements
   [junit4]   2> 16674 INFO  
(TEST-TestGenericDistributedQueue.testPeekElements-seed#[4D3E8EA5F71E5849]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testPeekElements
   [junit4]   2> 16684 INFO  
(TEST-TestGenericDistributedQueue.testLocallyOffer-seed#[4D3E8EA5F71E5849]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testLocallyOffer
   [junit4]   2> 16840 INFO  
(TEST-TestGenericDistributedQueue.testLocallyOffer-seed#[4D3E8EA5F71E5849]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testLocallyOffer
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestGenericDistributedQueue_4D3E8EA5F71E5849-001
   [junit4]   2> Mar 17, 2018 7:36:21 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> Mar 17, 2018 7:37:41 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue: 
   [junit4]   2>    1) Thread[id=33, name=sdqtest--5-thread-1, 
state=TIMED_WAITING, group=TGRP-TestGenericDistributedQueue]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]   2>         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:194)
   [junit4]   2>         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:167)
   [junit4]   2>         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.lambda$testDistributedQueueBlocking$0(TestSimDistributedQueue.java:92)
   [junit4]   2>         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue$$Lambda$199/34673378.call(Unknown
 Source)
   [junit4]   2>         at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2>         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2>         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/1574893378.run(Unknown
 Source)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Mar 17, 2018 7:37:41 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=33, name=sdqtest--5-thread-1, 
state=TIMED_WAITING, group=TGRP-TestGenericDistributedQueue]
   [junit4]   2> Mar 17, 2018 7:37:41 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), 
sim=RandomSimilarity(queryNorm=false): {}, locale=nl-NL, 
timezone=America/Marigot
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 
1.8.0_144 (64-bit)/cpus=4,threads=1,free=191216832,total=269484032
   [junit4]   2> NOTE: All tests run in this JVM: [TestExceedMaxTermLength, 
TestSurroundQueryParser, TestGenericDistributedQueue]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestGenericDistributedQueue -Dtests.seed=4D3E8EA5F71E5849 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.badapples=true 
-Dtests.locale=nl-NL -Dtests.timezone=America/Marigot -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestGenericDistributedQueue (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestGenericDistributedQueue: 
   [junit4]    >    1) Thread[id=33, name=sdqtest--5-thread-1, 
state=TIMED_WAITING, group=TGRP-TestGenericDistributedQueue]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:194)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.sim.GenericDistributedQueue.peek(GenericDistributedQueue.java:167)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue.lambda$testDistributedQueueBlocking$0(TestSimDistributedQueue.java:92)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.sim.TestSimDistributedQueue$$Lambda$199/34673378.call(Unknown
 Source)
   [junit4]    >         at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]    >         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    >         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/1574893378.run(Unknown
 Source)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849]:0)
   [junit4] Completed [13/784 (1!)] on J1 in 86.25s, 4 tests, 2 errors <<< 
FAILURES!

[...truncated 613 lines...]
   [junit4] Suite: 
org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_4D3E8EA5F71E5849-001/init-core-data-001
   [junit4]   2> 768829 WARN  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 768829 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 768831 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 768832 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 768832 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 768833 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/core/src/test-files/solr/collection1/lib,
 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 768877 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 768903 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 769035 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 769082 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ebb2c98
   [junit4]   2> 769094 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') 
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ebb2c98
   [junit4]   2> 769094 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ebb2c98
   [junit4]   2> 769096 INFO  (coreLoadExecutor-2900-thread-1) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 769097 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, 
from paths: 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/core/src/test-files/solr/collection1/lib,
 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 769133 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.4.0
   [junit4]   2> 769159 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 769287 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 769296 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using 
configuration from instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/core/src/test-files/solr/collection1,
 trusted=true
   [junit4]   2> 769297 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2ebb2c98
   [junit4]   2> 769297 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 769297 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/core/src/test-files/solr/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_4D3E8EA5F71E5849-001/init-core-data-001/]
   [junit4]   2> 769299 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.1206285996731297]
   [junit4]   2> 769365 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 769365 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
numVersionBuckets=65536
   [junit4]   2> 769366 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 769367 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 769368 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.762037677024349]
   [junit4]   2> 769368 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2a3c16f8[collection1] main]
   [junit4]   2> 769369 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 769377 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.s.DirectSolrSpellChecker init: 
{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 769410 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 769410 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 769410 INFO  (coreLoadExecutor-2900-thread-1) [    
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent 
updates, using new clock 1595215587163766784
   [junit4]   2> 769410 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 769410 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 769410 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: 
multipleFields
   [junit4]   2> 769411 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 769411 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 769411 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 769411 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 769411 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 769413 INFO  
(searcherExecutor-2901-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@2a3c16f8[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 769414 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 769416 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultipleThreads
   [junit4]   2> 769417 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM 
INDEX
   [junit4]   2> 769417 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@62928f98[collection1] 
realtime]
   [junit4]   2> 769418 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null 
path=null 
params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*
 (-9223372036854775807)} 0 1
   [junit4]   2> 769430 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.u.DirectUpdateHandler2 start 
commit{_version_=1595215587184738306,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 769430 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@3258bce5 
commitCommandVersion:1595215587184738306
   [junit4]   2> 769438 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@b32edfc[collection1] main]
   [junit4]   2> 769439 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 769441 INFO  (searcherExecutor-2901-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@b32edfc[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C10/9:delGen=1)))}
   [junit4]   2> 769441 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null 
path=null params={}{commit=} 0 11
   [junit4]   2> 769444 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=id:10&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769446 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=cat:aeotk798gxd9fc8fomoo+djllhvzek8hl8xz2racf+y1fn07tleh9zxhl0chnv+glzcj2lh4yz2xjmgevl8+a0828fiem5n2nr0e7p4d&wt=xml}
 hits=0 status=0 QTime=0
   [junit4]   2> 769446 ERROR 
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2>        xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int 
name="QTime">0</int></lst><result name="response" numFound="0" 
start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2>        request 
was:q=cat:aeotk798gxd9fc8fomoo+djllhvzek8hl8xz2racf+y1fn07tleh9zxhl0chnv+glzcj2lh4yz2xjmgevl8+a0828fiem5n2nr0e7p4d&wt=xml
   [junit4]   2> 769446 ERROR 
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: 
q=cat:aeotk798gxd9fc8fomoo+djllhvzek8hl8xz2racf+y1fn07tleh9zxhl0chnv+glzcj2lh4yz2xjmgevl8+a0828fiem5n2nr0e7p4d&wt=xml:java.lang.RuntimeException:
 REQUEST FAILED: xpath=//result[@numFound=1]
   [junit4]   2>        xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int 
name="QTime">0</int></lst><result name="response" numFound="0" 
start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2>        request 
was:q=cat:aeotk798gxd9fc8fomoo+djllhvzek8hl8xz2racf+y1fn07tleh9zxhl0chnv+glzcj2lh4yz2xjmgevl8+a0828fiem5n2nr0e7p4d&wt=xml
   [junit4]   2>        at 
org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]   2>        at 
org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 769447 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testMultipleThreads-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleThreads
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=AtomicUpdateProcessorFactoryTest -Dtests.method=testMultipleThreads 
-Dtests.seed=4D3E8EA5F71E5849 -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.badapples=true -Dtests.locale=sr-Latn-BA -Dtests.timezone=Etc/GMT-14 
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.04s J2 | 
AtomicUpdateProcessorFactoryTest.testMultipleThreads <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during 
query
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849:610CF9287BDA2ECD]:0)
   [junit4]    >        at 
org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:913)
   [junit4]    >        at 
org.apache.solr.update.processor.AtomicUpdateProcessorFactoryTest.testMultipleThreads(AtomicUpdateProcessorFactoryTest.java:256)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: 
xpath=//result[@numFound=1]
   [junit4]    >        xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int 
name="QTime">0</int></lst><result name="response" numFound="0" 
start="0"></result>
   [junit4]    > </response>
   [junit4]    >        request 
was:q=cat:aeotk798gxd9fc8fomoo+djllhvzek8hl8xz2racf+y1fn07tleh9zxhl0chnv+glzcj2lh4yz2xjmgevl8+a0828fiem5n2nr0e7p4d&wt=xml
   [junit4]    >        at 
org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:906)
   [junit4]    >        ... 40 more
   [junit4]   2> 769452 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testBasics
   [junit4]   2> 769454 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.DirectUpdateHandler2 start 
commit{_version_=1595215587209904128,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 769454 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@3258bce5 
commitCommandVersion:1595215587209904128
   [junit4]   2> 769459 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b7a0f6d[collection1] main]
   [junit4]   2> 769460 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 769462 INFO  (searcherExecutor-2901-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@1b7a0f6d[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C10/9:delGen=1)
 Uninverting(_1(7.4.0):C1)))}
   [junit4]   2> 769462 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null 
params={}{commit=} 0 8
   [junit4]   2> 769463 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} 
hits=1 status=0 QTime=0
   [junit4]   2> 769464 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769464 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=title:Mr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769465 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=count_i:20&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769465 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=name_s:Virat&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769465 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=multiDefault:Delhi&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769468 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.DirectUpdateHandler2 start 
commit{_version_=1595215587224584192,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 769468 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.SolrIndexWriter Calling setCommitData with 
IW:org.apache.solr.update.SolrIndexWriter@3258bce5 
commitCommandVersion:1595215587224584192
   [junit4]   2> 769473 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.s.SolrIndexSearcher Opening [Searcher@9c7b4f[collection1] main]
   [junit4]   2> 769473 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 769476 INFO  (searcherExecutor-2901-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@9c7b4f[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.4.0):C10/9:delGen=1)
 Uninverting(_2(7.4.0):C1)))}
   [junit4]   2> 769478 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null 
params={}{commit=} 0 10
   [junit4]   2> 769478 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&wt=xml} 
hits=1 status=0 QTime=0
   [junit4]   2> 769479 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=cat:human&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769480 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=cat:animal&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769480 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=title:Mr&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 769481 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=title:Dr&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769481 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=count_i:20&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 769481 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=count_i:40&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 769482 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=name_s:Virat&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 769482 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.c.S.Request [collection1]  webapp=null path=null 
params={q=multiDefault:Delhi&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 769482 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testBasics-seed#[4D3E8EA5F71E5849]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testBasics
   [junit4]   2> 769485 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testWrongAtomicOpPassed
   [junit4]   2> 769485 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testWrongAtomicOpPassed-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testWrongAtomicOpPassed
   [junit4]   2> 769487 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoUniqueIdPassed
   [junit4]   2> 769488 INFO  
(TEST-AtomicUpdateProcessorFactoryTest.testNoUniqueIdPassed-seed#[4D3E8EA5F71E5849])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoUniqueIdPassed
   [junit4]   2> 769488 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 769488 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=79219744
   [junit4]   2> 769488 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 769488 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@3697d968: rootName = null, 
domain = solr.node, service url = null, agent id = null] for registry solr.node 
/ com.codahale.metrics.MetricRegistry@235149d2
   [junit4]   2> 769493 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 769493 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@31206705: rootName = null, 
domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / 
com.codahale.metrics.MetricRegistry@152ac1f3
   [junit4]   2> 769497 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 769497 INFO  
(SUITE-AtomicUpdateProcessorFactoryTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@621b09c4: rootName = null, 
domain = solr.jetty, service url = null, agent id = null] for registry 
solr.jetty / com.codahale.metrics.MetricRegistry@1d8f3edd
   [junit4]   2> 769497 INFO  (coreCloseExecutor-2906-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@128bebbc
   [junit4]   2> 769498 INFO  (coreCloseExecutor-2906-thread-1) [    
x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.collection1, tag=311159740
   [junit4]   2> 769498 INFO  (coreCloseExecutor-2906-thread-1) [    
x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@73a917c7: rootName = null, 
domain = solr.core.collection1, service url = null, agent id = null] for 
registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@7bc38e4a
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.update.processor.AtomicUpdateProcessorFactoryTest_4D3E8EA5F71E5849-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{name_s=PostingsFormat(name=Direct), 
title_stringNoNorms=Lucene50(blocksize=128), 
title_stemmed=PostingsFormat(name=MockRandom), 
multiDefault=Lucene50(blocksize=128), cat=Lucene50(blocksize=128), 
id=PostingsFormat(name=Direct), text=FST50, 
title=PostingsFormat(name=MockRandom), 
title_lettertok=PostingsFormat(name=Direct)}, 
docValues:{int_i=DocValuesFormat(name=Direct), 
range_facet_l_dv=DocValuesFormat(name=Memory), 
_version_=DocValuesFormat(name=Lucene70), 
intDefault=DocValuesFormat(name=Lucene70), 
id_i1=DocValuesFormat(name=Lucene70), 
range_facet_i_dv=DocValuesFormat(name=Asserting), 
intDvoDefault=DocValuesFormat(name=Memory), 
count_i=DocValuesFormat(name=Direct), 
range_facet_l=DocValuesFormat(name=Asserting), 
timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1921, 
maxMBSortInHeap=7.633493995590008, sim=RandomSimilarity(queryNorm=false): {}, 
locale=sr-Latn-BA, timezone=Etc/GMT-14
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 
1.8.0_144 (64-bit)/cpus=4,threads=1,free=132376496,total=524812288
   [junit4]   2> NOTE: All tests run in this JVM: [CircularListTest, 
TestRandomDVFaceting, SuggesterTSTTest, MoreLikeThisHandlerTest, 
LeaderFailureAfterFreshStartTest, HdfsRestartWhileUpdatingTest, 
TestTolerantUpdateProcessorCloud, TestLocalFSCloudBackupRestore, 
UUIDUpdateProcessorFallbackTest, DistributedExpandComponentTest, 
SuggestComponentContextFilterQueryTest, 
DistribDocExpirationUpdateProcessorTest, CdcrVersionReplicationTest, 
TestDistribIDF, TestLazyCores, DistributedSpellCheckComponentTest, 
ClusterStateUpdateTest, TestDynamicLoading, TestSchemaResource, CopyFieldTest, 
LeaderElectionTest, DateMathParserTest, TestDownShardTolerantSearch, 
TestSolrXml, TestOverriddenPrefixQueryForCustomFieldType, MinimalSchemaTest, 
TestSizeLimitedDistributedMap, UniqFieldsUpdateProcessorFactoryTest, 
TestShardHandlerFactory, UnloadDistributedZkTest, 
TestSchemalessBufferedUpdates, BlockCacheTest, DocValuesTest, 
RegexBoostProcessorTest, TestSolrCloudWithKerberosAlt, TestRealTimeGet, 
TestBadConfig, TestExpandComponent, BasicDistributedZk2Test, 
DistributedSuggestComponentTest, SolrIndexMetricsTest, 
AutoAddReplicasIntegrationTest, TestLFUCache, HttpTriggerListenerTest, 
TestCodecSupport, TestReRankQParserPlugin, SearchHandlerTest, 
TestHdfsBackupRestoreCore, HdfsNNFailoverTest, TestRetrieveFieldsOptimizer, 
MigrateRouteKeyTest, TestCoreContainer, NodeMutatorTest, 
SpellCheckComponentTest, TestStressReorder, DirectoryFactoryTest, 
SolrGraphiteReporterTest, DistributedFacetPivotLongTailTest, TestUpdate, 
TestManagedSchemaThreadSafety, SecurityConfHandlerTest, TestQueryTypes, 
MergeStrategyTest, ResponseLogComponentTest, TestUnifiedSolrHighlighter, 
TestQuerySenderListener, NumericFieldsTest, TestMacros, 
TermVectorComponentTest, TestJsonFacetRefinement, MetricsConfigTest, 
TestDynamicFieldResource, AtomicUpdateProcessorFactoryTest]
   [junit4] Completed [191/784 (2!)] on J2 in 0.70s, 4 tests, 1 error <<< 
FAILURES!

[...truncated 1020 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionPropsTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionPropsTest_4D3E8EA5F71E5849-001/init-core-data-001
   [junit4]   2> 1763761 WARN  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
   [junit4]   2> 1763761 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1763763 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 1763763 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1763763 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.CollectionPropsTest Using legacyCloud?: false
   [junit4]   2> 1763763 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionPropsTest_4D3E8EA5F71E5849-001/tempDir-001
   [junit4]   2> 1763764 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1763764 INFO  (Thread-4554) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1763764 INFO  (Thread-4554) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1763771 ERROR (Thread-4554) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1763864 INFO  
(SUITE-CollectionPropsTest-seed#[4D3E8EA5F71E5849]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:36976
   [junit4]   2> 1763871 INFO  (zkConnectionManagerCallback-3535-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763881 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1763882 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1763885 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1763886 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1763886 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1763886 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1763887 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@f547317{/solr,null,AVAILABLE}
   [junit4]   2> 1763888 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4ca4c082{HTTP/1.1,[http/1.1]}{127.0.0.1:55480}
   [junit4]   2> 1763888 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1763888 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.e.j.s.Server Started @1766777ms
   [junit4]   2> 1763888 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1763888 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=55480}
   [junit4]   2> 1763888 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1763888 ERROR (jetty-launcher-3532-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1763889 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.4.0
   [junit4]   2> 1763889 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1763889 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1763889 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-17T20:05:28.275Z
   [junit4]   2> 1763893 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1763895 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1763895 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1763895 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1763895 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4da866c1{/solr,null,AVAILABLE}
   [junit4]   2> 1763896 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@49099c54{HTTP/1.1,[http/1.1]}{127.0.0.1:36436}
   [junit4]   2> 1763896 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.e.j.s.Server Started @1766785ms
   [junit4]   2> 1763896 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36436}
   [junit4]   2> 1763897 ERROR (jetty-launcher-3532-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1763897 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.4.0
   [junit4]   2> 1763897 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1763897 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1763897 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-17T20:05:28.283Z
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@39d83821{/solr,null,AVAILABLE}
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@59049e25{HTTP/1.1,[http/1.1]}{127.0.0.1:55694}
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.e.j.s.Server Started @1766791ms
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=55694}
   [junit4]   2> 1763902 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3bec6c95{/solr,null,AVAILABLE}
   [junit4]   2> 1763903 ERROR (jetty-launcher-3532-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.4.0
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@16dc5919{HTTP/1.1,[http/1.1]}{127.0.0.1:39473}
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.e.j.s.Server Started @1766792ms
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39473}
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-17T20:05:28.289Z
   [junit4]   2> 1763903 ERROR (jetty-launcher-3532-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.4.0
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1763903 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1763904 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-03-17T20:05:28.289Z
   [junit4]   2> 1763913 INFO  (zkConnectionManagerCallback-3537-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763913 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1763918 INFO  (zkConnectionManagerCallback-3541-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763918 INFO  (zkConnectionManagerCallback-3539-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763918 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1763918 INFO  (zkConnectionManagerCallback-3543-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763919 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1763923 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1763926 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105059d4a5c0001, likely client has closed socket
   [junit4]   2> 1763926 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105059d4a5c0002, likely client has closed socket
   [junit4]   2> 1763926 INFO  (jetty-launcher-3532-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36976/solr
   [junit4]   2> 1763930 INFO  (jetty-launcher-3532-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36976/solr
   [junit4]   2> 1763932 INFO  (zkConnectionManagerCallback-3547-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763934 INFO  (zkConnectionManagerCallback-3551-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763941 INFO  (jetty-launcher-3532-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36976/solr
   [junit4]   2> 1763945 INFO  
(zkConnectionManagerCallback-3556-thread-1-processing-n:127.0.0.1:55694_solr) 
[n:127.0.0.1:55694_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763946 INFO  (jetty-launcher-3532-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36976/solr
   [junit4]   2> 1763946 INFO  
(zkConnectionManagerCallback-3553-thread-1-processing-n:127.0.0.1:55480_solr) 
[n:127.0.0.1:55480_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763947 INFO  (zkConnectionManagerCallback-3559-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763948 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x105059d4a5c0009, likely client has closed socket
   [junit4]   2> 1763959 INFO  
(zkConnectionManagerCallback-3565-thread-1-processing-n:127.0.0.1:36436_solr) 
[n:127.0.0.1:36436_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763959 INFO  (zkConnectionManagerCallback-3563-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1763985 INFO  
(zkConnectionManagerCallback-3567-thread-1-processing-n:127.0.0.1:39473_solr) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1764002 INFO  (jetty-launcher-3532-thread-1) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1764003 INFO  (jetty-launcher-3532-thread-1) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:39473_solr
   [junit4]   2> 1764004 INFO  (jetty-launcher-3532-thread-1) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.Overseer Overseer 
(id=73471142037028876-127.0.0.1:39473_solr-n_0000000000) starting
   [junit4]   2> 1764018 INFO  
(zkConnectionManagerCallback-3575-thread-1-processing-n:127.0.0.1:39473_solr) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1764022 INFO  (jetty-launcher-3532-thread-1) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:36976/solr ready
   [junit4]   2> 1764023 INFO  (jetty-launcher-3532-thread-1) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39473_solr
   [junit4]   2> 1764044 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:39473_solr) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1764064 INFO  
(OverseerStateUpdate-73471142037028876-127.0.0.1:39473_solr-n_0000000000) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1764102 INFO  (jetty-launcher-3532-thread-3) 
[n:127.0.0.1:55694_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1764105 INFO  (jetty-launcher-3532-thread-3) 
[n:127.0.0.1:55694_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1764108 INFO  (jetty-launcher-3532-thread-3) 
[n:127.0.0.1:55694_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:55694_solr
   [junit4]   2> 1764108 INFO  (jetty-launcher-3532-thread-4) 
[n:127.0.0.1:55480_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1764110 INFO  
(zkCallback-3574-thread-1-processing-n:127.0.0.1:39473_solr) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1764117 INFO  
(zkCallback-3566-thread-1-processing-n:127.0.0.1:39473_solr) 
[n:127.0.0.1:39473_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1764117 INFO  
(zkCallback-3555-thread-1-processing-n:127.0.0.1:55694_solr) 
[n:127.0.0.1:55694_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1764120 INFO  (jetty-launcher-3532-thread-4) 
[n:127.0.0.1:55480_solr    ] o.a.s.c.Overseer Overseer (id=null) clo

[...truncated too long message...]

mQuery, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, 
TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, 
SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, 
TestWordDelimiterFilterFactory, TestRemoteStreaming, DocValuesMultiTest, 
CacheHeaderTest, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, 
DocumentAnalysisRequestHandlerTest, TestOmitPositions, 
PathHierarchyTokenizerFactoryTest, FastVectorHighlighterTest, 
LoggingHandlerTest, TestJmxIntegration, MBeansHandlerTest, 
ChaosMonkeyNothingIsSafeTest, AsyncCallRequestStatusResponseTest, 
ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConcurrentCreateRoutedAliasTest, 
DeleteInactiveReplicaTest, DistribJoinFromCollectionTest, 
HttpPartitionOnCommitTest, LeaderFailoverAfterPartitionTest, MoveReplicaTest, 
RecoveryAfterSoftCommitTest, ReplicationFactorTest, SaslZkACLProviderTest, 
SharedFSAutoReplicaFailoverTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, 
TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudJSONFacetJoinDomain, 
TestCloudSearcherWarming, TestConfigSetsAPIExclusivity, 
TestDistribDocBasedVersion, TestPrepRecovery, TestRandomFlRTGCloud, 
TestRandomRequestDistribution, TestSolrCloudWithSecureImpersonation, 
TestStressInPlaceUpdates, ConcurrentDeleteAndCreateCollectionTest, 
CustomCollectionTest, HdfsCollectionsAPIDistributedZkTest, 
TestHdfsCloudBackupRestore, TestReplicaProperties, 
AutoAddReplicasPlanActionTest, ComputePlanActionTest, 
HdfsAutoAddReplicasIntegrationTest, TestPolicyCloud, TestClusterStateProvider, 
TestComputePlanAction, TestDistribStateManager, TestLargeCluster]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLargeCluster 
-Dtests.seed=4D3E8EA5F71E5849 -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.badapples=true -Dtests.locale=ar-SY 
-Dtests.timezone=America/Argentina/ComodRivadavia -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | TestLargeCluster (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster: 
   [junit4]    >    1) Thread[id=29027, 
name=AutoscalingActionExecutor-9740-thread-1, state=RUNNABLE, 
group=TGRP-TestLargeCluster]
   [junit4]    >         at 
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   [junit4]    >         at 
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
   [junit4]    >         at 
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
   [junit4]    >         at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
   [junit4]    >         at 
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
   [junit4]    >         at 
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   [junit4]    >         at 
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.getMatrixCopy(Policy.java:300)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Policy$Session.copy(Policy.java:289)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:122)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$382/636823270.run(Unknown
 Source)
   [junit4]    >         at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]    >         at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]    >         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    >         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/109587478.run(Unknown
 Source)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=29027, 
name=AutoscalingActionExecutor-9740-thread-1, state=RUNNABLE, 
group=TGRP-TestLargeCluster]
   [junit4]    >         at java.util.ArrayList$Itr.<init>(ArrayList.java:840)
   [junit4]    >         at java.util.ArrayList$Itr.<init>(ArrayList.java:840)
   [junit4]    >         at java.util.ArrayList.iterator(ArrayList.java:834)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$null$4(Row.java:189)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$401/1590787792.accept(Unknown
 Source)
   [junit4]    >         at 
java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.lambda$forEachReplica$5(Row.java:188)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row$$Lambda$400/1847711884.accept(Unknown
 Source)
   [junit4]    >         at 
java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:187)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.forEachReplica(Row.java:183)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggestion$ConditionType$1.projectAddReplica(Suggestion.java:185)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Row.addReplica(Row.java:131)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.tryEachNode(MoveReplicaSuggester.java:59)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.MoveReplicaSuggester.init(MoveReplicaSuggester.java:34)
   [junit4]    >         at 
org.apache.solr.client.solrj.cloud.autoscaling.Suggester.getSuggestion(Suggester.java:129)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:98)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)
   [junit4]    >         at 
org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$382/636823270.run(Unknown
 Source)
   [junit4]    >         at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]    >         at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]    >         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    >         at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$119/109587478.run(Unknown
 Source)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([4D3E8EA5F71E5849]:0)
   [junit4] Completed [591/784 (4!)] on J2 in 65.97s, 4 tests, 2 errors <<< 
FAILURES!

[...truncated 8066 lines...]
   [junit4] Suite: org.apache.solr.ltr.TestLTRReRankingPipeline
   [junit4]   2> 11717 INFO  
(TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[69F2C55B7DEE55D9]) [    
] o.a.s.l.TestLTRReRankingPipeline rerank 1 documents 
   [junit4]   2> 11721 INFO  
(TEST-TestLTRReRankingPipeline.testDifferentTopN-seed#[69F2C55B7DEE55D9]) [    
] o.a.s.l.TestLTRReRankingPipeline doc 0 in pos 0
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestLTRReRankingPipeline -Dtests.method=testDifferentTopN 
-Dtests.seed=69F2C55B7DEE55D9 -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.badapples=true -Dtests.locale=fi -Dtests.timezone=GMT0 
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.28s J0 | TestLTRReRankingPipeline.testDifferentTopN <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1.0> but 
was:<0.0>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([69F2C55B7DEE55D9:9853B70B48559F4B]:0)
   [junit4]    >        at 
org.apache.solr.ltr.TestLTRReRankingPipeline.testDifferentTopN(TestLTRReRankingPipeline.java:255)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{field=PostingsFormat(name=Direct), id=Lucene50(blocksize=128), 
final-score=Lucene50(blocksize=128)}, 
docValues:{final-score=DocValuesFormat(name=Lucene70)}, 
maxPointsInLeafNode=1783, maxMBSortInHeap=5.569275488168796, 
sim=RandomSimilarity(queryNorm=false): {field=DFR I(F)B2}, locale=fi, 
timezone=GMT0
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 
1.8.0_144 (64-bit)/cpus=4,threads=1,free=235583616,total=349700096
   [junit4]   2> NOTE: All tests run in this JVM: [TestNoMatchSolrFeature, 
TestLTRReRankingPipeline]
   [junit4] Completed [4/37 (1!)] on J0 in 0.63s, 3 tests, 1 failure <<< 
FAILURES!

[...truncated 42104 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to