Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3018/
Java: 32bit/jdk1.8.0_172 -client -XX:+UseG1GC

3 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
SolrCore.getOpenCount()==1

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==1
        at __randomizedtesting.SeedInfo.seed([F0682DEC2BF4C14F]:0)
        at org.apache.solr.util.TestHarness.close(TestHarness.java:380)
        at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
        at 
org.apache.solr.cloud.AbstractZkTestCase.azt_afterClass(AbstractZkTestCase.java:147)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
4 threads leaked from SUITE scope at 
org.apache.solr.rest.TestManagedResourceStorage:     1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]         at 
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=44, 
name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]         at java.lang.Object.wait(Native 
Method)         at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147) 
   3) Thread[id=46, name=ProcessThread(sid:0 cport:44729):, state=WAITING, 
group=TGRP-TestManagedResourceStorage]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
    4) Thread[id=42, name=Thread-3, state=WAITING, 
group=TGRP-TestManagedResourceStorage]         at java.lang.Object.wait(Native 
Method)         at java.lang.Thread.join(Thread.java:1252)         at 
java.lang.Thread.join(Thread.java:1326)         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
         at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
         at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE 
scope at org.apache.solr.rest.TestManagedResourceStorage: 
   1) Thread[id=43, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, 
state=RUNNABLE, group=TGRP-TestManagedResourceStorage]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=44, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]
        at java.lang.Object.wait(Native Method)
        at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
   3) Thread[id=46, name=ProcessThread(sid:0 cport:44729):, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
   4) Thread[id=42, name=Thread-3, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
        at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
        at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
        at __randomizedtesting.SeedInfo.seed([F0682DEC2BF4C14F]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]         at 
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=43, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, 
state=RUNNABLE, group=TGRP-TestManagedResourceStorage]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([F0682DEC2BF4C14F]:0)




Build Log:
[...truncated 12634 lines...]
   [junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage
   [junit4]   2> 13641 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/init-core-data-001
   [junit4]   2> 13642 WARN  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 13642 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 13644 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 13651 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 13653 INFO  (Thread-3) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 13653 INFO  (Thread-3) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 13725 ERROR (Thread-3) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 13753 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:44729
   [junit4]   2> 13813 INFO  (zkConnectionManagerCallback-6-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13838 INFO  (zkConnectionManagerCallback-8-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 13848 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 13856 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 13858 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 13860 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 13862 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 13864 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 13865 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 13867 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 13869 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 13870 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 13872 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.AbstractZkTestCase put 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 13874 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 13874 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib,
 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 13907 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.6.0
   [junit4]   2> 13936 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 14037 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 15153 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44729/solr
   [junit4]   2> 15169 INFO  (zkConnectionManagerCallback-12-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 15175 INFO  (zkConnectionManagerCallback-14-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 15342 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 88.99.242.108:8983_
   [junit4]   2> 15343 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.Overseer Overseer 
(id=72088391141949443-88.99.242.108:8983_-n_0000000000) starting
   [junit4]   2> 15392 INFO  (zkConnectionManagerCallback-21-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 15394 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 
127.0.0.1:44729/solr ready
   [junit4]   2> 15448 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/88.99.242.108:8983_
   [junit4]   2> 15449 INFO  
(OverseerStateUpdate-72088391141949443-88.99.242.108:8983_-n_0000000000) 
[n:88.99.242.108:8983_    ] o.a.s.c.Overseer Starting to work on the main queue 
: 88.99.242.108:8983_
   [junit4]   2> 15465 INFO  (zkCallback-13-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 15465 INFO  (zkCallback-20-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 15488 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 15504 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1407530
   [junit4]   2> 15504 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1407530
   [junit4]   2> 15505 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1407530
   [junit4]   2> 15511 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 16516 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib,
 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 16550 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.6.0
   [junit4]   2> 16586 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 16704 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 16726 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection collection1, trusted=true
   [junit4]   2> 16726 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.collection1.shard1.88.99.242.108:8983__collection1' (registry 
'solr.core.collection1.shard1.88.99.242.108:8983__collection1') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@1407530
   [junit4]   2> 16726 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.c.SolrCore 
[[collection1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1],
 
dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/init-core-data-001/]
   [junit4]   2> 16733 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: 
minMergeSize=0, mergeFactor=10, maxMergeSize=1634191614, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.1]
   [junit4]   2> 16753 WARN  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class 
[solr.OldLuceneQParserPlugin]. Please consult documentation how to replace it 
accordingly.
   [junit4]   2> 16873 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 16873 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 16881 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 16881 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 16882 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 16883 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@1e39a6a[collection1] main]
   [junit4]   2> 16886 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 17025 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.s.DirectSolrSpellChecker init: 
{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 17146 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 17148 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: default
   [junit4]   2> 17149 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: direct
   [junit4]   2> 17149 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: wordbreak
   [junit4]   2> 17149 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: multipleFields
   [junit4]   2> 17149 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: jarowinkler
   [junit4]   2> 17150 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: external
   [junit4]   2> 17150 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: freq
   [junit4]   2> 17150 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: fqcn
   [junit4]   2> 17151 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for 
spellchecker: perDict
   [junit4]   2> 17153 INFO  
(searcherExecutor-48-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1  
x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@1e39a6a[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 17157 INFO  
(coreLoadExecutor-47-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1  x:collection1] o.a.s.u.UpdateLog 
Could not find max version in index or recent updates, using new clock 
1615955941259214848
   [junit4]   2> 17167 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 17173 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###Starting 
testZkBasedJsonStorage
   [junit4]   2> 17176 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Configured 
ZooKeeperStorageIO with znodeBase: /test
   [junit4]   2> 17177 INFO  
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ZkShardTerms 
Successful update of terms at /collections/collection1/terms/shard1 to 
Terms{values={88.99.242.108:8983__collection1=0}, version=0}
   [junit4]   2> 17178 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Wrote 136 bytes to 
new znode /test/_test_foo.json
   [junit4]   2> 17178 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Saved JSON object 
to path _test_foo.json using ZooKeeperStorageIO:path=/test
   [junit4]   2> 17179 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Loaded 
LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test
   [junit4]   2> 17181 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Wrote 175 bytes to 
existing znode /test/_test_foo.json
   [junit4]   2> 17181 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Saved JSON object 
to path _test_foo.json using ZooKeeperStorageIO:path=/test
   [junit4]   2> 17181 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Loaded 
LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test
   [junit4]   2> 17182 INFO  
(TEST-TestManagedResourceStorage.testZkBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###Ending 
testZkBasedJsonStorage
   [junit4]   2> 17188 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###Starting 
testFileBasedJsonStorage
   [junit4]   2> 17189 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage File-based storage 
initialized to use dir: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/json-storage-001/managed
   [junit4]   2> 17189 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Saved JSON object 
to path _test_foo.json using 
file:dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/json-storage-001/managed
   [junit4]   2> 17189 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Loaded 
LinkedHashMap at path _test_foo.json using 
file:dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/json-storage-001/managed
   [junit4]   2> 17190 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Saved JSON object 
to path _test_foo.json using 
file:dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/json-storage-001/managed
   [junit4]   2> 17190 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.r.ManagedResourceStorage Loaded 
LinkedHashMap at path _test_foo.json using 
file:dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.rest.TestManagedResourceStorage_F0682DEC2BF4C14F-001/json-storage-001/managed
   [junit4]   2> 17190 INFO  
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 17190 INFO  
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 17190 INFO  
(TEST-TestManagedResourceStorage.testFileBasedJsonStorage-seed#[F0682DEC2BF4C14F])
 [n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###Ending 
testFileBasedJsonStorage
   [junit4]   2> 17191 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 17191 INFO  
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Found all replicas participating in 
election, clear LIR
   [junit4]   2> 17191 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 17192 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.CoreContainer Shutting down CoreContainer 
instance=29109675
   [junit4]   2> 17192 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.SolrMetricManager Closing metric reporters 
for registry=solr.node, tag=null
   [junit4]   2> 17192 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@84ff93: rootName = null, 
domain = solr.node, service url = null, agent id = null] for registry solr.node 
/ com.codahale.metrics.MetricRegistry@15933a6
   [junit4]   2> 17210 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.SolrMetricManager Closing metric reporters 
for registry=solr.jvm, tag=null
   [junit4]   2> 17210 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1a6321a: rootName = null, 
domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / 
com.codahale.metrics.MetricRegistry@326
   [junit4]   2> 17211 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.SolrMetricManager Closing metric reporters 
for registry=solr.jetty, tag=null
   [junit4]   2> 17211 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@e2e28e: rootName = null, 
domain = solr.jetty, service url = null, agent id = null] for registry 
solr.jetty / com.codahale.metrics.MetricRegistry@9aec41
   [junit4]   2> 17213 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/88.99.242.108:8983_
   [junit4]   2> 17214 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.m.SolrMetricManager Closing metric reporters 
for registry=solr.cluster, tag=null
   [junit4]   2> 17214 INFO  (zkCallback-13-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 17214 INFO  
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://88.99.242.108:8983/collection1/ shard1
   [junit4]   2> 17215 INFO  (zkCallback-20-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 17215 INFO  
(coreCloseExecutor-53-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 
x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@1dfdf56
   [junit4]   2> 17215 INFO  
(coreCloseExecutor-53-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 
x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.core.collection1.shard1.88.99.242.108:8983__collection1, 
tag=1dfdf56
   [junit4]   2> 17216 INFO  
(coreCloseExecutor-53-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 
x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@fd9711: rootName = null, 
domain = solr.core.collection1.shard1.88.99.242.108:8983__collection1, service 
url = null, agent id = null] for registry 
solr.core.collection1.shard1.88.99.242.108:8983__collection1 / 
com.codahale.metrics.MetricRegistry@1bf6d7f
   [junit4]   2> 17242 INFO  
(coreCloseExecutor-53-thread-1-processing-n:88.99.242.108:8983_) 
[n:88.99.242.108:8983_ c:collection1 s:shard1 r:88.99.242.108:8983__collection1 
x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.collection.collection1.shard1.leader, tag=1dfdf56
   [junit4]   2> 17244 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.c.Overseer Overseer 
(id=72088391141949443-88.99.242.108:8983_-n_0000000000) closing
   [junit4]   2> 17245 WARN  
(OverseerAutoScalingTriggerThread-72088391141949443-88.99.242.108:8983_-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 17244 INFO  
(OverseerStateUpdate-72088391141949443-88.99.242.108:8983_-n_0000000000) 
[n:88.99.242.108:8983_    ] o.a.s.c.Overseer Overseer Loop exiting : 
88.99.242.108:8983_
   [junit4]   2> 17266 ERROR 
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ZkController Error 
getting leader from zk
   [junit4]   2> org.apache.solr.common.SolrException: No registered leader was 
found after waiting for 1560000ms , collection: collection1 slice: shard1 saw 
state=DocCollection(collection1//clusterstate.json/1)={
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "parent":null,
   [junit4]   2>       "range":null,
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"88.99.242.108:8983__collection1":{
   [junit4]   2>           "core":"collection1",
   [junit4]   2>           "base_url":"http://88.99.242.108:8983";,
   [junit4]   2>           "node_name":"88.99.242.108:8983_",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}},
   [junit4]   2>   "router":{"name":"implicit"}} with live_nodes=[]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:866)
 ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:831) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1270) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.register(ZkController.java:1150) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.register(ZkController.java:1081) ~[java/:?]
   [junit4]   2>        at 
org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:187) 
~[java/:?]
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
 ~[java/:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 17273 ERROR 
(coreZkRegister-35-thread-1-processing-n:88.99.242.108:8983_ x:collection1 
c:collection1 s:shard1) [n:88.99.242.108:8983_ c:collection1 s:shard1 
r:88.99.242.108:8983__collection1 x:collection1] o.a.s.c.ZkContainer 
:org.apache.solr.common.SolrException: Error getting leader from zk for shard 
shard1
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1299)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.register(ZkController.java:1150)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.register(ZkController.java:1081)
   [junit4]   2>        at 
org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:187)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered 
leader was found after waiting for 1560000ms , collection: collection1 slice: 
shard1 saw state=DocCollection(collection1//clusterstate.json/1)={
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "parent":null,
   [junit4]   2>       "range":null,
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"88.99.242.108:8983__collection1":{
   [junit4]   2>           "core":"collection1",
   [junit4]   2>           "base_url":"http://88.99.242.108:8983";,
   [junit4]   2>           "node_name":"88.99.242.108:8983_",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}},
   [junit4]   2>   "router":{"name":"implicit"}} with live_nodes=[]
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:866)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:831)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1270)
   [junit4]   2>        ... 7 more
   [junit4]   2> 
   [junit4]   2> 17273 INFO  
(SUITE-TestManagedResourceStorage-seed#[F0682DEC2BF4C14F]-worker) 
[n:88.99.242.108:8983_    ] o.a.s.SolrTestCaseJ4 
------------------------------------------------------- Done waiting for 
tracked resources to be released
   [junit4]   2> Nov 01, 2018 6:07:57 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 6 leaked 
thread(s).
   [junit4]   2> Nov 01, 2018 6:09:17 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 4 threads leaked from SUITE scope at 
org.apache.solr.rest.TestManagedResourceStorage: 
   [junit4]   2>    1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native 
Method)
   [junit4]   2>         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   [junit4]   2>         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   [junit4]   2>         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]   2>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]   2>         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    2) Thread[id=44, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
   [junit4]   2>    3) Thread[id=46, name=ProcessThread(sid:0 cport:44729):, 
state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
   [junit4]   2>    4) Thread[id=42, name=Thread-3, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1252)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1326)
   [junit4]   2>         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
   [junit4]   2>         at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
   [junit4]   2>         at 
org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
   [junit4]   2> Nov 01, 2018 6:09:17 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2>    2) Thread[id=44, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2>    3) Thread[id=46, name=ProcessThread(sid:0 cport:44729):, 
state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]   2>    4) Thread[id=42, name=Thread-3, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2> 97339 ERROR (SessionTracker) [    ] 
o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : 
SessionTracker
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at java.lang.Object.wait(Native Method) ~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147) 
[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2> 97339 ERROR (ProcessThread(sid:0 cport:44729):) [    ] 
o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : 
ProcessThread(sid:0 cport:44729):
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
 ~[?:1.8.0_172]
   [junit4]   2>        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) 
~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
 [zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2> 97339 ERROR (SessionTracker) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 97339 ERROR (ProcessThread(sid:0 cport:44729):) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 97341 WARN  (Thread-3) [    ] o.a.s.c.ZkTestServer Server 
interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at java.lang.Object.wait(Native Method) ~[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.join(Thread.java:1252) 
~[?:1.8.0_172]
   [junit4]   2>        at java.lang.Thread.join(Thread.java:1326) 
~[?:1.8.0_172]
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
 ~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
 [java/:?]
   [junit4]   2>        at 
org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496) [java/:?]
   [junit4]   2> Nov 01, 2018 6:09:20 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]
   [junit4]   2>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native 
Method)
   [junit4]   2>         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   [junit4]   2>         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   [junit4]   2>         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]   2>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]   2>         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=RandomSimilarity(queryNorm=true): {}, locale=lt, timezone=Pacific/Auckland
   [junit4]   2> NOTE: Linux 4.15.0-38-generic i386/Oracle Corporation 
1.8.0_172 (32-bit)/cpus=8,threads=3,free=16106976,total=90177536
   [junit4]   2> NOTE: All tests run in this JVM: [TestComponentsName, 
TestSubQueryTransformerCrossCore, TestManagedResourceStorage]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestManagedResourceStorage -Dtests.seed=F0682DEC2BF4C14F 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lt 
-Dtests.timezone=Pacific/Auckland -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestManagedResourceStorage (suite) <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: 
SolrCore.getOpenCount()==1
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F0682DEC2BF4C14F]:0)
   [junit4]    >        at 
org.apache.solr.util.TestHarness.close(TestHarness.java:380)
   [junit4]    >        at 
org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractZkTestCase.azt_afterClass(AbstractZkTestCase.java:147)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE 
scope at org.apache.solr.rest.TestManagedResourceStorage: 
   [junit4]    >    1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.nio.ch.EPollArrayWrapper.epollWait(Native 
Method)
   [junit4]    >         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   [junit4]    >         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   [junit4]    >         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    2) Thread[id=44, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
   [junit4]    >    3) Thread[id=46, name=ProcessThread(sid:0 cport:44729):, 
state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
   [junit4]    >    4) Thread[id=42, name=Thread-3, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at java.lang.Thread.join(Thread.java:1252)
   [junit4]    >         at java.lang.Thread.join(Thread.java:1326)
   [junit4]    >         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
   [junit4]    >         at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
   [junit4]    >         at 
org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F0682DEC2BF4C14F]:0)Throwable #3: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=43, 
name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.nio.ch.EPollArrayWrapper.epollWait(Native 
Method)
   [junit4]    >         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   [junit4]    >         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
   [junit4]    >         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F0682DEC2BF4C14F]:0)
   [junit4] Completed [27/836 (1!)] on J1 in 86.73s, 2 tests, 3 errors <<< 
FAILURES!

[...truncated 47725 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3018/consoleText

[repro] Revision: 50e10d327428ea05df493e6bcd62aaeccb7ec0b9

[repro] Ant options: "-Dargs=-client -XX:+UseG1GC"
[repro] Repro line:  ant test  -Dtestcase=TestManagedResourceStorage 
-Dtests.seed=F0682DEC2BF4C14F -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=lt -Dtests.timezone=Pacific/Auckland -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestManagedResourceStorage
[repro] ant compile-test

[...truncated 3580 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.TestManagedResourceStorage" -Dtests.showOutput=onerror 
"-Dargs=-client -XX:+UseG1GC" -Dtests.seed=F0682DEC2BF4C14F 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lt 
-Dtests.timezone=Pacific/Auckland -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[...truncated 76 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.rest.TestManagedResourceStorage
[repro] Exiting with code 0

[...truncated 40 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to