Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1580/

4 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3]:0)


FAILED:  
org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes

Error Message:


Stack Trace:
java.lang.NullPointerException
        at 
__randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3:73579C7C71FBEC2B]:0)
        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
        at 
org.apache.solr.cloud.TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes(TestDeleteCollectionOnDownNodes.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.search.mlt.SimpleMLTQParserTest.doTest

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
        at 
__randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3:4A2640203A63B31A]:0)
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:917)
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:877)
        at 
org.apache.solr.search.mlt.SimpleMLTQParserTest.doTest(SimpleMLTQParserTest.java:82)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: 
xpath=//result/doc[1]/str[@name='id'][.='13']
        xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int 
name="QTime">394</int></lst><result name="response" numFound="16" 
start="0"><doc><str name="id">16</str><arr 
name="range_facet_l"><long>16</long></arr><int name="id_i1">16</int><arr 
name="range_facet_l_dv"><long>16</long></arr><arr 
name="range_facet_i_dv"><int>16</int></arr><arr name="lowerfilt"><str>The slim 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The slim red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.959Z</date><long 
name="_version_">1605498167056400384</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">18</str><arr 
name="range_facet_l"><long>18</long></arr><int name="id_i1">18</int><arr 
name="range_facet_l_dv"><long>18</long></arr><arr 
name="range_facet_i_dv"><int>18</int></arr><arr name="lowerfilt"><str>The quote 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.960Z</date><long 
name="_version_">1605498167057448960</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">19</str><arr 
name="range_facet_l"><long>19</long></arr><int name="id_i1">19</int><arr 
name="range_facet_l_dv"><long>19</long></arr><arr 
name="range_facet_i_dv"><int>19</int></arr><arr name="lowerfilt"><str>The hose 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The hose red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.960Z</date><long 
name="_version_">1605498167057448961</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">20</str><arr 
name="range_facet_l"><long>20</long></arr><int name="id_i1">20</int><arr 
name="range_facet_l_dv"><long>20</long></arr><arr 
name="range_facet_i_dv"><int>20</int></arr><arr name="lowerfilt"><str>The quote 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.960Z</date><long 
name="_version_">1605498167057448962</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">21</str><arr 
name="range_facet_l"><long>21</long></arr><int name="id_i1">21</int><arr 
name="range_facet_l_dv"><long>21</long></arr><arr 
name="range_facet_i_dv"><int>21</int></arr><arr name="lowerfilt"><str>The court 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The court red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.961Z</date><long 
name="_version_">1605498167058497536</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">22</str><arr 
name="range_facet_l"><long>22</long></arr><int name="id_i1">22</int><arr 
name="range_facet_l_dv"><long>22</long></arr><arr 
name="range_facet_i_dv"><int>22</int></arr><arr name="lowerfilt"><str>The quote 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.961Z</date><long 
name="_version_">1605498167058497537</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">23</str><arr 
name="range_facet_l"><long>23</long></arr><int name="id_i1">23</int><arr 
name="range_facet_l_dv"><long>23</long></arr><arr 
name="range_facet_i_dv"><int>23</int></arr><arr name="lowerfilt"><str>The quote 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.961Z</date><long 
name="_version_">1605498167076323328</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">24</str><arr 
name="range_facet_l"><long>24</long></arr><int name="id_i1">24</int><arr 
name="range_facet_l_dv"><long>24</long></arr><arr 
name="range_facet_i_dv"><int>24</int></arr><arr name="lowerfilt"><str>The file 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The file red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.978Z</date><long 
name="_version_">1605498167076323329</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">13</str><arr 
name="range_facet_l"><long>13</long></arr><int name="id_i1">13</int><arr 
name="range_facet_l_dv"><long>13</long></arr><arr 
name="range_facet_i_dv"><int>13</int></arr><arr name="lowerfilt"><str>The quote 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.851Z</date><long 
name="_version_">1605498166943154177</long><int 
name="intDvoDefault">42</int></doc><doc><str name="id">14</str><arr 
name="range_facet_l"><long>14</long></arr><int name="id_i1">14</int><arr 
name="range_facet_l_dv"><long>14</long></arr><arr 
name="range_facet_i_dv"><int>14</int></arr><arr name="lowerfilt"><str>The quote 
red fox jumped over the lazy brown dogs.</str></arr><arr 
name="lowerfilt1and2"><str>The quote red fox jumped over the lazy brown 
dogs.</str></arr><arr name="multiDefault"><str>muLti-Default</str></arr><int 
name="intDefault">42</int><date 
name="timestamp">2018-07-09T07:46:06.884Z</date><long 
name="_version_">1605498166977757184</long><int 
name="intDvoDefault">42</int></doc></result>
</response>

        request was:q={!mlt+qf%3Dlowerfilt}17
        at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:910)
        ... 41 more




Build Log:
[...truncated 14825 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestDeleteCollectionOnDownNodes
   [junit4]   2> 4795802 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/init-core-data-001
   [junit4]   2> 4795803 WARN  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=13 numCloses=13
   [junit4]   2> 4795803 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 4795822 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 4795823 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001
   [junit4]   2> 4795823 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4795823 INFO  (Thread-15089) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4795823 INFO  (Thread-15089) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 4795825 ERROR (Thread-15089) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 4795924 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:33482
   [junit4]   2> 4796033 INFO  (zkConnectionManagerCallback-65718-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4796108 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 4796144 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 4796160 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 4796160 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 4796216 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 4796216 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 4796216 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 4796217 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2bd06f04{/solr,null,AVAILABLE}
   [junit4]   2> 4796253 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 4796253 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 4796253 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 4796289 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 4796289 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 4796290 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 4796362 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3228bd0f{/solr,null,AVAILABLE}
   [junit4]   2> 4796363 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3daafdcd{/solr,null,AVAILABLE}
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@5808a672{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.e.j.s.Server Started @???????ms
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=40769}
   [junit4]   2> 4796445 ERROR (jetty-launcher-65715-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 4796445 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-07-09T06:48:51.235Z
   [junit4]   2> 4796452 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 4796452 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 4796452 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 4796489 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@2cad898a{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 4796489 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.e.j.s.Server Started @???????ms
   [junit4]   2> 4796489 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=38417}
   [junit4]   2> 4796490 ERROR (jetty-launcher-65715-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 4796490 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 4796490 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 4796490 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 4796490 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 4796490 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-07-09T06:48:51.280Z
   [junit4]   2> 4796509 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@1a175782{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 4796509 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.e.j.s.Server Started @???????ms
   [junit4]   2> 4796509 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=42621}
   [junit4]   2> 4796509 ERROR (jetty-launcher-65715-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 4796510 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 4796510 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 4796510 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 4796510 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 4796510 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-07-09T06:48:51.300Z
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@13dfdfed{/solr,null,AVAILABLE}
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7cdf986e{HTTP/1.1,[http/1.1]}{127.0.0.1:?????}
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.e.j.s.Server Started @???????ms
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=43508}
   [junit4]   2> 4796555 ERROR (jetty-launcher-65715-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 4796555 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-07-09T06:48:51.345Z
   [junit4]   2> 4796582 INFO  (zkConnectionManagerCallback-65720-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4796583 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 4796618 INFO  (zkConnectionManagerCallback-65724-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4796619 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 4796707 INFO  (zkConnectionManagerCallback-65722-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4796891 INFO  (zkConnectionManagerCallback-65726-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4796927 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 4796927 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 4798871 INFO  (jetty-launcher-65715-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
   [junit4]   2> 4798939 INFO  (zkConnectionManagerCallback-65730-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4799071 INFO  (jetty-launcher-65715-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
   [junit4]   2> 4799199 INFO  (zkConnectionManagerCallback-65734-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4799211 INFO  (zkConnectionManagerCallback-65736-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4799337 INFO  (zkConnectionManagerCallback-65738-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4799875 INFO  (jetty-launcher-65715-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
   [junit4]   2> 4800000 INFO  (zkConnectionManagerCallback-65746-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4800187 INFO  (zkConnectionManagerCallback-65748-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4800403 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4800403 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:43508_solr
   [junit4]   2> 4800404 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.Overseer Overseer 
(id=72939468182454280-127.0.0.1:43508_solr-n_0000000000) starting
   [junit4]   2> 4800472 INFO  (jetty-launcher-65715-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33482/solr
   [junit4]   2> 4800493 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4800493 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:42621_solr
   [junit4]   2> 4800508 INFO  (zkConnectionManagerCallback-65754-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4800549 INFO  (zkCallback-65737-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4800569 INFO  (zkCallback-65747-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4800642 INFO  (zkConnectionManagerCallback-65759-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4800662 INFO  (zkConnectionManagerCallback-65761-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4800715 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 4801142 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:33482/solr ready
   [junit4]   2> 4801257 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 4801259 INFO  (zkConnectionManagerCallback-65768-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4801275 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 4801275 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 4801275 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:43508_solr
   [junit4]   2> 4801277 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 4801277 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion -1
   [junit4]   2> 4801277 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 1
   [junit4]   2> 4801294 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:33482/solr ready
   [junit4]   2> 4801296 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 4801389 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 4801423 INFO  (zkCallback-65747-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4801460 INFO  (zkCallback-65767-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4801478 INFO  (zkCallback-65737-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4801478 INFO  (zkCallback-65758-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4801609 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4801622 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:42621_solr, 127.0.0.1:43508_solr]
   [junit4]   2> 4801623 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 4801691 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 4801712 DEBUG 
(OverseerAutoScalingTriggerThread-72939468182454280-127.0.0.1:43508_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion 1
   [junit4]   2> 4801858 DEBUG (ScheduledTrigger-12671-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 4801865 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42621.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4801874 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 4801953 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 4801953 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40769_solr
   [junit4]   2> 4801969 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42621.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4801969 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42621.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4801970 INFO  (jetty-launcher-65715-thread-1) 
[n:127.0.0.1:42621_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/.
   [junit4]   2> 4801972 INFO  (zkCallback-65767-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4801972 INFO  (zkCallback-65747-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4802025 INFO  (zkCallback-65737-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4801990 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43508.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4802025 INFO  (zkCallback-65760-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4802062 INFO  (zkCallback-65758-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4802064 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4802114 INFO  (zkCallback-65735-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4802122 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43508.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4802122 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43508.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4802135 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 4802135 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38417_solr
   [junit4]   2> 4802188 INFO  (zkCallback-65747-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4802188 INFO  (zkCallback-65760-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4802188 INFO  (zkCallback-65735-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4802189 INFO  (zkCallback-65737-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4802191 INFO  (zkCallback-65758-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4802191 INFO  (zkCallback-65767-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4802192 INFO  (jetty-launcher-65715-thread-4) 
[n:127.0.0.1:43508_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/.
   [junit4]   2> 4802391 INFO  (zkConnectionManagerCallback-65776-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4802411 INFO  (zkConnectionManagerCallback-65780-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4802464 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 4802485 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 4802537 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:33482/solr ready
   [junit4]   2> 4802574 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 4802700 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:33482/solr ready
   [junit4]   2> 4802720 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 4802993 DEBUG (ScheduledTrigger-12671-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4803033 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40769.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4803145 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38417.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4803284 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40769.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4803284 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40769.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4803358 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38417.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4803358 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38417.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4803376 INFO  (jetty-launcher-65715-thread-3) 
[n:127.0.0.1:40769_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/.
   [junit4]   2> 4803473 INFO  (jetty-launcher-65715-thread-2) 
[n:127.0.0.1:38417_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/.
   [junit4]   2> 4803852 INFO  (zkConnectionManagerCallback-65784-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4803878 INFO  (zkConnectionManagerCallback-65789-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 4803920 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 4803922 INFO  
(SUITE-TestDeleteCollectionOnDownNodes-seed#[ED62F88457D8A0A3]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33482/solr ready
   [junit4]   2> 4804086 DEBUG (ScheduledTrigger-12671-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4804490 INFO  
(TEST-TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes-seed#[ED62F88457D8A0A3])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionWithDownNodes
   [junit4]   2> 4804518 INFO  (qtp1578527410-139817) [n:127.0.0.1:42621_solr   
 ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf&maxShardsPerNode=3&name=halfdeletedcollection2&nrtReplicas=3&action=CREATE&numShards=4&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 4804547 INFO  (OverseerThreadFactory-12673-thread-1) [    ] 
o.a.s.c.a.c.CreateCollectionCmd Create collection halfdeletedcollection2
   [junit4]   2> 4804695 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"halfdeletedcollection2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43508/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804730 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"halfdeletedcollection2_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40769/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804767 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"halfdeletedcollection2_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38417/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804769 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"halfdeletedcollection2_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:42621/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804824 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"halfdeletedcollection2_shard2_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43508/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804826 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"halfdeletedcollection2_shard2_replica_n10",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40769/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804859 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"halfdeletedcollection2_shard3_replica_n12",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38417/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804863 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"halfdeletedcollection2_shard3_replica_n14",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:42621/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804898 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"halfdeletedcollection2_shard3_replica_n17",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43508/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804914 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"halfdeletedcollection2_shard4_replica_n18",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40769/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804933 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"halfdeletedcollection2_shard4_replica_n20",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38417/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4804935 INFO  
(OverseerStateUpdate-72939468182454280-127.0.0.1:43508_solr-n_0000000000) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfdeletedcollection2",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"halfdeletedcollection2_shard4_replica_n22",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:42621/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 4805091 DEBUG (ScheduledTrigger-12671-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4805201 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr   
 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard1_replica_n3&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805255 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr   
 x:halfdeletedcollection2_shard4_replica_n18] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard4_replica_n18&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805255 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr   
 x:halfdeletedcollection2_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard1_replica_n1&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805256 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr   
 x:halfdeletedcollection2_shard3_replica_n14] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node16&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard3_replica_n14&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805256 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr   
 x:halfdeletedcollection2_shard3_replica_n14] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 4805257 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr   
 x:halfdeletedcollection2_shard2_replica_n10] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node13&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard2_replica_n10&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805257 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr   
 x:halfdeletedcollection2_shard4_replica_n22] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node24&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard4_replica_n22&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805384 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr    
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard1_replica_n4&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805531 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr   
 x:halfdeletedcollection2_shard2_replica_n8] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node11&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard2_replica_n8&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805532 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr   
 x:halfdeletedcollection2_shard3_replica_n17] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node19&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard3_replica_n17&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805533 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr    
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node23&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard4_replica_n20&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805550 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr   
 x:halfdeletedcollection2_shard2_replica_n6] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node9&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard2_replica_n6&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4805562 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr    
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&coreNodeName=core_node15&collection.configName=conf&newCollection=true&name=halfdeletedcollection2_shard3_replica_n12&action=CREATE&numShards=4&collection=halfdeletedcollection2&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 4806094 DEBUG (ScheduledTrigger-12671-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4806315 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4806482 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard1_replica_n3] Schema name=minimal
   [junit4]   2> 4806518 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4806518 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard1_replica_n3' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4806519 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_40769.solr.core.halfdeletedcollection2.shard1.replica_n3' 
(registry 'solr.core.halfdeletedcollection2.shard1.replica_n3') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4806519 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4806519 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard1_replica_n3] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/halfdeletedcollection2_shard1_replica_n3],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/./halfdeletedcollection2_shard1_replica_n3/data/]
   [junit4]   2> 4807374 DEBUG (ScheduledTrigger-12671-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4807466 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807482 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807502 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807536 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807611 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807556 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807626 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807675 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 4807685 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4807692 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4807692 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard1_replica_n1' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4807692 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_43508.solr.core.halfdeletedcollection2.shard1.replica_n1' 
(registry 'solr.core.halfdeletedcollection2.shard1.replica_n1') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4807692 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4807692 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard1_replica_n1] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/halfdeletedcollection2_shard1_replica_n1],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/./halfdeletedcollection2_shard1_replica_n1/data/]
   [junit4]   2> 4807700 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard3_replica_n12] Schema name=minimal
   [junit4]   2> 4808029 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4808048 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808048 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard3_replica_n12' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808049 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_38417.solr.core.halfdeletedcollection2.shard3.replica_n12' 
(registry 'solr.core.halfdeletedcollection2.shard3.replica_n12') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808049 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808049 INFO  (qtp837502291-139803) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard3 r:core_node15 
x:halfdeletedcollection2_shard3_replica_n12] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard3_replica_n12] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/halfdeletedcollection2_shard3_replica_n12],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/./halfdeletedcollection2_shard3_replica_n12/data/]
   [junit4]   2> 4808057 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4808077 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.SolrConfig Using Lucene 
MatchVersion: 8.0.0
   [junit4]   2> 4808095 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard4_replica_n22] Schema name=minimal
   [junit4]   2> 4808098 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard1_replica_n4] Schema name=minimal
   [junit4]   2> 4808121 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard2_replica_n10] Schema name=minimal
   [junit4]   2> 4808123 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808123 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard2_replica_n10' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808124 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_40769.solr.core.halfdeletedcollection2.shard2.replica_n10' 
(registry 'solr.core.halfdeletedcollection2.shard2.replica_n10') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808124 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808124 INFO  (qtp1110224962-139794) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard2 r:core_node13 
x:halfdeletedcollection2_shard2_replica_n10] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard2_replica_n10] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/halfdeletedcollection2_shard2_replica_n10],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/./halfdeletedcollection2_shard2_replica_n10/data/]
   [junit4]   2> 4808158 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard4_replica_n20] Schema name=minimal
   [junit4]   2> 4808160 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808160 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard4_replica_n20' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808160 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_38417.solr.core.halfdeletedcollection2.shard4.replica_n20' 
(registry 'solr.core.halfdeletedcollection2.shard4.replica_n20') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808160 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808161 INFO  (qtp837502291-139810) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard4 r:core_node23 
x:halfdeletedcollection2_shard4_replica_n20] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard4_replica_n20] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/halfdeletedcollection2_shard4_replica_n20],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/./halfdeletedcollection2_shard4_replica_n20/data/]
   [junit4]   2> 4808169 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808169 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard1_replica_n4' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808170 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_38417.solr.core.halfdeletedcollection2.shard1.replica_n4' 
(registry 'solr.core.halfdeletedcollection2.shard1.replica_n4') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808170 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808170 INFO  (qtp837502291-139808) [n:127.0.0.1:38417_solr 
c:halfdeletedcollection2 s:shard1 r:core_node7 
x:halfdeletedcollection2_shard1_replica_n4] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard1_replica_n4] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/halfdeletedcollection2_shard1_replica_n4],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node2/./halfdeletedcollection2_shard1_replica_n4/data/]
   [junit4]   2> 4808173 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard4_replica_n18] Schema name=minimal
   [junit4]   2> 4808482 DEBUG (ScheduledTrigger-12671-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4808528 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808528 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard4_replica_n22' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808529 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_42621.solr.core.halfdeletedcollection2.shard4.replica_n22' 
(registry 'solr.core.halfdeletedcollection2.shard4.replica_n22') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808529 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808529 INFO  (qtp1578527410-139812) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard4 r:core_node24 
x:halfdeletedcollection2_shard4_replica_n22] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard4_replica_n22] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/halfdeletedcollection2_shard4_replica_n22],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/./halfdeletedcollection2_shard4_replica_n22/data/]
   [junit4]   2> 4808564 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808564 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard4_replica_n18' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808564 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_40769.solr.core.halfdeletedcollection2.shard4.replica_n18' 
(registry 'solr.core.halfdeletedcollection2.shard4.replica_n18') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808564 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808564 INFO  (qtp1110224962-139795) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard4 r:core_node21 
x:halfdeletedcollection2_shard4_replica_n18] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard4_replica_n18] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/halfdeletedcollection2_shard4_replica_n18],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node3/./halfdeletedcollection2_shard4_replica_n18/data/]
   [junit4]   2> 4808582 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard3_replica_n14] Schema name=minimal
   [junit4]   2> 4808602 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 4808618 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard3_replica_n17] Schema name=minimal
   [junit4]   2> 4808620 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808620 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard3_replica_n17' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808637 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_43508.solr.core.halfdeletedcollection2.shard3.replica_n17' 
(registry 'solr.core.halfdeletedcollection2.shard3.replica_n17') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808637 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808637 INFO  (qtp1121055659-139822) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard3 r:core_node19 
x:halfdeletedcollection2_shard3_replica_n17] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard3_replica_n17] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/halfdeletedcollection2_shard3_replica_n17],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/./halfdeletedcollection2_shard3_replica_n17/data/]
   [junit4]   2> 4808690 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808690 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard3_replica_n14' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808690 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_42621.solr.core.halfdeletedcollection2.shard3.replica_n14' 
(registry 'solr.core.halfdeletedcollection2.shard3.replica_n14') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808691 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808691 INFO  (qtp1578527410-139813) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard3 r:core_node16 
x:halfdeletedcollection2_shard3_replica_n14] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard3_replica_n14] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/halfdeletedcollection2_shard3_replica_n14],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/./halfdeletedcollection2_shard3_replica_n14/data/]
   [junit4]   2> 4808711 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.s.IndexSchema 
[halfdeletedcollection2_shard2_replica_n8] Schema name=minimal
   [junit4]   2> 4808713 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808713 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard2_replica_n8' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808713 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_43508.solr.core.halfdeletedcollection2.shard2.replica_n8' 
(registry 'solr.core.halfdeletedcollection2.shard2.replica_n8') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808713 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808713 INFO  (qtp1121055659-139827) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard2 r:core_node11 
x:halfdeletedcollection2_shard2_replica_n8] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard2_replica_n8] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/halfdeletedcollection2_shard2_replica_n8],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node4/./halfdeletedcollection2_shard2_replica_n8/data/]
   [junit4]   2> 4808747 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema 
minimal/1.1 with uniqueid field id
   [junit4]   2> 4808748 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.CoreContainer Creating 
SolrCore 'halfdeletedcollection2_shard2_replica_n6' using configuration from 
collection halfdeletedcollection2, trusted=true
   [junit4]   2> 4808748 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX 
monitoring for 'solr_42621.solr.core.halfdeletedcollection2.shard2.replica_n6' 
(registry 'solr.core.halfdeletedcollection2.shard2.replica_n6') enabled at 
server: com.sun.jmx.mbeanserver.JmxMBeanServer@73682d16
   [junit4]   2> 4808748 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 4808748 INFO  (qtp1578527410-139815) [n:127.0.0.1:42621_solr 
c:halfdeletedcollection2 s:shard2 r:core_node9 
x:halfdeletedcollection2_shard2_replica_n6] o.a.s.c.SolrCore 
[[halfdeletedcollection2_shard2_replica_n6] ] Opening new SolrCore at 
[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/halfdeletedcollection2_shard2_replica_n6],
 
dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.TestDeleteCollectionOnDownNodes_ED62F88457D8A0A3-001/tempDir-001/node1/./halfdeletedcollection2_shard2_replica_n6/data/]
   [junit4]   2> 4809469 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 4809469 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 4809470 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 4809805 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 4809807 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@471e7fc7[halfdeletedcollection2_shard1_replica_n3] main]
   [junit4]   2> 4809826 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.r.ManagedResourceStorage 
Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 4809826 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.r.ManagedResourceStorage 
Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 4809827 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits 
will be reserved for 10000ms.
   [junit4]   2> 4809827 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core_node5 
x:halfdeletedcollection2_shard1_replica_n3] o.a.s.u.UpdateLog Could not find 
max version in index or recent updates, using new clock 1605494578470715392
   [junit4]   2> 4809841 INFO  
(searcherExecutor-12689-thread-1-processing-n:127.0.0.1:40769_solr 
x:halfdeletedcollection2_shard1_replica_n3 c:halfdeletedcollection2 s:shard1 
r:core_node5) [n:127.0.0.1:40769_solr c:halfdeletedcollection2 s:shard1 
r:core_node5 x:halfdeletedcollection2_shard1_replica_n3] o.a.s.c.SolrCore 
[halfdeletedcollection2_shard1_replica_n3] Registered new searcher 
Searcher@471e7fc7[halfdeletedcollection2_shard1_replica_n3] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4809848 DEBUG (ScheduledTrigger-12671-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4
   [junit4]   2> 4809981 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 4809981 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing 
UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 
maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 4809982 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 4809982 INFO  (qtp1121055659-139826) [n:127.0.0.1:43508_solr 
c:halfdeletedcollection2 s:shard1 r:core_node2 
x:halfdeletedcollection2_shard1_replica_n1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 4810008 INFO  (qtp1110224962-139799) [n:127.0.0.1:40769_solr 
c:halfdeletedcollection2 s:shard1 r:core

[...truncated too long message...]

lteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 
40parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
14parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
20parent_f2_s=Lucene50(blocksize=128), 34parent_f1_s=Lucene50(blocksize=128), 
24parent_f1_s=FST50, 
30parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 5parent_f1_s=Lucene50(blocksize=128), 6grand0_s=FST50, 10parent_f2_s=FST50, 
8parent_f1_s=FST50, 
27parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 2parent_f2_s=Lucene50(blocksize=128), 
4child1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
2grand1_s=Lucene50(blocksize=128), 17parent_f2_s=Lucene50(blocksize=128), 
3child2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 16parent_f2_s=FST50, 
26parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
1child0_s=PostingsFormat(name=LuceneVarGapFixedInterval), 36parent_f2_s=FST50, 
7grand6_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
5grand0_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
18parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
28parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 6grand5_s=Lucene50(blocksize=128), 
7grand2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
15parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 4grand3_s=Lucene50(blocksize=128), 
6parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 25parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
0parent_f1_s=FST50, 3grand2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
35parent_f1_s=FST50, 
4parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
19parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
37parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
5grand4_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
38parent_f1_s=Lucene50(blocksize=128), 6grand1_s=Lucene50(blocksize=128), 
5parent_f2_s=FST50, 16parent_f1_s=Lucene50(blocksize=128), 
8parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
39parent_f2_s=Lucene50(blocksize=128), 
29parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 
2parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 
4child2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 rnd_b=Lucene50(blocksize=128), 27parent_f1_s=Lucene50(blocksize=128), 
17parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 
2grand0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 3child1_s=FST50, 
7parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 
26parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 2child0_s=FST50, 3parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 
36parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval)}, 
docValues:{_version_=DocValuesFormat(name=Direct), 
id=DocValuesFormat(name=Asserting), text_t=DocValuesFormat(name=Direct)}, 
maxPointsInLeafNode=574, maxMBSortInHeap=6.466847940740896, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@31efb2d9),
 locale=sq-AL, timezone=Europe/Riga
   [junit4]   2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 
1.8.0_172 (64-bit)/cpus=4,threads=133,free=37266040,total=534249472
   [junit4]   2> NOTE: All tests run in this JVM: [TestSystemIdResolver, 
LIRRollingUpdatesTest, TestSolrCloudWithHadoopAuthPlugin, 
TestSimpleTrackingShardHandler, DirectUpdateHandlerTest, TestInfoStreamLogging, 
HdfsDirectoryTest, TestRawTransformer, MultiThreadedOCPTest, 
CollectionsAPIDistributedZkTest, CollectionReloadTest, TestBadConfig, 
SliceStateTest, TestCorePropertiesReload, TestSQLHandlerNonCloud, 
TestShardHandlerFactory, TestPayloadCheckQParserPlugin, 
TestTrackingShardHandlerFactory, ScheduledTriggerTest, TestChildDocTransformer, 
TestLegacyNumericUtils, TestSSLRandomization, CoreAdminRequestStatusTest, 
TestStressLucene, HdfsChaosMonkeySafeLeaderTest, 
TestPHPSerializedResponseWriter, DocumentAnalysisRequestHandlerTest, 
TestSolrCoreSnapshots, TestNumericRangeQuery32, TestGeoJSONResponseWriter, 
IgnoreLargeDocumentProcessorFactoryTest, ZkShardTermsTest, 
XmlUpdateRequestHandlerTest, TestManagedStopFilterFactory, 
ClassificationUpdateProcessorTest, BitVectorTest, JSONWriterTest, 
DeleteInactiveReplicaTest, DistributedFacetPivotLargeTest, 
TestPostingsSolrHighlighter, SpatialFilterTest, 
OverriddenZkACLAndCredentialsProvidersTest, QueryEqualityTest, 
MetricsHandlerTest, TestScoreJoinQPScore, DateFieldTest, MetricUtilsTest, 
FileUtilsTest, TestCollectionAPI, AnalyticsMergeStrategyTest, 
SpatialHeatmapFacetsTest, TestLazyCores, DistribCursorPagingTest, 
LeaderElectionTest, ShufflingReplicaListTransformerTest, PrimUtilsTest, 
ZkControllerTest, HttpTriggerListenerTest, BlockJoinFacetRandomTest, 
TestConfigOverlay, TestEmbeddedSolrServerAdminHandler, 
DocExpirationUpdateProcessorFactoryTest, BlobRepositoryCloudTest, 
ConnectionManagerTest, TestDocTermOrdsUninvertLimit, HdfsThreadLeakTest, 
HdfsWriteToMultipleCollectionsTest, TestRestManager, 
DistributedQueryComponentCustomSortTest, DistributedQueueTest, 
TestExactSharedStatsCache, TestLeaderElectionZkExpiry, 
TestJsonFacetsWithNestedObjects, TestHalfAndHalfDocValues, 
TestLegacyNumericRangeQueryBuilder, NodeLostTriggerIntegrationTest, 
SuggesterFSTTest, TestRandomCollapseQParserPlugin, 
TestInPlaceUpdatesStandalone, HighlighterConfigTest, TestCloudConsistency, 
DistanceFunctionTest, CleanupOldIndexTest, TestCloudSchemaless, PeerSyncTest, 
TestFieldResource, DirectSolrConnectionTest, TestConfigSets, 
TestNumericTerms64, TestQueryTypes, CollectionsAPISolrJTest, 
MigrateRouteKeyTest, SolrJmxReporterCloudTest, CdcrRequestHandlerTest, 
TestFuzzyAnalyzedSuggestions, TestSchemaManager, TestSolrQueryParser, 
TestDynamicLoading, SecurityConfHandlerTest, TestSchemaVersionResource, 
SolrCoreCheckLockOnStartupTest, PluginInfoTest, TestDFISimilarityFactory, 
TestSolrCoreParser, FacetPivotSmallTest, TestTolerantUpdateProcessorCloud, 
TestMultiWordSynonyms, TestHdfsBackupRestoreCore, TestConfigSetsAPIZkFailure, 
TestComplexPhraseLeadingWildcard, ConvertedLegacyTest, 
ReplicaListTransformerTest, TermVectorComponentTest, TestDocumentBuilder, 
PeerSyncWithLeaderAndIndexFingerprintCachingTest, SolrXmlInZkTest, 
TestTriggerIntegration, ShardRoutingCustomTest, RequestHandlersTest, 
TestBinaryField, RollingRestartTest, TestReRankQParserPlugin, 
SolrIndexSplitterTest, TestCSVResponseWriter, AnalysisErrorHandlingTest, 
MoveReplicaHDFSTest, NumericFieldsTest, AsyncCallRequestStatusResponseTest, 
TestAuthorizationFramework, TestNodeLostTrigger, 
TestSubQueryTransformerDistrib, RestoreTriggerStateTest, BadComponentTest, 
RegexBoostProcessorTest, TestFastOutputStream, CursorPagingTest, 
DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, EchoParamsTest, 
MinimalSchemaTest, OutputWriterTest, SampleTest, SolrInfoBeanTest, 
SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, 
TestDistributedGrouping, TestGroupingSearch, TestHighlightDedupGrouping, 
TestJoin, TestSolrCoreProperties, TestTolerantSearch, TestTrie, 
PathHierarchyTokenizerFactoryTest, ProtectedTermFilterFactoryTest, 
TestCharFilters, TestLuceneMatchVersion, TestReversedWildcardFilterFactory, 
TestWordDelimiterFilterFactory, TestEmbeddedSolrServerConstructors, 
TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, 
ActionThrottleTest, AddReplicaTest, BasicDistributedZk2Test, 
BasicDistributedZkTest, BasicZkTest, ChaosMonkeyNothingIsSafeTest, 
ChaosMonkeySafeLeaderTest, DocValuesNotIndexedTest, ForceLeaderTest, 
FullSolrCloudDistribCmdsTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=ED62F88457D8A0A3 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=sq-AL -Dtests.timezone=Europe/Riga -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J2 | FullSolrCloudDistribCmdsTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([ED62F88457D8A0A3]:0)
   [junit4] Completed [822/822 (3!)] on J2 in 8369.95s, 1 test, 2 errors <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J2: stdout was not empty, see: 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J2-20180709_052854_0328821182303940527471.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/heapdumps/java_pid17717.hprof
 ...
   [junit4] Heap dump file created [574979098 bytes in 19.502 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 8720 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:651:
 The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/checkout/build.xml:585:
 Some of the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid17717.hprof

Total time: 629 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to