Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/17/

6 tests failed.
FAILED:  org.apache.solr.cloud.RollingRestartTest.test

Error Message:
Unable to restart (#6): CloudJettyRunner 
[url=http://127.0.0.1:48745/collection1]

Stack Trace:
java.lang.AssertionError: Unable to restart (#6): CloudJettyRunner 
[url=http://127.0.0.1:48745/collection1]
        at 
__randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:A19ED091F969DC10]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:103)
        at 
org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test

Error Message:
There were too many update fails (64 > 60) - we expect it can happen, but 
shouldn't easily

Stack Trace:
java.lang.AssertionError: There were too many update fails (64 > 60) - we 
expect it can happen, but shouldn't easily
        at 
__randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:A19ED091F969DC10]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertFalse(Assert.java:68)
        at 
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:216)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [HdfsTransactionLog]
        at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
        at 
__randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:36709EBC87F5772D]:0)
        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh(ZkStateReaderTest.java:42)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 6 object(s) that were not released!!! [NRTCachingDirectory, 
NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, 
NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 6 object(s) that were not 
released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, 
NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
        at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
        at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=9989, name=collection1, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=9989, name=collection1, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:45335: Could not find collection : 
awholynewstresscollection_collection1_0
        at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)




Build Log:
[...truncated 11409 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_29CAEF4B5795B1E8-001/init-core-data-001
   [junit4]   2> 813825 INFO  
(SUITE-ZkStateReaderTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 813827 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 813827 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 813830 INFO  (Thread-4408) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 813830 INFO  (Thread-4408) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 813930 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer start zk server on port:39674
   [junit4]   2> 813930 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 813930 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 813934 INFO  (zkCallback-1225-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7fb3f666 
name:ZooKeeperConnection Watcher:127.0.0.1:39674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 813934 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 813934 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 813935 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 813935 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 813936 INFO  (zkCallback-1226-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5ee56a15 
name:ZooKeeperConnection Watcher:127.0.0.1:39674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 813936 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 813936 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 813936 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 813940 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 813940 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 813941 INFO  (zkCallback-1227-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@173ad290 
name:ZooKeeperConnection Watcher:127.0.0.1:39674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 813941 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 813941 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 813942 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 813942 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 813943 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 813944 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 813945 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 813946 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 813947 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 813948 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 813949 INFO  (zkCallback-1227-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 813950 INFO  (zkCallback-1227-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814000 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 814000 INFO  (zkCallback-1227-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814002 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39674 39674
   [junit4]   2> 814128 INFO  (Thread-4408) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:39674 39674
   [junit4]   2> 814129 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 814131 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 814131 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 814132 INFO  (Thread-4409) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 814132 INFO  (Thread-4409) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 814232 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer start zk server on port:56816
   [junit4]   2> 814232 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814232 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814234 INFO  (zkCallback-1228-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@50559e02 
name:ZooKeeperConnection Watcher:127.0.0.1:56816 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814234 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814234 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814235 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814235 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814235 INFO  (zkCallback-1229-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5fe3ff65 
name:ZooKeeperConnection Watcher:127.0.0.1:56816 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814236 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814236 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814236 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 814238 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814238 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814238 INFO  (zkCallback-1230-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@33511417 
name:ZooKeeperConnection Watcher:127.0.0.1:56816/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814238 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814238 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814239 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 814239 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 814240 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 814240 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 814241 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 814241 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 814242 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814242 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 814243 INFO  (zkCallback-1230-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 814243 INFO  (zkCallback-1230-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814244 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814244 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 814245 INFO  (zkCallback-1230-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814245 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814246 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56816 56816
   [junit4]   2> 814450 INFO  (Thread-4409) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:56816 56816
   [junit4]   2> 814451 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending 
testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 814453 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 814454 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 814455 INFO  (Thread-4410) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 814455 INFO  (Thread-4410) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 814555 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer start zk server on port:48455
   [junit4]   2> 814555 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814565 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814583 INFO  (zkCallback-1231-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@ffc2633 name:ZooKeeperConnection 
Watcher:127.0.0.1:48455 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 814583 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814584 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814591 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814599 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814614 INFO  (zkCallback-1232-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6b93916 name:ZooKeeperConnection 
Watcher:127.0.0.1:48455 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 814615 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814615 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814615 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 814617 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814630 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814637 INFO  (zkCallback-1233-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@37140a93 
name:ZooKeeperConnection Watcher:127.0.0.1:48455/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814637 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814637 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814638 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 814639 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 814639 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 814640 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 814640 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 814640 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 814641 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814641 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 814641 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 814641 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 814642 INFO  (zkCallback-1233-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 814646 INFO  (zkCallback-1233-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814646 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 814648 INFO  (zkCallback-1233-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for 
collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814648 INFO  (zkCallback-1233-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 814648 INFO  (zkCallback-1233-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814652 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48455 48455
   [junit4]   2> 814764 INFO  (Thread-4410) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:48455 48455
   [junit4]   2> 814770 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 814772 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 814773 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 814773 INFO  (Thread-4411) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 814773 INFO  (Thread-4411) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 814873 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer start zk server on port:58510
   [junit4]   2> 814873 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814879 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814890 INFO  (zkCallback-1234-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2254fffe 
name:ZooKeeperConnection Watcher:127.0.0.1:58510 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814890 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814890 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814891 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814892 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814895 INFO  (zkCallback-1235-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@b02d773 name:ZooKeeperConnection 
Watcher:127.0.0.1:58510 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 814895 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814895 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814895 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 814899 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814899 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814900 INFO  (zkCallback-1236-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2722398a 
name:ZooKeeperConnection Watcher:127.0.0.1:58510/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814900 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814900 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814900 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 814901 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 814903 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 814904 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 814906 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 814907 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 814910 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814912 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 814912 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 814912 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 814913 INFO  (zkCallback-1236-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 814913 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814914 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 814915 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814928 ERROR 
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$9/1382749964@384b380f
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7d49a162[Shutting
 down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 814930 INFO  (zkCallback-1236-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 814930 WARN  (zkCallback-1236-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /clusterstate.json]
   [junit4]   2> 814931 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58510 58510
   [junit4]   2> 815136 INFO  (Thread-4411) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:58510 58510
   [junit4]   2> 815137 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest 
-Dtests.method=testStateFormatUpdateWithExplicitRefresh 
-Dtests.seed=29CAEF4B5795B1E8 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=es-CL -Dtests.timezone=SystemV/YST9YDT -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.37s J2 | 
ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not 
find collection : c1
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:36709EBC87F5772D]:0)
   [junit4]    >        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    >        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
   [junit4]    >        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh(ZkStateReaderTest.java:42)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 815144 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 815144 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 815145 INFO  (Thread-4412) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 815146 INFO  (Thread-4412) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 815245 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer start zk server on port:53554
   [junit4]   2> 815246 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815246 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815252 INFO  (zkCallback-1237-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@159338ed 
name:ZooKeeperConnection Watcher:127.0.0.1:53554 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815252 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815252 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815253 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815261 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815262 INFO  (zkCallback-1238-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7f709adb 
name:ZooKeeperConnection Watcher:127.0.0.1:53554 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815262 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815263 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815263 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 815265 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815265 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815266 INFO  (zkCallback-1239-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2830aa38 
name:ZooKeeperConnection Watcher:127.0.0.1:53554/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815266 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815266 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815266 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 815267 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 815268 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 815268 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 815271 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 815273 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 815274 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815274 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 815276 INFO  (zkCallback-1239-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 815276 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 815277 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815278 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 815278 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 815278 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 815280 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53554 53554
   [junit4]   2> 815475 INFO  (Thread-4412) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:53554 53554
   [junit4]   2> 815479 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 815485 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.SolrTestCaseJ4 ###Starting testWatchedCollectionCreation
   [junit4]   2> 815485 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 815485 INFO  (Thread-4413) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 815485 INFO  (Thread-4413) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 815585 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.ZkTestServer start zk server on port:41608
   [junit4]   2> 815585 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815593 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815595 INFO  (zkCallback-1240-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@a90e385 name:ZooKeeperConnection 
Watcher:127.0.0.1:41608 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 815595 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815595 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815598 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815606 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815607 INFO  (zkCallback-1241-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e69958 name:ZooKeeperConnection 
Watcher:127.0.0.1:41608 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 815607 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815607 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815607 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 815611 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815632 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815632 INFO  (zkCallback-1242-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4abd38 name:ZooKeeperConnection 
Watcher:127.0.0.1:41608/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 815634 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815634 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815638 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 815638 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 815639 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 815639 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 815640 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 815640 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 815641 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815641 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 815641 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 815641 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 815642 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815643 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 815643 INFO  (zkCallback-1242-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for 
collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 815643 INFO  (zkCallback-1242-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 815644 INFO  (zkCallback-1242-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 815696 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41608 41608
   [junit4]   2> 816108 INFO  (Thread-4413) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41608 41608
   [junit4]   2> 816109 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) 
[    ] o.a.s.SolrTestCaseJ4 ###Ending testWatchedCollectionCreation
   [junit4]   2> 816110 INFO  
(SUITE-ZkStateReaderTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_29CAEF4B5795B1E8-001
   [junit4]   2> May 23, 2016 5:49:14 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: 
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
 chunkSize=9, maxDocsPerChunk=6, blockSize=10), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, 
chunkSize=9, blockSize=10)), sim=RandomSimilarity(queryNorm=true,coord=no): {}, 
locale=es-CL, timezone=SystemV/YST9YDT
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=1,free=179526928,total=531103744
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtils, 
HLLSerializationTest, TestReplicaProperties, TestHdfsUpdateLog, 
DataDrivenBlockJoinTest, TestExpandComponent, TestZkChroot, InfoHandlerTest, 
RankQueryTest, TestMiniSolrCloudClusterBase, TestJmxIntegration, 
TestTolerantSearch, PrimitiveFieldTypeTest, TestHashQParserPlugin, TestReload, 
TestMissingGroups, SpatialRPTFieldTypeTest, AnalyticsQueryTest, 
CleanupOldIndexTest, OverseerStatusTest, TestFieldResource, TestSQLHandler, 
TestMinMaxOnMultiValuedField, TestDynamicFieldCollectionResource, 
AtomicUpdatesTest, BinaryUpdateRequestHandlerTest, PluginInfoTest, AssignTest, 
RemoteQueryErrorTest, TestSolrJ, BadComponentTest, UnloadDistributedZkTest, 
DirectUpdateHandlerOptimizeTest, SuggesterTSTTest, RegexBoostProcessorTest, 
TestFuzzyAnalyzedSuggestions, TestSSLRandomization, 
DistributedFacetPivotLongTailTest, TestStressReorder, DateMathParserTest, 
TestJmxMonitoredMap, TestNRTOpen, AddBlockUpdateTest, TestSchemaNameResource, 
DeleteShardTest, TestAuthenticationFramework, FieldAnalysisRequestHandlerTest, 
LukeRequestHandlerTest, QueryParsingTest, BufferStoreTest, 
SimpleCollectionCreateDeleteTest, TestElisionMultitermQuery, 
DeleteInactiveReplicaTest, AutoCommitTest, CurrencyFieldXmlFileTest, 
DirectUpdateHandlerTest, TestManagedSynonymFilterFactory, 
HighlighterConfigTest, BaseCdcrDistributedZkTest, 
DistributedFacetPivotWhiteBoxTest, TestPKIAuthenticationPlugin, 
RequestHandlersTest, TestIndexSearcher, UpdateParamsTest, 
OverriddenZkACLAndCredentialsProvidersTest, BasicDistributedZk2Test, 
JavabinLoaderTest, TestDistributedMissingSort, TestJettySolrRunner, 
CollectionStateFormat2Test, ClusterStateTest, 
IgnoreCommitOptimizeUpdateProcessorFactoryTest, 
SuggestComponentContextFilterQueryTest, TestSweetSpotSimilarityFactory, 
CoreAdminCreateDiscoverTest, TestSolrDeletionPolicy1, TestSearchPerf, 
BitVectorTest, TestNamedUpdateProcessors, DistributedDebugComponentTest, 
TestGroupingSearch, TestIntervalFaceting, TestOnReconnectListenerSupport, 
ZkStateReaderTest]
   [junit4] Completed [157/584 (1!)] on J2 in 2.81s, 6 tests, 1 error <<< 
FAILURES!

[...truncated 27 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/init-core-data-001
   [junit4]   2> 753745 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 753777 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 753786 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 753788 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 753799 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_42310_hdfs____rg775q/webapp
   [junit4]   2> 753876 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 754159 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42310
   [junit4]   2> 754206 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 754207 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 754215 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_50453_datanode____7utz9a/webapp
   [junit4]   2> 754291 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 754600 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50453
   [junit4]   2> 754643 WARN  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 754644 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log jetty-6.1.26
   [junit4]   2> 754659 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_37269_datanode____tqsdtk/webapp
   [junit4]   2> 754727 INFO  (IPC Server handler 3 on 34655) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-344877d6-eb69-44d6-b82a-8bcb2429bfbd node DatanodeRegistration(127.0.0.1, 
datanodeUuid=2a6f9b40-428a-4d1f-964a-6d8805fc65e3, infoPort=50453, 
ipcPort=42208, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 754727 INFO  (IPC Server handler 3 on 34655) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-16c6665e-9db9-47bb-9823-3c95bb5f65b0 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=2a6f9b40-428a-4d1f-964a-6d8805fc65e3, infoPort=50453, 
ipcPort=42208, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 754793 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 755151 INFO  
(SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] 
o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37269
   [junit4]   2> 755245 INFO  (IPC Server handler 0 on 34655) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-ce06f900-d6e4-42c5-8c20-80dd97f265d3 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=7720753c-58bc-4b75-ab40-0737022dd664, infoPort=37269, 
ipcPort=33487, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 755246 INFO  (IPC Server handler 0 on 34655) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-4f157fa6-0255-473e-bde1-c9f5065872c9 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=7720753c-58bc-4b75-ab40-0737022dd664, infoPort=37269, 
ipcPort=33487, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 755322 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 755322 INFO  (Thread-1738) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 755322 INFO  (Thread-1738) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 755422 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:37618
   [junit4]   2> 755422 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 755426 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 755429 INFO  (zkCallback-585-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5c68a54f 
name:ZooKeeperConnection Watcher:127.0.0.1:37618 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 755429 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 755429 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 755429 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 755431 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 755434 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 755435 INFO  (zkCallback-586-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1f031aea 
name:ZooKeeperConnection Watcher:127.0.0.1:37618/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 755435 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 755435 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 755435 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 755436 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 755437 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 755437 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 755438 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 755438 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 755439 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema15.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 755439 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 755440 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 755440 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 755441 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 755441 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 755442 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 755442 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 755445 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 755445 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 755450 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 755450 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 755451 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 755451 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 755452 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 755452 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 755455 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 755455 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 755456 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 755456 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 755521 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/cores/collection1
   [junit4]   2> 755522 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 755523 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@467a3972{/,null,AVAILABLE}
   [junit4]   2> 755523 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@f28ea04{HTTP/1.1,[http/1.1]}{127.0.0.1:54292}
   [junit4]   2> 755523 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.e.j.s.Server Started @757579ms
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:34655/hdfs__localhost_34655__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001_tempDir-002_control_data,
 hostContext=/, hostPort=54292, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/cores}
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001'
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 755524 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 755527 INFO  (zkCallback-587-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2f122e65 
name:ZooKeeperConnection Watcher:127.0.0.1:37618/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 755527 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 755527 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 755528 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 755528 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/solr.xml
   [junit4]   2> 755532 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/cores
   [junit4]   2> 755532 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 829332570
   [junit4]   2> 755532 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001]
   [junit4]   2> 755532 WARN  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/lib
   [junit4]   2> 755532 INFO  
(TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] 
o.a.s.h.c.HttpShardHandl

[...truncated too long message...]

-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/mockito-core-1.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.1-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/contrib/analysis-extras/lib/icu4j-56.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.2.jar
 com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/temp/junit4-J0-20160523_053536_198.events
 
@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/temp/junit4-J0-20160523_053536_198.suites
 -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Quit event not received from 
the forked process? This may indicate JVM crash or runner bugs.
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4]     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]     at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014:
 At least one slave process threw an exception, first: Quit event not received 
from the forked process? This may indicate JVM crash or runner bugs.

Total time: 195 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to