Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11240/
Java: 64bit/jdk1.8.0_40-ea-b04 -XX:+UseCompressedOops -XX:+UseG1GC

7 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestZkChroot

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=5251, name=coreLoadExecutor-2568-thread-1, state=RUNNABLE, 
group=TGRP-TestZkChroot], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=5251, 
name=coreLoadExecutor-2568-thread-1, state=RUNNABLE, group=TGRP-TestZkChroot], 
registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1552)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:729)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1272)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1163)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1155)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:40)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
        at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:276)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:488)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:794)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:652)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
MockDirectoryWrapper(RAMDirectory@3373529f 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@48072962)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestZkChroot

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=5276, name=coreLoadExecutor-2578-thread-1, state=RUNNABLE, 
group=TGRP-TestZkChroot], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=5276, 
name=coreLoadExecutor-2578-thread-1, state=RUNNABLE, group=TGRP-TestZkChroot], 
registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1552)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:729)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1272)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1163)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1155)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:40)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
        at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:276)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:488)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:794)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:652)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
MockDirectoryWrapper(RAMDirectory@236306cd 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@260b93d5)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestZkChroot

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=5296, name=coreLoadExecutor-2585-thread-1, state=RUNNABLE, 
group=TGRP-TestZkChroot], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=5296, 
name=coreLoadExecutor-2585-thread-1, state=RUNNABLE, group=TGRP-TestZkChroot], 
registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1552)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:729)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1272)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1163)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1155)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:40)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
        at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:276)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:488)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:794)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:652)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
MockDirectoryWrapper(RAMDirectory@64998627 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@61e1f9d7)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


REGRESSION:  
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this 
request:[https://127.0.0.1:39925/kwy, https://127.0.0.1:52356/kwy, 
https://127.0.0.1:55432/kwy]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[https://127.0.0.1:39925/kwy, 
https://127.0.0.1:52356/kwy, https://127.0.0.1:55432/kwy]
        at 
__randomizedtesting.SeedInfo.seed([DF1F884DADB46034:5EF90655DAEB0008]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:874)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:116)
        at 
org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:106)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : customcollreplicadeletion/a/core_node1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:550)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
        ... 46 more


REGRESSION:  org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:41348, 
https://127.0.0.1:45666, https://127.0.0.1:50256, https://127.0.0.1:41428, 
https://127.0.0.1:37880]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[https://127.0.0.1:41348, https://127.0.0.1:45666, 
https://127.0.0.1:50256, https://127.0.0.1:41428, https://127.0.0.1:37880]
        at 
__randomizedtesting.SeedInfo.seed([DF1F884DADB46034:5EF90655DAEB0008]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:874)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
        at 
org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:139)
        at 
org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:123)
        at 
org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:87)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
 remove replica : delLiveColl/shard2/core_node3
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:550)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
        ... 47 more


REGRESSION:  org.apache.solr.core.CachingDirectoryFactoryTest.stressTest

Error Message:
Captured an uncaught exception in thread: Thread[id=6935, name=Thread-2497, 
state=RUNNABLE, group=TGRP-CachingDirectoryFactoryTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=6935, name=Thread-2497, state=RUNNABLE, 
group=TGRP-CachingDirectoryFactoryTest]
Caused by: java.security.AccessControlException: access denied 
("java.io.FilePermission" "path11/7/17" "write")
        at __randomizedtesting.SeedInfo.seed([DF1F884DADB46034]:0)
        at 
java.security.AccessControlContext.checkPermission(AccessControlContext.java:457)
        at 
java.security.AccessController.checkPermission(AccessController.java:884)
        at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
        at java.lang.SecurityManager.checkWrite(SecurityManager.java:979)
        at sun.nio.fs.UnixPath.checkWrite(UnixPath.java:801)
        at 
sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:376)
        at java.nio.file.Files.createDirectory(Files.java:674)
        at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781)
        at java.nio.file.Files.createDirectories(Files.java:727)
        at 
org.apache.lucene.store.FSLockFactory.setLockDir(FSLockFactory.java:46)
        at 
org.apache.lucene.store.SimpleFSLockFactory.<init>(SimpleFSLockFactory.java:81)
        at 
org.apache.solr.core.CachingDirectoryFactory.injectLockFactory(CachingDirectoryFactory.java:500)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:357)
        at 
org.apache.solr.core.CachingDirectoryFactoryTest$GetDirThread.run(CachingDirectoryFactoryTest.java:190)


REGRESSION:  org.apache.solr.core.RAMDirectoryFactoryTest.test

Error Message:
access denied ("java.io.FilePermission" "/fake/path" "write")

Stack Trace:
java.security.AccessControlException: access denied ("java.io.FilePermission" 
"/fake/path" "write")
        at 
__randomizedtesting.SeedInfo.seed([DF1F884DADB46034:574BB79703480DCC]:0)
        at 
java.security.AccessControlContext.checkPermission(AccessControlContext.java:457)
        at 
java.security.AccessController.checkPermission(AccessController.java:884)
        at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
        at java.lang.SecurityManager.checkWrite(SecurityManager.java:979)
        at sun.nio.fs.UnixPath.checkWrite(UnixPath.java:801)
        at 
sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:376)
        at java.nio.file.Files.createDirectory(Files.java:674)
        at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781)
        at java.nio.file.Files.createDirectories(Files.java:727)
        at 
org.apache.lucene.store.FSLockFactory.setLockDir(FSLockFactory.java:46)
        at 
org.apache.lucene.store.SimpleFSLockFactory.<init>(SimpleFSLockFactory.java:81)
        at 
org.apache.solr.core.CachingDirectoryFactory.injectLockFactory(CachingDirectoryFactory.java:500)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:357)
        at 
org.apache.solr.core.RAMDirectoryFactoryTest.dotestOpenReturnsTheSameForSamePath(RAMDirectoryFactoryTest.java:46)
        at 
org.apache.solr.core.RAMDirectoryFactoryTest.test(RAMDirectoryFactoryTest.java:33)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11237 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest
   [junit4]   2> Creating dataDir: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/init-core-data-001
   [junit4]   2> 70593 T223 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (false)
   [junit4]   2> 70593 T223 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /kwy/
   [junit4]   2> 70599 T223 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 70599 T223 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 70600 T224 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 70700 T223 oasc.ZkTestServer.run start zk server on port:57353
   [junit4]   2> 70700 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 70701 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 70704 T230 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@35ce8614 
name:ZooKeeperConnection Watcher:127.0.0.1:57353 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 70705 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 70705 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 70705 T223 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 70712 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 70713 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 70716 T232 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5e9c7ddb 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 70716 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 70716 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 70716 T223 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 70719 T223 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 70720 T223 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 70721 T223 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 70723 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 70723 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 70726 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 70726 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 70728 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 70729 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 70730 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 70730 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 70732 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 70733 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 70734 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 70734 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 70736 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 70736 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 70737 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 70738 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 70739 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 70739 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 70741 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 70741 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 70742 T223 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 70743 T223 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 70747 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 70747 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 70749 T234 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@680fdb51 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 70749 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 70750 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 71144 T223 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 71148 T223 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 71166 T223 oejs.AbstractConnector.doStart Started 
[email protected]:?????
   [junit4]   2> 71168 T223 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 71168 T223 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 71169 T223 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002
   [junit4]   2> 71169 T223 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/'
   [junit4]   2> 71185 T223 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/solr.xml
   [junit4]   2> 71211 T223 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002
   [junit4]   2> 71211 T223 oasc.CoreContainer.<init> New CoreContainer 
527058626
   [junit4]   2> 71212 T223 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/]
   [junit4]   2> 71212 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 71213 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 71213 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 71213 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 71213 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 71214 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 71214 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 71214 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 71214 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 71216 T223 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 71217 T223 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 71217 T223 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 71217 T223 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 71217 T223 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:57353/solr
   [junit4]   2> 71218 T223 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 71218 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 71218 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 71220 T245 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@20c5b241 
name:ZooKeeperConnection Watcher:127.0.0.1:57353 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 71220 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 71221 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 71222 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 71224 T247 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e92d86a 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 71224 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 71225 T223 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 71227 T223 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 71228 T223 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 71230 T223 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 71232 T223 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 71234 T223 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 71235 T223 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:55432_kwy
   [junit4]   2> 71236 T223 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:55432_kwy
   [junit4]   2> 71237 T223 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 71238 T223 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 71239 T223 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 71241 T223 oasc.OverseerElectionContext.runLeaderProcess I am 
going to be the leader 127.0.0.1:55432_kwy
   [junit4]   2> 71241 T223 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 71242 T223 oasc.Overseer.start Overseer 
(id=92448366919024644-127.0.0.1:55432_kwy-n_0000000000) starting
   [junit4]   2> 71243 T223 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 71248 T223 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 71249 T249 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 71250 T223 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 71251 T223 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 71253 T223 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 71255 T248 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 71257 T223 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002
   [junit4]   2> 71268 T223 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/conf/
   [junit4]   2> 71414 T223 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 71415 T223 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 71415 T223 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 71418 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 71419 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 71420 T253 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4c1b2886 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 71420 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 71421 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 71422 T223 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 71424 T223 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 71424 T223 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 71424 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 71425 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 71426 T255 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@38b9ac4c 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 71426 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 71427 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 71429 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 71432 T248 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: collection1
   [junit4]   2> 71432 T248 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 71432 T248 oasc.Overseer$ClusterStateUpdater.createCollection 
state version collection1 2
   [junit4]   2> 71434 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 71435 T256 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 71436 T257 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 71776 T223 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 71777 T223 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 71781 T223 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 71783 T223 oejs.AbstractConnector.doStart Started 
[email protected]:?????
   [junit4]   2> 71785 T223 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 71785 T223 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 71786 T223 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003
   [junit4]   2> 71786 T223 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003/'
   [junit4]   2> 71802 T223 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003/solr.xml
   [junit4]   2> 71808 T223 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003
   [junit4]   2> 71809 T223 oasc.CoreContainer.<init> New CoreContainer 
294460718
   [junit4]   2> 71809 T223 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003/]
   [junit4]   2> 71809 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 71810 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 71810 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 71810 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 71810 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 71811 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 71811 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 71811 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 71811 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 71813 T223 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 71814 T223 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 71814 T223 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 71814 T223 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 71815 T223 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:57353/solr
   [junit4]   2> 71815 T223 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 71815 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 71816 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 71817 T268 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@c8d026a name:ZooKeeperConnection 
Watcher:127.0.0.1:57353 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 71818 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 71818 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 71823 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 71825 T270 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@9e81aaa name:ZooKeeperConnection 
Watcher:127.0.0.1:57353/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 71825 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 71829 T223 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 72832 T223 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:52356_kwy
   [junit4]   2> 72833 T223 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:52356_kwy
   [junit4]   2> 72837 T223 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 72839 T223 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003
   [junit4]   2> 72846 T223 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-003/conf/
   [junit4]   2> 72962 T223 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 72963 T223 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 72964 T223 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 73209 T223 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 73210 T223 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 73213 T223 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 73214 T223 oejs.AbstractConnector.doStart Started 
[email protected]:?????
   [junit4]   2> 73216 T223 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 73216 T223 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 73216 T223 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004
   [junit4]   2> 73216 T223 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/'
   [junit4]   2> 73227 T223 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/solr.xml
   [junit4]   2> 73233 T223 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004
   [junit4]   2> 73234 T223 oasc.CoreContainer.<init> New CoreContainer 
1771769262
   [junit4]   2> 73234 T223 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/]
   [junit4]   2> 73235 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 73235 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 73235 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 73235 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 73235 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 73236 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 73236 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 73236 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 73236 T223 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 73238 T223 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 73238 T223 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 73239 T223 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 73239 T223 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 73239 T223 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:57353/solr
   [junit4]   2> 73239 T223 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 73240 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 73240 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 73242 T283 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7fef3ca7 
name:ZooKeeperConnection Watcher:127.0.0.1:57353 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 73242 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 73243 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 73245 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 73246 T285 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1aa4cee9 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 73246 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 73250 T223 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 74254 T223 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:39925_kwy
   [junit4]   2> 74255 T223 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:39925_kwy
   [junit4]   2> 74259 T223 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 74261 T223 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004
   [junit4]   2> 74266 T223 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/conf/
   [junit4]   2> 74374 T223 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 74375 T223 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 74375 T223 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 74378 T223 oasc.AbstractFullDistribZkTestBase.createCollection 
Creating collection with stateFormat=2: customcollreplicadeletion
   [junit4]   2> 74378 T223 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 74379 T223 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 74380 T289 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@11e110c0 
name:ZooKeeperConnection Watcher:127.0.0.1:57353/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 74380 T223 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 74381 T223 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 74382 T223 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 74451 T281 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
replicationFactor=1&shards=a,b&maxShardsPerNode=5&router.name=implicit&name=customcollreplicadeletion&action=CREATE&numShards=1&stateFormat=2&wt=javabin&version=2
   [junit4]   2> 74452 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 74453 T249 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"createcollection",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"customcollreplicadeletion",
   [junit4]   2>          "replicationFactor":"1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"5",
   [junit4]   2>          "shards":"a,b",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "router.name":"implicit"}
   [junit4]   2> 74454 T290 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2>          "operation":"createcollection",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"customcollreplicadeletion",
   [junit4]   2>          "replicationFactor":"1",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "maxShardsPerNode":"5",
   [junit4]   2>          "shards":"a,b",
   [junit4]   2>          "stateFormat":"2",
   [junit4]   2>          "router.name":"implicit"}
   [junit4]   2> 74455 T290 oasc.OverseerCollectionProcessor.createConfNode 
Only one config set found in zk - using it:conf1
   [junit4]   2> 74455 T290 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/customcollreplicadeletion 
   [junit4]   2> 74456 T290 oascc.SolrZkClient.makePath makePath: 
/collections/customcollreplicadeletion
   [junit4]   2> 74459 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 74461 T248 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: customcollreplicadeletion
   [junit4]   2> 74461 T248 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection customcollreplicadeletion with shards [a, b]
   [junit4]   2> 74461 T248 oasc.Overseer$ClusterStateUpdater.createCollection 
state version customcollreplicadeletion 2
   [junit4]   2> 74463 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/customcollreplicadeletion/state.json
   [junit4]   2> 74464 T257 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 74464 T271 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 74464 T291 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 74464 T256 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 74464 T286 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 74559 T290 oasc.OverseerCollectionProcessor.createCollection 
Creating SolrCores for new collection customcollreplicadeletion, shardNames [a, 
b] , replicationFactor : 1
   [junit4]   2> 74559 T290 oasc.OverseerCollectionProcessor.createCollection 
Creating shard customcollreplicadeletion_a_replica1 as part of slice a of 
collection customcollreplicadeletion on 127.0.0.1:55432_kwy
   [junit4]   2> 74560 T290 oasc.OverseerCollectionProcessor.createCollection 
Creating shard customcollreplicadeletion_b_replica1 as part of slice b of 
collection customcollreplicadeletion on 127.0.0.1:39925_kwy
   [junit4]   2> 74636 T278 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection.configName=conf1&name=customcollreplicadeletion_b_replica1&action=CREATE&numShards=2&collection=customcollreplicadeletion&shard=b&wt=javabin&version=2
   [junit4]   2> 74639 T240 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection.configName=conf1&name=customcollreplicadeletion_a_replica1&action=CREATE&numShards=2&collection=customcollreplicadeletion&shard=a&wt=javabin&version=2
   [junit4]   2> 74641 T240 oasc.ZkController.publish publishing 
core=customcollreplicadeletion_a_replica1 state=down 
collection=customcollreplicadeletion
   [junit4]   2> 74642 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 74643 T240 oasc.ZkController.preRegister Registering watch for 
external collection customcollreplicadeletion
   [junit4]   2> 74644 T278 oasc.ZkController.publish publishing 
core=customcollreplicadeletion_b_replica1 state=down 
collection=customcollreplicadeletion
   [junit4]   2> 74644 T248 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "core":"customcollreplicadeletion_a_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:55432/kwy";,
   [junit4]   2>          "node_name":"127.0.0.1:55432_kwy",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"a",
   [junit4]   2>          "collection":"customcollreplicadeletion",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 74645 T278 oasc.ZkController.preRegister Registering watch for 
external collection customcollreplicadeletion
   [junit4]   2> 74646 T278 oascc.ZkStateReader.addZkWatch addZkWatch 
customcollreplicadeletion
   [junit4]   2> 74646 T278 oascc.ZkStateReader.addZkWatch Updating collection 
state at /collections/customcollreplicadeletion/state.json from ZooKeeper... 
   [junit4]   2> 74647 T278 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 0 
   [junit4]   2> 74647 T278 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 74649 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/customcollreplicadeletion/state.json
   [junit4]   2> 74649 T286 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74650 T286 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 1 
   [junit4]   2> 74650 T240 oascc.ZkStateReader.addZkWatch addZkWatch 
customcollreplicadeletion
   [junit4]   2> 74651 T240 oascc.ZkStateReader.addZkWatch Updating collection 
state at /collections/customcollreplicadeletion/state.json from ZooKeeper... 
   [junit4]   2> 74652 T240 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 1 
   [junit4]   2> 74652 T240 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 74652 T240 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for customcollreplicadeletion_a_replica1
   [junit4]   2> 74652 T240 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:customcollreplicadeletion
   [junit4]   2> 74653 T240 oasc.ZkController.createCollectionZkNode Collection 
zkNode exists
   [junit4]   2> 74653 T240 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/customcollreplicadeletion
   [junit4]   2> 74653 T248 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 1 
   [junit4]   2> 74654 T240 oascc.ZkStateReader.readConfigName 
path=/collections/customcollreplicadeletion configName=conf1 specified config 
exists in ZooKeeper
   [junit4]   2> 74654 T248 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "core":"customcollreplicadeletion_b_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:39925/kwy";,
   [junit4]   2>          "node_name":"127.0.0.1:39925_kwy",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"b",
   [junit4]   2>          "collection":"customcollreplicadeletion",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 74654 T240 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/'
   [junit4]   2> 74655 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 74655 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/customcollreplicadeletion/state.json
   [junit4]   2> 74656 T286 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74656 T286 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 2 
   [junit4]   2> 74656 T256 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74658 T256 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 2 
   [junit4]   2> 74678 T240 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 74691 T240 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 74692 T240 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 74701 T240 oass.IndexSchema.readSchema 
[customcollreplicadeletion_a_replica1] Schema name=test
   [junit4]   2> 74820 T240 oass.OpenExchangeRatesOrgProvider.init Initialized 
with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 74826 T240 oass.IndexSchema.readSchema default search field in 
schema is text
   [junit4]   2> 74828 T240 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 74844 T240 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 74848 T240 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 74851 T240 oass.OpenExchangeRatesOrgProvider.reload Reloading 
exchange rates from open-exchange-rates.json
   [junit4]   2> 74852 T240 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 74853 T240 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 74854 T240 oass.OpenExchangeRatesOrgProvider.reload Reloading 
exchange rates from open-exchange-rates.json
   [junit4]   2> 74854 T240 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 74855 T240 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 74855 T240 oasc.CoreContainer.create Creating SolrCore 
'customcollreplicadeletion_a_replica1' using configuration from collection 
customcollreplicadeletion
   [junit4]   2> 74855 T240 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 74856 T240 oasc.SolrCore.<init> 
[customcollreplicadeletion_a_replica1] Opening new SolrCore at 
../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/,
 
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/data/
   [junit4]   2> 74856 T240 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1049db4e
   [junit4]   2> 74857 T240 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/data
   [junit4]   2> 74860 T240 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/data/index/
   [junit4]   2> 74860 T240 oasc.SolrCore.initIndex WARN 
[customcollreplicadeletion_a_replica1] Solr index directory 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 74861 T240 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-002/customcollreplicadeletion_a_replica1/data/index
   [junit4]   2> 74861 T240 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=17, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=48.4775390625, 
floorSegmentMB=0.4384765625, forceMergeDeletesPctAllowed=0.12369125592327168, 
segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.2772990419729281
   [junit4]   2> 74862 T240 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@47b1adf 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bf2ac0b),segFN=segments_1,generation=1}
   [junit4]   2> 74863 T240 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 74870 T240 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 74870 T240 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 74871 T240 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 74871 T240 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 74871 T240 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 74872 T240 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 74872 T240 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 74873 T240 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 74873 T240 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 74874 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 74875 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 74875 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 74876 T240 oasc.RequestHandlers.initHandlersFromConfig created 
standard: solr.StandardRequestHandler
   [junit4]   2> 74877 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/get: solr.RealTimeGetHandler
   [junit4]   2> 74877 T240 oasc.RequestHandlers.initHandlersFromConfig adding 
lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 74877 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/replication: solr.ReplicationHandler
   [junit4]   2> 74878 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/update: solr.UpdateRequestHandler
   [junit4]   2> 74878 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 74879 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 74880 T240 oasc.RequestHandlers.initHandlersFromConfig created 
/admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 74882 T240 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 74883 T240 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 74884 T240 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 74885 T240 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 74887 T240 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 74887 T240 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 74888 T240 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 74888 T240 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@47b1adf 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2bf2ac0b),segFN=segments_1,generation=1}
   [junit4]   2> 74889 T240 oasc.SolrDeletionPolicy.updateCommits newest commit 
generation = 1
   [junit4]   2> 74889 T240 oass.SolrIndexSearcher.<init> Opening 
Searcher@4caabe19[customcollreplicadeletion_a_replica1] main
   [junit4]   2> 74889 T240 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/customcollreplicadeletion
   [junit4]   2> 74894 T240 oascc.ZkStateReader.readConfigName 
path=/collections/customcollreplicadeletion configName=conf1 specified config 
exists in ZooKeeper
   [junit4]   2> 74895 T240 oasr.ManagedResourceStorage.newStorageIO Setting up 
ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 74895 T240 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 74896 T240 oasr.RestManager.init Initializing RestManager with 
initArgs: {}
   [junit4]   2> 74896 T240 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 74897 T240 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 74897 T240 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 74899 T240 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 74902 T240 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 74902 T240 oasr.ManagedResourceStorage$JsonStorage.store Saved 
JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 74903 T240 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 74908 T294 oasc.SolrCore.registerSearcher 
[customcollreplicadeletion_a_replica1] Registered new searcher 
Searcher@4caabe19[customcollreplicadeletion_a_replica1] 
main{UninvertingDirectoryReader()}
   [junit4]   2> 74916 T240 oasc.CoreContainer.registerCore registering core: 
customcollreplicadeletion_a_replica1
   [junit4]   2> 74917 T240 oasc.ZkController.register Register replica - 
core:customcollreplicadeletion_a_replica1 address:https://127.0.0.1:55432/kwy 
collection:customcollreplicadeletion shard:a
   [junit4]   2> 74918 T240 oascc.SolrZkClient.makePath makePath: 
/collections/customcollreplicadeletion/leader_elect/a/election
   [junit4]   2> 74923 T240 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard a
   [junit4]   2> 74924 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 74925 T240 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 74925 T240 oasc.ShardLeaderElectionContext.runLeaderProcess I 
may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C18 name=customcollreplicadeletion_a_replica1 
org.apache.solr.core.SolrCore@52fb267f 
url=https://127.0.0.1:55432/kwy/customcollreplicadeletion_a_replica1 
node=127.0.0.1:55432_kwy C18_STATE=coll:customcollreplicadeletion 
core:customcollreplicadeletion_a_replica1 
props:{core=customcollreplicadeletion_a_replica1, 
base_url=https://127.0.0.1:55432/kwy, node_name=127.0.0.1:55432_kwy, state=down}
   [junit4]   2> 74925 T240 C18 P55432 oasc.SyncStrategy.sync Sync replicas to 
https://127.0.0.1:55432/kwy/customcollreplicadeletion_a_replica1/
   [junit4]   2> 74926 T240 C18 P55432 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 74926 T240 C18 P55432 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:55432/kwy/customcollreplicadeletion_a_replica1/ has no 
replicas
   [junit4]   2> 74927 T240 oasc.ShardLeaderElectionContext.runLeaderProcess I 
am the new leader: 
https://127.0.0.1:55432/kwy/customcollreplicadeletion_a_replica1/ a
   [junit4]   2> 74927 T240 oascc.SolrZkClient.makePath makePath: 
/collections/customcollreplicadeletion/leaders/a
   [junit4]   2> 74931 T248 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 2 
   [junit4]   2> 74934 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/customcollreplicadeletion/state.json
   [junit4]   2> 74935 T256 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74935 T286 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74936 T286 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 3 
   [junit4]   2> 74936 T256 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 3 
   [junit4]   2> 74938 T248 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 3 
   [junit4]   2> 74940 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 74940 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/customcollreplicadeletion/state.json
   [junit4]   2> 74941 T286 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74941 T256 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74942 T286 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 4 
   [junit4]   2> 74943 T256 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 4 
   [junit4]   2> 74985 T240 oasc.ZkController.register We are 
https://127.0.0.1:55432/kwy/customcollreplicadeletion_a_replica1/ and leader is 
https://127.0.0.1:55432/kwy/customcollreplicadeletion_a_replica1/
   [junit4]   2> 74986 T240 oasc.ZkController.register No LogReplay needed for 
core=customcollreplicadeletion_a_replica1 baseURL=https://127.0.0.1:55432/kwy
   [junit4]   2> 74986 T240 oasc.ZkController.checkRecovery I am the leader, no 
recovery necessary
   [junit4]   2> 74986 T240 oasc.ZkController.publish publishing 
core=customcollreplicadeletion_a_replica1 state=active 
collection=customcollreplicadeletion
   [junit4]   2> 74988 T256 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 74992 T240 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 4 
   [junit4]   2> 74993 T240 oass.SolrDispatchFilter.handleAdminRequest [admin] 
webapp=null path=/admin/cores 
params={qt=/admin/cores&collection.configName=conf1&name=customcollreplicadeletion_a_replica1&action=CREATE&numShards=2&collection=customcollreplicadeletion&shard=a&wt=javabin&version=2}
 status=0 QTime=354 
   [junit4]   2> 74995 T248 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 4 
   [junit4]   2> 74996 T248 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "core":"customcollreplicadeletion_a_replica1",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:55432/kwy";,
   [junit4]   2>          "node_name":"127.0.0.1:55432_kwy",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "shard":"a",
   [junit4]   2>          "collection":"customcollreplicadeletion",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 74998 T248 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to update_collection /collections/customcollreplicadeletion/state.json
   [junit4]   2> 74999 T286 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74999 T256 oascc.ZkStateReader$7.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/customcollreplicadeletion/state.json, has occurred - 
updating... 
   [junit4]   2> 74999 T286 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 5 
   [junit4]   2> 75003 T256 oascc.ZkStateReader.updateWatchedCollection 
Updating data for customcollreplicadeletion to ver 5 
   [junit4]   2> 75647 T278 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for customcollreplicadeletion_b_replica1
   [junit4]   2> 75648 T278 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:customcollreplicadeletion
   [junit4]   2> 75648 T278 oasc.ZkController.createCollectionZkNode Collection 
zkNode exists
   [junit4]   2> 75649 T278 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/customcollreplicadeletion
   [junit4]   2> 75650 T278 oascc.ZkStateReader.readConfigName 
path=/collections/customcollreplicadeletion configName=conf1 specified config 
exists in ZooKeeper
   [junit4]   2> 75650 T278 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/customcollreplicadeletion_b_replica1/'
   [junit4]   2> 75686 T278 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 75733 T278 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 75734 T278 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 75741 T278 oass.IndexSchema.readSchema 
[customcollreplicadeletion_b_replica1] Schema name=test
   [junit4]   2> 75890 T278 oass.OpenExchangeRatesOrgProvider.init Initialized 
with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 75896 T278 oass.IndexSchema.readSchema default search field in 
schema is text
   [junit4]   2> 75897 T278 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 75927 T278 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 75943 T278 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 75949 T278 oass.OpenExchangeRatesOrgProvider.reload Reloading 
exchange rates from open-exchange-rates.json
   [junit4]   2> 75956 T278 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 75957 T278 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 75957 T278 oass.OpenExchangeRatesOrgProvider.reload Reloading 
exchange rates from open-exchange-rates.json
   [junit4]   2> 75958 T278 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 75959 T278 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 75959 T278 oasc.CoreContainer.create Creating SolrCore 
'customcollreplicadeletion_b_replica1' using configuration from collection 
customcollreplicadeletion
   [junit4]   2> 75959 T278 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 75960 T278 oasc.SolrCore.<init> 
[customcollreplicadeletion_b_replica1] Opening new SolrCore at 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/customcollreplicadeletion_b_replica1/,
 
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-DF1F884DADB46034-001/tempDir-004/customcollreplicadeletion_b_replica1/data/
   [junit4]   2> 75961 T278 oasc.JmxMonitoredMap.<init> JMX monitoring

[...truncated too long message...]

ctoryFactoryTest$GetDirThread.run(CachingDirectoryFactoryTest.java:190)Throwable
 #10: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=6938, name=Thread-2500, state=RUNNABLE, 
group=TGRP-CachingDirectoryFactoryTest]
   [junit4]    > Caused by: java.security.AccessControlException: access denied 
("java.io.FilePermission" "path11/7/17" "write")
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([DF1F884DADB46034]:0)
   [junit4]    >        at 
java.security.AccessControlContext.checkPermission(AccessControlContext.java:457)
   [junit4]    >        at 
java.security.AccessController.checkPermission(AccessController.java:884)
   [junit4]    >        at 
java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
   [junit4]    >        at 
java.lang.SecurityManager.checkWrite(SecurityManager.java:979)
   [junit4]    >        at sun.nio.fs.UnixPath.checkWrite(UnixPath.java:801)
   [junit4]    >        at 
sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:376)
   [junit4]    >        at java.nio.file.Files.createDirectory(Files.java:674)
   [junit4]    >        at 
java.nio.file.Files.createAndCheckIsDirectory(Files.java:781)
   [junit4]    >        at java.nio.file.Files.createDirectories(Files.java:727)
   [junit4]    >        at 
org.apache.lucene.store.FSLockFactory.setLockDir(FSLockFactory.java:46)
   [junit4]    >        at 
org.apache.lucene.store.SimpleFSLockFactory.<init>(SimpleFSLockFactory.java:81)
   [junit4]    >        at 
org.apache.solr.core.CachingDirectoryFactory.injectLockFactory(CachingDirectoryFactory.java:500)
   [junit4]    >        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:357)
   [junit4]    >        at 
org.apache.solr.core.CachingDirectoryFactoryTest$GetDirThread.run(CachingDirectoryFactoryTest.java:190)Throwable
 #11: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
uncaught exception in thread: Thread[id=6943, name=Thread-2505, state=RUNNABLE, 
group=TGRP-CachingDirectoryFactoryTest]
   [junit4]    > Caused by: java.security.AccessControlException: access denied 
("java.io.FilePermission" "path11/7/17" "write")
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([DF1F884DADB46034]:0)
   [junit4]    >        at 
java.security.AccessControlContext.checkPermission(AccessControlContext.java:457)
   [junit4]    >        at 
java.security.AccessController.checkPermission(AccessController.java:884)
   [junit4]    >        at 
java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
   [junit4]    >        at 
java.lang.SecurityManager.checkWrite(SecurityManager.java:979)
   [junit4]    >        at sun.nio.fs.UnixPath.checkWrite(UnixPath.java:801)
   [junit4]    >        at 
sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:376)
   [junit4]    >        at java.nio.file.Files.createDirectory(Files.java:674)
   [junit4]    >        at 
java.nio.file.Files.createAndCheckIsDirectory(Files.java:781)
   [junit4]    >        at java.nio.file.Files.createDirectories(Files.java:727)
   [junit4]    >        at 
org.apache.lucene.store.FSLockFactory.setLockDir(FSLockFactory.java:46)
   [junit4]    >        at 
org.apache.lucene.store.SimpleFSLockFactory.<init>(SimpleFSLockFactory.java:81)
   [junit4]    >        at 
org.apache.solr.core.CachingDirectoryFactory.injectLockFactory(CachingDirectoryFactory.java:500)
   [junit4]    >        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:357)
   [junit4]    >        at 
org.apache.solr.core.CachingDirectoryFactoryTest$GetDirThread.run(CachingDirectoryFactoryTest.java:190)
   [junit4]   2> 2403804 T6934 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene410: {}, docValues:{}, 
sim=DefaultSimilarity, locale=ar_EG, timezone=Australia/West
   [junit4]   2> NOTE: Linux 3.13.0-35-generic amd64/Oracle Corporation 
1.8.0_40-ea (64-bit)/cpus=8,threads=1,free=322777160,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [ExpressionTest, 
HdfsDirectoryTest, TestSchemaVersionResource, XsltUpdateRequestHandlerTest, 
TestChildDocTransformer, ModifyConfFileTest, TestReRankQParserPlugin, 
SolrTestCaseJ4Test, TestParamSet, TestFreeTextSuggestions, TestComponentsName, 
ExternalCollectionsTest, DeleteLastCustomShardedReplicaTest, 
CoreMergeIndexesAdminHandlerTest, IndexSchemaTest, CursorMarkTest, 
RollingRestartTest, TestLuceneMatchVersion, CurrencyFieldOpenExchangeTest, 
TestMiniSolrCloudCluster, TestSort, SyncSliceTest, TestSimpleQParserPlugin, 
FieldMutatingUpdateProcessorTest, BasicFunctionalityTest, TestCodecSupport, 
JSONWriterTest, TestCopyFieldCollectionResource, FastVectorHighlighterTest, 
TestSolr4Spatial, TestHashPartitioner, DocumentBuilderTest, 
TestReplicationHandler, AsyncMigrateRouteKeyTest, PingRequestHandlerTest, 
SpellingQueryConverterTest, TestSystemIdResolver, JsonLoaderTest, 
DistribDocExpirationUpdateProcessorTest, TestRecoveryHdfs, 
ResponseLogComponentTest, TestManagedStopFilterFactory, 
SharedFSAutoReplicaFailoverUtilsTest, TestShardHandlerFactory, TestConfig, 
TestLRUCache, DeleteShardTest, SolrCoreCheckLockOnStartupTest, 
TestFastLRUCache, TestDefaultSimilarityFactory, TestWordDelimiterFilterFactory, 
TestFieldResource, ZkCLITest, IndexBasedSpellCheckerTest, 
HighlighterConfigTest, TestSolrCoreProperties, StressHdfsTest, TestSolrJ, 
TestMissingGroups, LeaderElectionTest, SignatureUpdateProcessorFactoryTest, 
DirectUpdateHandlerTest, TestSolrXmlPersistence, 
OverseerCollectionProcessorTest, HdfsSyncSliceTest, SystemInfoHandlerTest, 
ReturnFieldsTest, AssignTest, TestStressUserVersions, HdfsRecoveryZkTest, 
TimeZoneUtilsTest, TestAnalyzeInfixSuggestions, 
TestLMDirichletSimilarityFactory, ZkNodePropsTest, 
StatelessScriptUpdateProcessorFactoryTest, MBeansHandlerTest, 
DocValuesMultiTest, TriLevelCompositeIdRoutingTest, 
PathHierarchyTokenizerFactoryTest, DocValuesMissingTest, 
TestDFRSimilarityFactory, SuggesterWFSTTest, TestCoreDiscovery, TestOrdValues, 
TestMaxScoreQueryParser, DistributedFacetPivotLargeTest, 
UnloadDistributedZkTest, PreAnalyzedUpdateProcessorTest, 
TestLMJelinekMercerSimilarityFactory, TestManagedResource, 
TestShortCircuitedRequests, DistributedExpandComponentTest, 
HighlighterMaxOffsetTest, TestRTGBase, TestSolrDeletionPolicy2, TestDocSet, 
QueryEqualityTest, RegexBoostProcessorTest, EchoParamsTest, 
TestManagedSynonymFilterFactory, DistributedQueryComponentCustomSortTest, 
DisMaxRequestHandlerTest, DistributedDebugComponentTest, SimpleFacetsTest, 
BasicDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, 
RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestZkChroot, 
TestRandomDVFaceting, TestDistributedGrouping, ZkControllerTest, 
TestStressReorder, TestJoin, HardAutoCommitTest, TestRangeQuery, 
TestCoreContainer, StatsComponentTest, SpellCheckComponentTest, 
SolrCmdDistributorTest, BadIndexSchemaTest, TestFunctionQuery, TestBadConfig, 
HighlighterTest, ShowFileRequestHandlerTest, SolrIndexSplitterTest, 
SimplePostToolTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, 
SpellCheckCollatorTest, CoreAdminHandlerTest, TestTrie, 
WordBreakSolrSpellCheckerTest, TestUpdate, TestAtomicUpdateErrorCases, 
DirectUpdateHandlerOptimizeTest, SortByFunctionTest, TestRemoteStreaming, 
DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, 
FileBasedSpellCheckerTest, RequestHandlersTest, TestValueSourceCache, 
TestIndexingPerformance, TestSolrQueryParser, TestJmxIntegration, 
TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, 
CoreContainerCoreInitFailuresTest, SOLR749Test, UpdateParamsTest, 
TestQuerySenderNoQuery, BadComponentTest, SampleTest, TestSearchPerf, 
MinimalSchemaTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, 
TestPostingsSolrHighlighter, DirectSolrConnectionTest, 
NotRequiredUniqueKeyTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, 
TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, 
TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, 
LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TestFastOutputStream, 
OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, 
ChaosMonkeyNothingIsSafeTest, TestHighlightDedupGrouping, FieldFacetTest, 
CollectionsAPIAsyncDistributedZkTest, DeleteReplicaTest, RemoteQueryErrorTest, 
TestLeaderElectionZkExpiry, TestModifyConfFiles, 
VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, 
HdfsBasicDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, 
HdfsCollectionsAPIDistributedZkTest, HdfsUnloadDistributedZkTest, 
CachingDirectoryFactoryTest]
   [junit4] Completed on J0 in 8.17s, 1 test, 1 error <<< FAILURES!

[...truncated 185 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:491: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:471: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:60: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1358:
 The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: 
There were test failures: 438 suites, 1830 tests, 3 suite-level errors, 4 
errors, 45 ignored (23 assumptions)

Total time: 90 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_40-ea-b04 
-XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to