Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11778/
Java: 32bit/jdk1.8.0_40-ea-b09 -client -XX:+UseSerialGC (asserts: false)

4 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
ERROR: SolrZkClient opens=19 closes=18

Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=19 closes=18
        at __randomizedtesting.SeedInfo.seed([9BBDF0BC2F99DBCD]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:461)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:188)
        at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
6 threads leaked from SUITE scope at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=3456, 
name=zkCallback-366-thread-2, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=3510, 
name=zkCallback-366-thread-4, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=3323, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-SendThread(127.0.0.1:44872),
 state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)    4) 
Thread[id=3470, name=zkCallback-366-thread-3, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    5) Thread[id=3325, 
name=zkCallback-366-thread-1, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    6) Thread[id=3324, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-EventThread,
 state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 6 threads leaked from SUITE 
scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=3456, name=zkCallback-366-thread-2, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=3510, name=zkCallback-366-thread-4, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=3323, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-SendThread(127.0.0.1:44872),
 state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
   4) Thread[id=3470, name=zkCallback-366-thread-3, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=3325, name=zkCallback-366-thread-1, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   6) Thread[id=3324, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-EventThread,
 state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
        at __randomizedtesting.SeedInfo.seed([9BBDF0BC2F99DBCD]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=3456, name=zkCallback-366-thread-2, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=3510, 
name=zkCallback-366-thread-4, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=3323, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-SendThread(127.0.0.1:44872),
 state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    
4) Thread[id=3470, name=zkCallback-366-thread-3, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    5) Thread[id=3325, 
name=zkCallback-366-thread-1, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=3456, name=zkCallback-366-thread-2, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=3510, name=zkCallback-366-thread-4, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=3323, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-SendThread(127.0.0.1:44872),
 state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   4) Thread[id=3470, name=zkCallback-366-thread-3, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=3325, name=zkCallback-366-thread-1, state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([9BBDF0BC2F99DBCD]:0)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
expected:<...DF0BC2F99DBCD-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
 but 
was:<...DF0BC2F99DBCD-001/te[stPropertyParamsForCreate-001/instanceDir-mxrd]>

Stack Trace:
org.junit.ComparisonFailure: 
expected:<...DF0BC2F99DBCD-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
 but 
was:<...DF0BC2F99DBCD-001/te[stPropertyParamsForCreate-001/instanceDir-mxrd]>
        at 
__randomizedtesting.SeedInfo.seed([9BBDF0BC2F99DBCD:1A5B7EA458C6BBF1]:0)
        at org.junit.Assert.assertEquals(Assert.java:125)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:1154)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:901)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9255 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/init-core-data-001
   [junit4]   2> 963252 T3130 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (true)
   [junit4]   2> 963252 T3130 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /
   [junit4]   2> 963255 T3130 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 963255 T3130 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 963256 T3131 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 963356 T3130 oasc.ZkTestServer.run start zk server on 
port:44872
   [junit4]   2> 963356 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963357 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963360 T3138 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@16ff8d5 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 963361 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963361 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 963361 T3130 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 963365 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963366 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963367 T3141 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a5ccbb name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 963367 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963368 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 963368 T3130 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 963370 T3130 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 963372 T3130 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 963373 T3130 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 963375 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 963376 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 963378 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 963379 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 963381 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 963382 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 963383 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 963384 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 963385 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 963385 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 963387 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 963387 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 963389 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 963389 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 963391 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 963391 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 963393 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 963394 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 963395 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 963396 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 963398 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 963398 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 963401 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963406 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963408 T3144 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5ee3ba name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 963409 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963409 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 963412 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963413 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963417 T3147 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@70c9cd name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 963417 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963418 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 963418 T3130 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 963420 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963422 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963423 T3150 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@17b03f9 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 963423 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963424 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 963424 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 963425 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/solrconfig.xml
   [junit4]   2> 963427 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 963428 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/schema.xml
   [junit4]   2> 963430 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 963430 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 963432 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 963433 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/stopwords.txt
   [junit4]   2> 963435 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 963435 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/protwords.txt
   [junit4]   2> 963437 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 963437 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/currency.xml
   [junit4]   2> 963439 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 963439 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/open-exchange-rates.json
   [junit4]   2> 963441 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 963442 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 963444 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 963444 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/old_synonyms.txt
   [junit4]   2> 963446 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 963447 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/synonyms.txt
   [junit4]   2> 963449 T3130 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 963450 T3130 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/elevate.xml
   [junit4]   2> 963751 T3130 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 963757 T3130 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 963768 T3130 oejs.AbstractConnector.doStart Started 
[email protected]:47456
   [junit4]   2> 963770 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 963771 T3130 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 963771 T3130 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-002
   [junit4]   2> 963772 T3130 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-002/'
   [junit4]   2> 963787 T3130 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-002/solr.xml
   [junit4]   2> 963797 T3130 oasc.CoreContainer.<init> New CoreContainer 
7565133
   [junit4]   2> 963798 T3130 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-002/]
   [junit4]   2> 963799 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 963799 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 963799 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 963800 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 963800 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 963800 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 963801 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 963801 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 963801 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 963802 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 963804 T3130 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 963806 T3130 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 963806 T3130 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 963806 T3130 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 963807 T3130 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:44872/solr
   [junit4]   2> 963807 T3130 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 963807 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963808 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963810 T3162 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@16771fb name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 963810 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963811 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 963817 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963819 T3165 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5481b4 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 963819 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963821 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 963824 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 963827 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 963830 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 963833 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 963836 T3130 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 963837 T3130 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47456_
   [junit4]   2> 963838 T3130 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:47456_
   [junit4]   2> 963841 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 963843 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 963845 T3130 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 963847 T3130 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:47456_
   [junit4]   2> 963847 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 963849 T3130 oasc.Overseer.start Overseer 
(id=93000619690295302-127.0.0.1:47456_-n_0000000000) starting
   [junit4]   2> 963851 T3130 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 963865 T3130 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 963866 T3167 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 963867 T3130 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 963869 T3130 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 963870 T3130 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 963873 T3166 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 963874 T3130 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 963875 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 963879 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 963880 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 963882 T3172 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1dc48d7 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 963882 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 963882 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 963883 T3130 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 963886 T3130 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 964172 T3130 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 964173 T3130 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 964177 T3130 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 964179 T3130 oejs.AbstractConnector.doStart Started 
[email protected]:40313
   [junit4]   2> 964182 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 964182 T3130 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 964182 T3130 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003
   [junit4]   2> 964183 T3130 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/'
   [junit4]   2> 964200 T3130 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solr.xml
   [junit4]   2> 964212 T3130 oasc.CoreContainer.<init> New CoreContainer 
5612793
   [junit4]   2> 964212 T3130 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/]
   [junit4]   2> 964213 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 964213 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 964213 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 964214 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 964214 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 964214 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 964214 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 964215 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 964215 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 964215 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 964217 T3130 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 964218 T3130 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 964218 T3130 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 964219 T3130 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 964219 T3130 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:44872/solr
   [junit4]   2> 964219 T3130 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 964220 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 964220 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 964222 T3184 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@9095b name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 964223 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 964223 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 964227 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 964228 T3187 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@87bdd3 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 964229 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 964235 T3130 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 965238 T3130 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40313_
   [junit4]   2> 965239 T3130 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:40313_
   [junit4]   2> 965243 T3130 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 965246 T3130 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 965246 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 965521 T3130 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 965522 T3130 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 965526 T3130 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 965527 T3130 oejs.AbstractConnector.doStart Started 
[email protected]:46008
   [junit4]   2> 965529 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 965529 T3130 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 965529 T3130 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-004
   [junit4]   2> 965530 T3130 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-004/'
   [junit4]   2> 965545 T3130 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-004/solr.xml
   [junit4]   2> 965558 T3130 oasc.CoreContainer.<init> New CoreContainer 
31151079
   [junit4]   2> 965558 T3130 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-004/]
   [junit4]   2> 965559 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 965559 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 965559 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 965560 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 965560 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 965560 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 965560 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 965561 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 965561 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 965561 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 965563 T3130 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 965564 T3130 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 965564 T3130 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 965565 T3130 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 965565 T3130 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:44872/solr
   [junit4]   2> 965565 T3130 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 965565 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 965566 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 965568 T3200 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1ded8bd name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 965568 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 965569 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 965573 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 965575 T3203 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@aafdb name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 965575 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 965585 T3130 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 966592 T3130 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46008_
   [junit4]   2> 966593 T3130 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:46008_
   [junit4]   2> 966597 T3130 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 966601 T3130 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 966601 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 966876 T3130 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 966876 T3130 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 966880 T3130 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 966883 T3130 oejs.AbstractConnector.doStart Started 
[email protected]:56637
   [junit4]   2> 966885 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 966886 T3130 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 966886 T3130 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-005
   [junit4]   2> 966886 T3130 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-005/'
   [junit4]   2> 966901 T3130 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-005/solr.xml
   [junit4]   2> 966914 T3130 oasc.CoreContainer.<init> New CoreContainer 
24810006
   [junit4]   2> 966915 T3130 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-005/]
   [junit4]   2> 966915 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 966916 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 966916 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 966916 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 966917 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 966917 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 966917 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 966918 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 966918 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 966918 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 966920 T3130 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 966921 T3130 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 966921 T3130 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 966922 T3130 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 966922 T3130 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:44872/solr
   [junit4]   2> 966922 T3130 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 966923 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 966923 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 966926 T3216 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@b01bd5 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 966927 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 966927 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 966931 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 966932 T3219 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@81d300 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 966932 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 966938 T3130 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 967941 T3130 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56637_
   [junit4]   2> 967942 T3130 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:56637_
   [junit4]   2> 967946 T3130 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 967949 T3130 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 967950 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 968287 T3130 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 968288 T3130 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 968291 T3130 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 968293 T3130 oejs.AbstractConnector.doStart Started 
[email protected]:34540
   [junit4]   2> 968295 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 968295 T3130 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 968296 T3130 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-006
   [junit4]   2> 968296 T3130 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-006/'
   [junit4]   2> 968312 T3130 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-006/solr.xml
   [junit4]   2> 968335 T3130 oasc.CoreContainer.<init> New CoreContainer 
29272915
   [junit4]   2> 968335 T3130 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-006/]
   [junit4]   2> 968336 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 120000
   [junit4]   2> 968337 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: null
   [junit4]   2> 968337 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 968337 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 968338 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnections to: 10000
   [junit4]   2> 968338 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 968338 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 968339 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 968339 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 968339 T3130 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 968341 T3130 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 968342 T3130 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 968342 T3130 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 968343 T3130 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 968343 T3130 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:44872/solr
   [junit4]   2> 968344 T3130 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 968344 T3130 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 968345 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 968347 T3232 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4b05b3 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 968348 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 968349 T3130 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 968351 T3130 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 968357 T3235 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b74a26 name:ZooKeeperConnection 
Watcher:127.0.0.1:44872/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 968358 T3130 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 968363 T3130 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 969366 T3130 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34540_
   [junit4]   2> 969368 T3130 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:34540_
   [junit4]   2> 969372 T3130 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 969375 T3130 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 969376 T3130 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 969546 T3179 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&action=CREATE&numShards=2&wt=javabin&version=2
   [junit4]   2> 969548 T3165 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/collection-queue-work state 
SyncConnected
   [junit4]   2> 969549 T3167 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 969551 T3237 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 969552 T3237 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 969553 T3237 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 969557 T3165 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 969561 T3166 oasc.Overseer$ClusterStateUpdater.run 
processMessage: queueSize: 0, message = {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"} current state version: 0
   [junit4]   2> 969561 T3166 oasco.ClusterStateMutator.createCollection 
building a new cName: solrj_collection
   [junit4]   2> 969563 T3172 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 969563 T3165 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 969563 T3187 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 969564 T3203 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 969563 T3219 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 969563 T3235 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 969758 T3237 oasc.OverseerCollectionProcessor.createCollection 
Creating SolrCores for new collection solrj_collection, shardNames [shard1, 
shard2] , replicationFactor : 2
   [junit4]   2> 969758 T3237 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:47456_
   [junit4]   2> 969759 T3237 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:56637_
   [junit4]   2> 969761 T3237 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:40313_
   [junit4]   2> 969763 T3237 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:46008_
   [junit4]   2> 969978 T3178 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 969980 T3178 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 969981 T3178 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 969982 T3165 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 969983 T3166 oasc.Overseer$ClusterStateUpdater.run 
processMessage: queueSize: 1, message = {
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:40313";,
   [junit4]   2>          "node_name":"127.0.0.1:40313_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"} current state version: 1
   [junit4]   2> 969984 T3166 oasco.ReplicaMutator.updateState Update state 
numShards=2 message={
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:40313";,
   [junit4]   2>          "node_name":"127.0.0.1:40313_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 969995 T3156 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 969998 T3156 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 969999 T3165 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 969999 T3156 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 970000 T3166 oasc.Overseer$ClusterStateUpdater.run 
processMessage: queueSize: 1, message = {
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:47456";,
   [junit4]   2>          "node_name":"127.0.0.1:47456_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"} current state version: 1
   [junit4]   2> 970001 T3166 oasco.ReplicaMutator.updateState Update state 
numShards=2 message={
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:47456";,
   [junit4]   2>          "node_name":"127.0.0.1:47456_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 970036 T3213 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 970038 T3213 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 970040 T3165 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 970040 T3213 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 970042 T3194 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 970042 T3166 oasc.Overseer$ClusterStateUpdater.run 
processMessage: queueSize: 1, message = {
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:56637";,
   [junit4]   2>          "node_name":"127.0.0.1:56637_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"} current state version: 1
   [junit4]   2> 970043 T3194 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 970043 T3166 oasco.ReplicaMutator.updateState Update state 
numShards=2 message={
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:56637";,
   [junit4]   2>          "node_name":"127.0.0.1:56637_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 970045 T3194 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 970047 T3166 oasc.Overseer$ClusterStateUpdater.run 
processMessage: queueSize: 1, message = {
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:46008";,
   [junit4]   2>          "node_name":"127.0.0.1:46008_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"} current state version: 1
   [junit4]   2> 970048 T3166 oasco.ReplicaMutator.updateState Update state 
numShards=2 message={
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "base_url":"https://127.0.0.1:46008";,
   [junit4]   2>          "node_name":"127.0.0.1:46008_",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 970050 T3165 oasc.DistributedQueue$LatchWatcher.process 
NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 970051 T3172 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 970051 T3203 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 970051 T3187 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 970051 T3219 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 970051 T3235 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 970051 T3165 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 970982 T3178 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 970983 T3178 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 970984 T3178 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 970984 T3178 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 970986 T3178 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 970986 T3178 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solrj_collection_shard2_replica1/'
   [junit4]   2> 971000 T3156 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 971001 T3156 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 971001 T3156 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 971002 T3156 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 971003 T3156 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 971003 T3156 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-002/solrj_collection_shard1_replica1/'
   [junit4]   2> 971014 T3178 oasc.ZkController.watchZKConfDir watch zkdir 
/configs/conf1
   [junit4]   2> 971016 T3178 oasc.Config.<init> loaded config solrconfig.xml 
with version 0 
   [junit4]   2> 971021 T3156 oasc.ZkController.watchZKConfDir watch zkdir 
/configs/conf1
   [junit4]   2> 971023 T3156 oasc.Config.<init> loaded config solrconfig.xml 
with version 0 
   [junit4]   2> 971041 T3213 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 971042 T3213 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 971043 T3213 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 971044 T3213 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 971045 T3194 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 971045 T3213 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 971046 T3194 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 971046 T3213 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-005/solrj_collection_shard1_replica2/'
   [junit4]   2> 971048 T3194 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 971048 T3194 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 971052 T3194 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 971052 T3194 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-004/solrj_collection_shard2_replica2/'
   [junit4]   2> 971056 T3178 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
6.0.0
   [junit4]   2> 971064 T3156 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
6.0.0
   [junit4]   2> 971084 T3213 oasc.ZkController.watchZKConfDir watch zkdir 
/configs/conf1
   [junit4]   2> 971086 T3213 oasc.Config.<init> loaded config solrconfig.xml 
with version 0 
   [junit4]   2> 971087 T3178 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 971088 T3178 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 971090 T3194 oasc.ZkController.watchZKConfDir watch zkdir 
/configs/conf1
   [junit4]   2> 971092 T3194 oasc.Config.<init> loaded config solrconfig.xml 
with version 0 
   [junit4]   2> 971098 T3156 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 971100 T3156 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 971108 T3213 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
6.0.0
   [junit4]   2> 971110 T3194 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
6.0.0
   [junit4]   2> 971139 T3213 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 971140 T3178 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 971143 T3194 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 971143 T3213 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 971144 T3194 oass.IndexSchema.readSchema Reading Solr Schema 
from /configs/conf1/schema.xml
   [junit4]   2> 971149 T3156 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 971191 T3213 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 971213 T3194 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 971452 T3178 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 971471 T3178 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 971475 T3178 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 971495 T3156 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 971502 T3156 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 971505 T3156 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 971505 T3213 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 971510 T3178 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 971512 T3213 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 971514 T3213 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 971515 T3194 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 971517 T3178 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 971521 T3194 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 971523 T3178 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 971523 T3194 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 971524 T3178 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 971527 T3178 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 971527 T3156 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 971527 T3178 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 971529 T3178 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 971529 T3178 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 971530 T3178 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 971530 T3178 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 971530 T3178 oasc.SolrCore.<init> 
[solrj_collection_shard2_replica1] Opening new SolrCore at 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solrj_collection_shard2_replica1/,
 
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solrj_collection_shard2_replica1/data/
   [junit4]   2> 971531 T3178 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1b3de51
   [junit4]   2> 971533 T3213 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 971534 T3156 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 971535 T3178 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solrj_collection_shard2_replica1/data
   [junit4]   2> 971536 T3178 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 971536 T3178 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard2_replica1] Solr index directory 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest-9BBDF0BC2F99DBCD-001/tempDir-003/solrj_collection_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 971537 T3178 oasc.CachingDirectoryFactory.get return new dire

[...truncated too long message...]

ronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=3323, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-SendThread(127.0.0.1:44872),
 state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
   [junit4]    >    4) Thread[id=3470, name=zkCallback-366-thread-3, 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=3325, name=zkCallback-366-thread-1, 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    6) Thread[id=3324, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-EventThread,
 state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9BBDF0BC2F99DBCD]:0)Throwable #3: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=3456, name=zkCallback-366-thread-2, 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=3510, name=zkCallback-366-thread-4, 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=3323, 
name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[9BBDF0BC2F99DBCD]-SendThread(127.0.0.1:44872),
 state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >    4) Thread[id=3470, name=zkCallback-366-thread-3, 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=3325, name=zkCallback-366-thread-1, 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9BBDF0BC2F99DBCD]:0)
   [junit4] Completed on J1 in 105.26s, 1 test, 2 failures, 2 errors <<< 
FAILURES!

[...truncated 975 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:187: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:510: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1349:
 The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:956: 
There were test failures: 452 suites, 1849 tests, 3 suite-level errors, 1 
failure, 1091 ignored (15 assumptions)

Total time: 57 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b09 -client 
-XX:+UseSerialGC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to