Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/639/

4 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
The Monkey ran for over 20 seconds and no jetties were stopped - this is worth 
investigating!

Stack Trace:
java.lang.AssertionError: The Monkey ran for over 20 seconds and no jetties 
were stopped - this is worth investigating!
        at 
__randomizedtesting.SeedInfo.seed([90BC362B74A11273:115AB83303FE724F]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.ChaosMonkey.stopTheMonkey(ChaosMonkey.java:535)
        at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:140)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
2 threads leaked from SUITE scope at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest:     1) Thread[id=8505, 
name=StopableIndexingThread, state=TIMED_WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:121)
    2) Thread[id=8506, name=StopableIndexingThread, state=TIMED_WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]         at java.lang.Thread.sleep(Native 
Method)         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:121)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE 
scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   1) Thread[id=8505, name=StopableIndexingThread, state=TIMED_WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:121)
   2) Thread[id=8506, name=StopableIndexingThread, state=TIMED_WAITING, 
group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:121)
        at __randomizedtesting.SeedInfo.seed([90BC362B74A11273]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=8506, name=StopableIndexingThread, state=BLOCKED, 
group=TGRP-ChaosMonkeySafeLeaderTest]         at 
java.io.PrintStream.println(PrintStream.java:806)         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:107)
    2) Thread[id=8505, name=StopableIndexingThread, state=RUNNABLE, 
group=TGRP-ChaosMonkeySafeLeaderTest]         at 
java.security.AccessController.getStackAccessControlContext(Native Method)      
   at java.security.AccessController.checkPermission(AccessController.java:533) 
        at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)  
       at 
java.lang.reflect.AccessibleObject.setAccessible(AccessibleObject.java:128)     
    at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.ConstructorConstructor.newDefaultConstructor(ConstructorConstructor.java:84)
         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.ConstructorConstructor.getConstructor(ConstructorConstructor.java:66)
         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.ReflectiveTypeAdapterFactory.create(ReflectiveTypeAdapterFactory.java:64)
         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.MiniGson.getAdapter(MiniGson.java:92)
         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.Gson.toJson(Gson.java:504)
         at 
com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:87)
         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$4.write(SlaveMain.java:410)   
      at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) 
        at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)    
     at java.io.PrintStream.flush(PrintStream.java:338)         at 
java.io.FilterOutputStream.flush(FilterOutputStream.java:140)         at 
java.io.PrintStream.write(PrintStream.java:482)         at 
sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)         at 
sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)         at 
sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:104)         at 
java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:185)         at 
java.io.PrintStream.newLine(PrintStream.java:546)         at 
java.io.PrintStream.println(PrintStream.java:824)         at 
java.lang.Throwable$WrappedPrintStream.println(Throwable.java:748)         at 
java.lang.Throwable.printStackTrace(Throwable.java:658)         at 
java.lang.Throwable.printStackTrace(Throwable.java:643)         at 
java.lang.Throwable.printStackTrace(Throwable.java:634)         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:108)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=8506, name=StopableIndexingThread, state=BLOCKED, 
group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.io.PrintStream.println(PrintStream.java:806)
        at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:107)
   2) Thread[id=8505, name=StopableIndexingThread, state=RUNNABLE, 
group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.security.AccessController.getStackAccessControlContext(Native 
Method)
        at 
java.security.AccessController.checkPermission(AccessController.java:533)
        at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
        at 
java.lang.reflect.AccessibleObject.setAccessible(AccessibleObject.java:128)
        at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.ConstructorConstructor.newDefaultConstructor(ConstructorConstructor.java:84)
        at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.ConstructorConstructor.getConstructor(ConstructorConstructor.java:66)
        at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.ReflectiveTypeAdapterFactory.create(ReflectiveTypeAdapterFactory.java:64)
        at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.MiniGson.getAdapter(MiniGson.java:92)
        at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.Gson.toJson(Gson.java:504)
        at 
com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:87)
        at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$4.write(SlaveMain.java:410)
        at 
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
        at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
        at java.io.PrintStream.flush(PrintStream.java:338)
        at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
        at java.io.PrintStream.write(PrintStream.java:482)
        at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
        at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
        at sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:104)
        at java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:185)
        at java.io.PrintStream.newLine(PrintStream.java:546)
        at java.io.PrintStream.println(PrintStream.java:824)
        at java.lang.Throwable$WrappedPrintStream.println(Throwable.java:748)
        at java.lang.Throwable.printStackTrace(Throwable.java:658)
        at java.lang.Throwable.printStackTrace(Throwable.java:643)
        at java.lang.Throwable.printStackTrace(Throwable.java:634)
        at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:108)
        at __randomizedtesting.SeedInfo.seed([90BC362B74A11273]:0)


REGRESSION:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create 
core [halfcollection_shard1_replica1] Caused by: Could not get shard id for 
core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error 
CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12073 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/init-core-data-001
   [junit4]   2> 678133 T14078 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (true)
   [junit4]   2> 678133 T14078 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /qhf/
   [junit4]   2> 678140 T14078 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 678141 T14078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 678142 T14079 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 678241 T14078 oasc.ZkTestServer.run start zk server on 
port:23673
   [junit4]   2> 678242 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 678243 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 678257 T14085 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@50cb4e7a 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 678257 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 678258 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 678258 T14078 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 678261 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 678263 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 678264 T14087 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@16f06d12 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 678264 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 678264 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 678265 T14078 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 678267 T14078 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 678269 T14078 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 678270 T14078 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 678273 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 678274 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 678277 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 678277 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 678280 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 678281 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 678283 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 678283 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 678286 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 678286 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 678288 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 678289 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 678291 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 678292 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 678294 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 678294 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 678297 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 678297 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 678299 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 678300 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 678302 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 678303 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 678305 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 678306 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 678307 T14089 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@489df7e5 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 678307 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 678308 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 678309 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 678310 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 678311 T14091 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7998150c 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 678311 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 678312 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 678312 T14078 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 678314 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 678314 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 678315 T14093 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2bea0fa0 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 678316 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 678316 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 678318 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 678318 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/solrconfig.xml
   [junit4]   2> 678321 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 678321 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/schema.xml
   [junit4]   2> 678324 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 678324 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 678326 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 678327 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/stopwords.txt
   [junit4]   2> 678329 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 678329 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/protwords.txt
   [junit4]   2> 678331 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 678332 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/currency.xml
   [junit4]   2> 678334 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 678334 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/open-exchange-rates.json
   [junit4]   2> 678336 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 678337 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 678339 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 678339 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/old_synonyms.txt
   [junit4]   2> 678341 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 678342 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/synonyms.txt
   [junit4]   2> 678344 T14078 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 678345 T14078 oascc.SolrZkClient.makePath makePath: 
/configs/conf2/elevate.xml
   [junit4]   2> 679570 T14078 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 679575 T14078 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 679579 T14078 oejs.AbstractConnector.doStart Started 
[email protected]:23683
   [junit4]   2> 679581 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 679582 T14078 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 679582 T14078 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002
   [junit4]   2> 679582 T14078 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/'
   [junit4]   2> 679612 T14078 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/solr.xml
   [junit4]   2> 679655 T14078 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002
   [junit4]   2> 679656 T14078 oasc.CoreContainer.<init> New CoreContainer 
1533555223
   [junit4]   2> 679656 T14078 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/]
   [junit4]   2> 679657 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 679657 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 679657 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 679658 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 679658 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 679658 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 679658 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 679658 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 679659 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 679661 T14078 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 679662 T14078 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 679663 T14078 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 679663 T14078 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 679663 T14078 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:23673/solr
   [junit4]   2> 679664 T14078 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 679664 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 679665 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 679666 T14104 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@689c680b 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 679667 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 679668 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 679669 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 679671 T14106 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@538a1556 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 679671 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 679672 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 679675 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 679677 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 679680 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 679682 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 679685 T14078 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 679687 T14078 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23683_qhf
   [junit4]   2> 679688 T14078 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:23683_qhf
   [junit4]   2> 679690 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 679691 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 679693 T14078 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 679694 T14078 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:23683_qhf
   [junit4]   2> 679694 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 679696 T14078 oasc.Overseer.start Overseer 
(id=92560882149163014-127.0.0.1:23683_qhf-n_0000000000) starting
   [junit4]   2> 679698 T14078 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 679705 T14078 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 679706 T14108 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 679707 T14078 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 679708 T14078 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 679709 T14078 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 679712 T14107 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 679715 T14078 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002
   [junit4]   2> 680478 T14078 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/conf/
   [junit4]   2> 680557 T14078 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 680559 T14078 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 680559 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 680562 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 680563 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 680564 T14112 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@63128123 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 680564 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 680564 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 680565 T14078 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 680567 T14078 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 680568 T14078 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 680568 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 680569 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 680570 T14114 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1d2c7d5 name:ZooKeeperConnection 
Watcher:127.0.0.1:23673/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 680570 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 680570 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 680572 T14115 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 680574 T14107 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
collection1
   [junit4]   2> 680574 T14107 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 680574 T14107 
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 680576 T14107 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 680577 T14115 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 680577 T14116 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 681510 T14078 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 681511 T14078 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 681514 T14078 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 681515 T14078 oejs.AbstractConnector.doStart Started 
[email protected]:23690
   [junit4]   2> 681518 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 681518 T14078 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 681518 T14078 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003
   [junit4]   2> 681518 T14078 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/'
   [junit4]   2> 681548 T14078 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/solr.xml
   [junit4]   2> 681590 T14078 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003
   [junit4]   2> 681590 T14078 oasc.CoreContainer.<init> New CoreContainer 
1550245041
   [junit4]   2> 681590 T14078 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/]
   [junit4]   2> 681591 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 681591 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 681592 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 681592 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 681592 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 681592 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 681593 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 681593 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 681593 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 681595 T14078 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 681596 T14078 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 681597 T14078 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 681597 T14078 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 681597 T14078 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:23673/solr
   [junit4]   2> 681597 T14078 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 681598 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 681598 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 681600 T14127 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@671a21f9 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 681600 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 681600 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 681602 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 681603 T14129 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@73780bac 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 681603 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 681607 T14078 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 682611 T14078 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23690_qhf
   [junit4]   2> 682612 T14078 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:23690_qhf
   [junit4]   2> 682615 T14078 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 682620 T14078 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003
   [junit4]   2> 682802 T14078 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/conf/
   [junit4]   2> 683490 T14078 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 683492 T14078 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 683492 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 684442 T14078 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 684443 T14078 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 684447 T14078 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 684448 T14078 oejs.AbstractConnector.doStart Started 
[email protected]:23695
   [junit4]   2> 684450 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 684451 T14078 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 684451 T14078 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004
   [junit4]   2> 684451 T14078 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004/'
   [junit4]   2> 684482 T14078 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004/solr.xml
   [junit4]   2> 684525 T14078 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004
   [junit4]   2> 684526 T14078 oasc.CoreContainer.<init> New CoreContainer 
1616823003
   [junit4]   2> 684526 T14078 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004/]
   [junit4]   2> 684527 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 684527 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 684527 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 684527 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 684528 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 684528 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 684528 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 684528 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 684529 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 684531 T14078 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 684532 T14078 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 684532 T14078 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 684533 T14078 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 684533 T14078 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:23673/solr
   [junit4]   2> 684533 T14078 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 684534 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 684534 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 684536 T14142 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@58ac462a 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684536 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 684537 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 684539 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 684540 T14144 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@481249ed 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684540 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 684545 T14078 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 685549 T14078 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23695_qhf
   [junit4]   2> 685550 T14078 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:23695_qhf
   [junit4]   2> 685554 T14078 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 685559 T14078 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004
   [junit4]   2> 686650 T14078 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004/conf/
   [junit4]   2> 686652 T14078 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 686653 T14078 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 686653 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 687915 T14078 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 687915 T14078 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 687920 T14078 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 687920 T14078 oejs.AbstractConnector.doStart Started 
[email protected]:23701
   [junit4]   2> 687923 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 687924 T14078 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 687924 T14078 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005
   [junit4]   2> 687924 T14078 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005/'
   [junit4]   2> 687954 T14078 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005/solr.xml
   [junit4]   2> 688042 T14078 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005
   [junit4]   2> 688043 T14078 oasc.CoreContainer.<init> New CoreContainer 
92636017
   [junit4]   2> 688043 T14078 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005/]
   [junit4]   2> 688045 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 688045 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 688045 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 688046 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 688046 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 688046 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 688047 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 688047 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 688047 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 688050 T14078 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 688052 T14078 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 688053 T14078 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 688053 T14078 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 688053 T14078 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:23673/solr
   [junit4]   2> 688054 T14078 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 688054 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 688055 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 688056 T14157 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6e54993c 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688057 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 688058 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 688060 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 688061 T14159 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4f2c9300 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688061 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 688066 T14078 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 689071 T14078 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23701_qhf
   [junit4]   2> 689072 T14078 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:23701_qhf
   [junit4]   2> 689076 T14078 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 689081 T14078 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005
   [junit4]   2> 690401 T14078 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-005/conf/
   [junit4]   2> 690417 T14078 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 690418 T14078 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 690418 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 691349 T14078 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 691350 T14078 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 691353 T14078 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 691354 T14078 oejs.AbstractConnector.doStart Started 
[email protected]:23707
   [junit4]   2> 691357 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 691357 T14078 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 691358 T14078 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006
   [junit4]   2> 691358 T14078 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006/'
   [junit4]   2> 691387 T14078 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006/solr.xml
   [junit4]   2> 691429 T14078 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006
   [junit4]   2> 691429 T14078 oasc.CoreContainer.<init> New CoreContainer 
1439136654
   [junit4]   2> 691430 T14078 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006/]
   [junit4]   2> 691430 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 691431 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 691431 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 691431 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 691431 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 691432 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 691432 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 691432 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 691432 T14078 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 691434 T14078 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 691436 T14078 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 691436 T14078 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 691436 T14078 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 691436 T14078 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:23673/solr
   [junit4]   2> 691437 T14078 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 691437 T14078 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 691438 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 691439 T14172 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@34808b17 
name:ZooKeeperConnection Watcher:127.0.0.1:23673 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 691440 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 691440 T14078 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 691442 T14078 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 691443 T14174 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3bacbce3 
name:ZooKeeperConnection Watcher:127.0.0.1:23673/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 691443 T14078 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 691448 T14078 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 692452 T14078 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23707_qhf
   [junit4]   2> 692453 T14078 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:23707_qhf
   [junit4]   2> 692457 T14078 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 692461 T14078 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006
   [junit4]   2> 693383 T14078 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006/conf/
   [junit4]   2> 693397 T14078 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 693398 T14078 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 693399 T14078 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 693527 T14125 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
collection.configName=conf1&action=CREATE&numShards=2&replicationFactor=2&name=solrj_collection&version=2&wt=javabin&router.field=myOwnField
   [junit4]   2> 693528 T14115 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 693529 T14108 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 693530 T14178 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 693532 T14178 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 693532 T14178 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 693535 T14115 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 693538 T14107 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
solrj_collection
   [junit4]   2> 693538 T14107 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
solrj_collection with shards [shard1, shard2]
   [junit4]   2> 693538 T14107 
oasc.Overseer$ClusterStateUpdater.createCollection state version 
solrj_collection 1
   [junit4]   2> 693540 T14145 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693540 T14160 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693540 T14115 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693540 T14116 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693540 T14175 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693540 T14130 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693635 T14178 
oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new 
collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 693636 T14178 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard1_replica1 as part of slice shard1 of collection 
solrj_collection on 127.0.0.1:23683_qhf
   [junit4]   2> 693637 T14178 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard1_replica2 as part of slice shard1 of collection 
solrj_collection on 127.0.0.1:23695_qhf
   [junit4]   2> 693639 T14178 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard2_replica1 as part of slice shard2 of collection 
solrj_collection on 127.0.0.1:23690_qhf
   [junit4]   2> 693642 T14178 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard2_replica2 as part of slice shard2 of collection 
solrj_collection on 127.0.0.1:23707_qhf
   [junit4]   2> 693757 T14097 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&action=CREATE&numShards=2&name=solrj_collection_shard1_replica1&qt=/admin/cores&collection=solrj_collection&version=2&wt=javabin&shard=shard1
   [junit4]   2> 693760 T14120 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&action=CREATE&numShards=2&name=solrj_collection_shard2_replica1&qt=/admin/cores&collection=solrj_collection&version=2&wt=javabin&shard=shard2
   [junit4]   2> 693761 T14135 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&action=CREATE&numShards=2&name=solrj_collection_shard1_replica2&qt=/admin/cores&collection=solrj_collection&version=2&wt=javabin&shard=shard1
   [junit4]   2> 693761 T14097 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 693762 T14115 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 693762 T14097 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 693763 T14120 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 693763 T14135 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 693763 T14120 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 693764 T14135 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 693765 T14107 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "node_name":"127.0.0.1:23683_qhf",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:23683/qhf";,
   [junit4]   2>          "shard":"shard1"}
   [junit4]   2> 693767 T14107 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "node_name":"127.0.0.1:23690_qhf",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:23690/qhf";,
   [junit4]   2>          "shard":"shard2"}
   [junit4]   2> 693769 T14115 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 693769 T14164 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&action=CREATE&numShards=2&name=solrj_collection_shard2_replica2&qt=/admin/cores&collection=solrj_collection&version=2&wt=javabin&shard=shard2
   [junit4]   2> 693770 T14107 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "node_name":"127.0.0.1:23695_qhf",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:23695/qhf";,
   [junit4]   2>          "shard":"shard1"}
   [junit4]   2> 693771 T14164 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 693772 T14164 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 693772 T14115 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 693773 T14107 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "node_name":"127.0.0.1:23707_qhf",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:23707/qhf";,
   [junit4]   2>          "shard":"shard2"}
   [junit4]   2> 693876 T14115 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693876 T14130 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693876 T14116 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693876 T14175 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693876 T14160 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 693876 T14145 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 694763 T14097 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 694764 T14097 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 694764 T14120 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 694765 T14097 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 694764 T14135 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 694765 T14097 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 694765 T14120 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 694766 T14135 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 694766 T14120 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 694766 T14097 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 694767 T14135 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 694767 T14120 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 694767 T14135 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 694767 T14097 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/solrj_collection_shard1_replica1/'
   [junit4]   2> 694768 T14120 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 694769 T14135 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 694769 T14120 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/solrj_collection_shard2_replica1/'
   [junit4]   2> 694769 T14135 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-004/solrj_collection_shard1_replica2/'
   [junit4]   2> 694772 T14164 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 694773 T14164 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 694773 T14164 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 694774 T14164 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 694775 T14164 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 694775 T14164 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-006/solrj_collection_shard2_replica2/'
   [junit4]   2> 694971 T14135 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 694972 T14164 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 694972 T14097 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 694972 T14120 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 5.0.0
   [junit4]   2> 695049 T14135 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 695050 T14164 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 695051 T14135 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 695050 T14120 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 695051 T14097 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 695051 T14164 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 695052 T14120 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 695052 T14097 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 695063 T14135 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 695065 T14164 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 695065 T14120 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 695065 T14097 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 695572 T14135 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 695572 T14097 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 695573 T14164 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 695573 T14120 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 695587 T14135 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 695588 T14097 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 695588 T14120 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 695589 T14164 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 695591 T14097 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 695591 T14135 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 695591 T14120 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 695593 T14164 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 695614 T14120 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695614 T14097 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695615 T14135 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695618 T14164 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695620 T14120 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695620 T14097 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695621 T14135 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695623 T14164 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 695624 T14120 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695625 T14097 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695625 T14120 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695628 T14120 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695628 T14135 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695628 T14097 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695628 T14120 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695629 T14135 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695629 T14097 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695630 T14120 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695630 T14120 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695630 T14164 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695630 T14135 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695631 T14120 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 695630 T14097 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695632 T14120 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 695632 T14164 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695631 T14135 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695633 T14164 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695633 T14097 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695633 T14120 oasc.SolrCore.<init> 
[solrj_collection_shard2_replica1] Opening new SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/solrj_collection_shard2_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/solrj_collection_shard2_replica1/data/
   [junit4]   2> 695634 T14097 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695634 T14135 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695633 T14164 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 695635 T14135 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695635 T14097 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 695634 T14120 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5c322524
   [junit4]   2> 695636 T14097 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 695636 T14164 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 695636 T14135 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 695637 T14120 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-003/solrj_collection_shard2_replica1/data
   [junit4]   2> 695637 T14164 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 695637 T14097 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica1] Opening new SolrCore at 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/solrj_collection_shard1_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-90BC362B74A11273-001/tempDir-002/solrj_collection_shard1_replica1/data/
   [junit4]   2> 695638 T14164 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 695638 T14120 oasc.SolrCore.getNewI

[...truncated too long message...]

http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]   2>        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:466)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]   2>        at 
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
   [junit4]   2>        at 
org.apache.solr.cloud.StopableIndexingThread.indexDoc(StopableIndexingThread.java:168)
   [junit4]   2>        at 
org.apache.solr.cloud.StopableIndexingThread.indexr(StopableIndexingThread.java:158)
   [junit4]   2>        at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:103)
   [junit4]   2> java.lang.IllegalStateException: Connection pool shut down
   [junit4]   2>        at org.apache.http.util.Asserts.check(Asserts.java:34)
   [junit4]   2>        at 
org.apache.http.pool.AbstractConnPool.lease(AbstractConnPool.java:169)
   [junit4]   2>        at 
org.apache.http.pool.AbstractConnPool.lease(AbstractConnPool.java:202)
   [junit4]   2>        at 
org.apache.http.impl.conn.PoolingClientConnectionManager.requestConnection(PoolingClientConnectionManager.java:184)
   [junit4]   2>        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:414)
   [junit4]   2>        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]   2>        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2>        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]   2>        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:466)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]   2>        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]   2>        at 
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
   [junit4]   2>        at 
org.apache.solr.cloud.StopableIndexingThread.indexDoc(StopableIndexingThread.java:168)
   [junit4]   2>        at 
org.apache.solr.cloud.StopableIndexingThread.indexr(StopableIndexingThread.java:158)
   [junit4]   2>        at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:103)
   [junit4]   2> 86093 T8506 ccr.RunnerThreadGroup.uncaughtException SEVERE 
RunnerThreadGroup's sub thread should always have a context and it didn't have 
any? java.lang.IllegalStateException: No context information for thread: 
Thread[id=8506, name=StopableIndexingThread, state=RUNNABLE, 
group=TGRP-ChaosMonkeySafeLeaderTest]. Is this thread running under a class 
com.carrotsearch.randomizedtesting.RandomizedRunner runner context? Add 
@RunWith(class com.carrotsearch.randomizedtesting.RandomizedRunner.class) to 
your test class. Make sure your code accesses random contexts within 
@BeforeClass and @AfterClass boundary (for example, static test class 
initializers are not permitted to access random contexts).
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:206)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:144)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.augmentStackTrace(RandomizedRunner.java:1753)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RunnerThreadGroup.uncaughtException(RunnerThreadGroup.java:23)
   [junit4]   2>        at 
java.lang.Thread.dispatchUncaughtException(Thread.java:1986)
   [junit4]   2> 
   [junit4] ERROR   0.00s J0 | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE 
scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   [junit4]    >    1) Thread[id=8505, name=StopableIndexingThread, 
state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:121)
   [junit4]    >    2) Thread[id=8506, name=StopableIndexingThread, 
state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:121)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([90BC362B74A11273]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=8506, name=StopableIndexingThread, 
state=BLOCKED, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    >         at java.io.PrintStream.println(PrintStream.java:806)
   [junit4]    >         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:107)
   [junit4]    >    2) Thread[id=8505, name=StopableIndexingThread, 
state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    >         at 
java.security.AccessController.getStackAccessControlContext(Native Method)
   [junit4]    >         at 
java.security.AccessController.checkPermission(AccessController.java:533)
   [junit4]    >         at 
java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
   [junit4]    >         at 
java.lang.reflect.AccessibleObject.setAccessible(AccessibleObject.java:128)
   [junit4]    >         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.ConstructorConstructor.newDefaultConstructor(ConstructorConstructor.java:84)
   [junit4]    >         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.ConstructorConstructor.getConstructor(ConstructorConstructor.java:66)
   [junit4]    >         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.ReflectiveTypeAdapterFactory.create(ReflectiveTypeAdapterFactory.java:64)
   [junit4]    >         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.MiniGson.getAdapter(MiniGson.java:92)
   [junit4]    >         at 
com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.Gson.toJson(Gson.java:504)
   [junit4]    >         at 
com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:87)
   [junit4]    >         at 
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
   [junit4]    >         at 
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
   [junit4]    >         at java.io.PrintStream.flush(PrintStream.java:338)
   [junit4]    >         at 
java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
   [junit4]    >         at java.io.PrintStream.write(PrintStream.java:482)
   [junit4]    >         at 
sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
   [junit4]    >         at 
sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
   [junit4]    >         at 
sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:104)
   [junit4]    >         at 
java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:185)
   [junit4]    >         at java.io.PrintStream.newLine(PrintStream.java:546)
   [junit4]    >         at java.io.PrintStream.println(PrintStream.java:824)
   [junit4]    >         at 
java.lang.Throwable$WrappedPrintStream.println(Throwable.java:748)
   [junit4]    >         at 
java.lang.Throwable.printStackTrace(Throwable.java:658)
   [junit4]    >         at 
java.lang.Throwable.printStackTrace(Throwable.java:643)
   [junit4]    >         at 
java.lang.Throwable.printStackTrace(Throwable.java:634)
   [junit4]    >         at 
org.apache.solr.cloud.StopableIndexingThread.run(StopableIndexingThread.java:108)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([90BC362B74A11273]:0)
   [junit4] Completed on J0 in 86.12s, 1 test, 1 failure, 2 errors <<< FAILURES!

[...truncated 792 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962:
 There were test failures: 433 suites, 1780 tests, 2 suite-level errors, 1 
error, 1 failure, 766 ignored (10 assumptions)

Total time: 155 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #638
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 507488033 bytes
Compression is 0.0%
Took 1 min 30 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to