Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/637/

3 tests failed.
REGRESSION:  org.apache.solr.DistributedIntervalFacetingTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=58297, name=Thread-8747, 
state=RUNNABLE, group=TGRP-DistributedIntervalFacetingTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=58297, name=Thread-8747, state=RUNNABLE, 
group=TGRP-DistributedIntervalFacetingTest]
        at 
__randomizedtesting.SeedInfo.seed([2B6B51549F05F06F:AA8DDF4CE85A9053]:0)
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: https://127.0.0.1:56646
        at __randomizedtesting.SeedInfo.seed([2B6B51549F05F06F]:0)
        at 
org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:580)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: https://127.0.0.1:56646
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:562)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
        at 
org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
        at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
        at 
org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:575)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
        at sun.security.ssl.InputRecord.read(InputRecord.java:480)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
        at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
        at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
        ... 5 more


REGRESSION:  
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create 
core [halfcollection_shard1_replica1] Caused by: Could not get shard id for 
core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error 
CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:552)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


REGRESSION:  
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1411556983488,generation=2,filelist=[_kz6.fdt, 
_kz6.fdx, _kz6.fnm, _kz6.nvd, _kz6.nvm, _kz6.si, _kz6_Lucene41WithOrds_0.doc, 
_kz6_Lucene41WithOrds_0.tib, _kz6_Lucene41WithOrds_0.tii, _l71.fdt, _l71.fdx, 
_l71.fnm, _l71.nvd, _l71.nvm, _l71.si, _l71_Lucene41WithOrds_0.doc, 
_l71_Lucene41WithOrds_0.tib, _l71_Lucene41WithOrds_0.tii, _l77.fdt, _l77.fdx, 
_l77.fnm, _l77.nvd, _l77.nvm, _l77.si, _l77_Lucene41WithOrds_0.doc, 
_l77_Lucene41WithOrds_0.tib, _l77_Lucene41WithOrds_0.tii, _l7c.fdt, _l7c.fdx, 
_l7c.fnm, _l7c.nvd, _l7c.nvm, _l7c.si, _l7c_Lucene41WithOrds_0.doc, 
_l7c_Lucene41WithOrds_0.tib, _l7c_Lucene41WithOrds_0.tii, _l7e.fdt, _l7e.fdx, 
_l7e.fnm, _l7e.nvd, _l7e.nvm, _l7e.si, _l7e_Lucene41WithOrds_0.doc, 
_l7e_Lucene41WithOrds_0.tib, _l7e_Lucene41WithOrds_0.tii, _l7i.fdt, _l7i.fdx, 
_l7i.fnm, _l7i.nvd, _l7i.nvm, _l7i.si, _l7i_Lucene41WithOrds_0.doc, 
_l7i_Lucene41WithOrds_0.tib, _l7i_Lucene41WithOrds_0.tii, _l7j.cfe, _l7j.cfs, 
_l7j.si, _l7k.fdt, _l7k.fdx, _l7k.fnm, _l7k.nvd, _l7k.nvm, _l7k.si, 
_l7k_Lucene41WithOrds_0.doc, _l7k_Lucene41WithOrds_0.tib, 
_l7k_Lucene41WithOrds_0.tii, _l7l.fdt, _l7l.fdx, _l7l.fnm, _l7l.nvd, _l7l.nvm, 
_l7l.si, _l7l_Lucene41WithOrds_0.doc, _l7l_Lucene41WithOrds_0.tib, 
_l7l_Lucene41WithOrds_0.tii, _l7m.fdt, _l7m.fdx, _l7m.fnm, _l7m.nvd, _l7m.nvm, 
_l7m.si, _l7m_Lucene41WithOrds_0.doc, _l7m_Lucene41WithOrds_0.tib, 
_l7m_Lucene41WithOrds_0.tii, _l7n.fdt, _l7n.fdx, _l7n.fnm, _l7n.nvd, _l7n.nvm, 
_l7n.si, _l7n_Lucene41WithOrds_0.doc, _l7n_Lucene41WithOrds_0.tib, 
_l7n_Lucene41WithOrds_0.tii, _l7o.fdt, _l7o.fdx, _l7o.fnm, _l7o.nvd, _l7o.nvm, 
_l7o.si, _l7o_Lucene41WithOrds_0.doc, _l7o_Lucene41WithOrds_0.tib, 
_l7o_Lucene41WithOrds_0.tii, _l7p.cfe, _l7p.cfs, _l7p.si, _l7q.fdt, _l7q.fdx, 
_l7q.fnm, _l7q.nvd, _l7q.nvm, _l7q.si, _l7q_Lucene41WithOrds_0.doc, 
_l7q_Lucene41WithOrds_0.tib, _l7q_Lucene41WithOrds_0.tii, _l7r.fdt, _l7r.fdx, 
_l7r.fnm, _l7r.nvd, _l7r.nvm, _l7r.si, _l7r_Lucene41WithOrds_0.doc, 
_l7r_Lucene41WithOrds_0.tib, _l7r_Lucene41WithOrds_0.tii, _l7s.fdt, _l7s.fdx, 
_l7s.fnm, _l7s.nvd, _l7s.nvm, _l7s.si, _l7s_Lucene41WithOrds_0.doc, 
_l7s_Lucene41WithOrds_0.tib, _l7s_Lucene41WithOrds_0.tii, _l7t.fdt, _l7t.fdx, 
_l7t.fnm, _l7t.nvd, _l7t.nvm, _l7t.si, _l7t_Lucene41WithOrds_0.doc, 
_l7t_Lucene41WithOrds_0.tib, _l7t_Lucene41WithOrds_0.tii, _l7u.fdt, _l7u.fdx, 
_l7u.fnm, _l7u.nvd, _l7u.nvm, _l7u.si, _l7u_Lucene41WithOrds_0.doc, 
_l7u_Lucene41WithOrds_0.tib, _l7u_Lucene41WithOrds_0.tii, _l7v.fdt, _l7v.fdx, 
_l7v.fnm, _l7v.nvd, _l7v.nvm, _l7v.si, _l7v_Lucene41WithOrds_0.doc, 
_l7v_Lucene41WithOrds_0.tib, _l7v_Lucene41WithOrds_0.tii, _lch.fdt, _lch.fdx, 
_lch.fnm, _lch.nvd, _lch.nvm, _lch.si, _lch_Lucene41WithOrds_0.doc, 
_lch_Lucene41WithOrds_0.tib, _lch_Lucene41WithOrds_0.tii, _lco.fdt, _lco.fdx, 
_lco.fnm, _lco.nvd, _lco.nvm, _lco.si, _lco_Lucene41WithOrds_0.doc, 
_lco_Lucene41WithOrds_0.tib, _lco_Lucene41WithOrds_0.tii, _lcp.fdt, _lcp.fdx, 
_lcp.fnm, _lcp.nvd, _lcp.nvm, _lcp.si, _lcp_Lucene41WithOrds_0.doc, 
_lcp_Lucene41WithOrds_0.tib, _lcp_Lucene41WithOrds_0.tii, _lcr.fdt, _lcr.fdx, 
_lcr.fnm, _lcr.nvd, _lcr.nvm, _lcr.si, _lcr_Lucene41WithOrds_0.doc, 
_lcr_Lucene41WithOrds_0.tib, _lcr_Lucene41WithOrds_0.tii, _lct.fdt, _lct.fdx, 
_lct.fnm, _lct.nvd, _lct.nvm, _lct.si, _lct_Lucene41WithOrds_0.doc, 
_lct_Lucene41WithOrds_0.tib, _lct_Lucene41WithOrds_0.tii, _lcu.fdt, _lcu.fdx, 
_lcu.fnm, _lcu.nvd, _lcu.nvm, _lcu.si, _lcu_Lucene41WithOrds_0.doc, 
_lcu_Lucene41WithOrds_0.tib, _lcu_Lucene41WithOrds_0.tii, _lcv.fdt, _lcv.fdx, 
_lcv.fnm, _lcv.nvd, _lcv.nvm, _lcv.si, _lcv_Lucene41WithOrds_0.doc, 
_lcv_Lucene41WithOrds_0.tib, _lcv_Lucene41WithOrds_0.tii, _lcw.fdt, _lcw.fdx, 
_lcw.fnm, _lcw.nvd, _lcw.nvm, _lcw.si, _lcw_Lucene41WithOrds_0.doc, 
_lcw_Lucene41WithOrds_0.tib, _lcw_Lucene41WithOrds_0.tii, _lcx.fdt, _lcx.fdx, 
_lcx.fnm, _lcx.nvd, _lcx.nvm, _lcx.si, _lcx_Lucene41WithOrds_0.doc, 
_lcx_Lucene41WithOrds_0.tib, _lcx_Lucene41WithOrds_0.tii, _lcy.fdt, _lcy.fdx, 
_lcy.fnm, _lcy.nvd, _lcy.nvm, _lcy.si, _lcy_Lucene41WithOrds_0.doc, 
_lcy_Lucene41WithOrds_0.tib, _lcy_Lucene41WithOrds_0.tii, _lcz.fdt, _lcz.fdx, 
_lcz.fnm, _lcz.nvd, _lcz.nvm, _lcz.si, _lcz_Lucene41WithOrds_0.doc, 
_lcz_Lucene41WithOrds_0.tib, _lcz_Lucene41WithOrds_0.tii, _ld0.fdt, _ld0.fdx, 
_ld0.fnm, _ld0.nvd, _ld0.nvm, _ld0.si, _ld0_Lucene41WithOrds_0.doc, 
_ld0_Lucene41WithOrds_0.tib, _ld0_Lucene41WithOrds_0.tii, _ld2.fdt, _ld2.fdx, 
_ld2.fnm, _ld2.nvd, _ld2.nvm, _ld2.si, _ld2_Lucene41WithOrds_0.doc, 
_ld2_Lucene41WithOrds_0.tib, _ld2_Lucene41WithOrds_0.tii, segments_2]}]> but 
was:<[{indexVersion=1411556983488,generation=2,filelist=[_kz6.fdt, _kz6.fdx, 
_kz6.fnm, _kz6.nvd, _kz6.nvm, _kz6.si, _kz6_Lucene41WithOrds_0.doc, 
_kz6_Lucene41WithOrds_0.tib, _kz6_Lucene41WithOrds_0.tii, _l71.fdt, _l71.fdx, 
_l71.fnm, _l71.nvd, _l71.nvm, _l71.si, _l71_Lucene41WithOrds_0.doc, 
_l71_Lucene41WithOrds_0.tib, _l71_Lucene41WithOrds_0.tii, _l77.fdt, _l77.fdx, 
_l77.fnm, _l77.nvd, _l77.nvm, _l77.si, _l77_Lucene41WithOrds_0.doc, 
_l77_Lucene41WithOrds_0.tib, _l77_Lucene41WithOrds_0.tii, _l7c.fdt, _l7c.fdx, 
_l7c.fnm, _l7c.nvd, _l7c.nvm, _l7c.si, _l7c_Lucene41WithOrds_0.doc, 
_l7c_Lucene41WithOrds_0.tib, _l7c_Lucene41WithOrds_0.tii, _l7e.fdt, _l7e.fdx, 
_l7e.fnm, _l7e.nvd, _l7e.nvm, _l7e.si, _l7e_Lucene41WithOrds_0.doc, 
_l7e_Lucene41WithOrds_0.tib, _l7e_Lucene41WithOrds_0.tii, _l7i.fdt, _l7i.fdx, 
_l7i.fnm, _l7i.nvd, _l7i.nvm, _l7i.si, _l7i_Lucene41WithOrds_0.doc, 
_l7i_Lucene41WithOrds_0.tib, _l7i_Lucene41WithOrds_0.tii, _l7j.cfe, _l7j.cfs, 
_l7j.si, _l7k.fdt, _l7k.fdx, _l7k.fnm, _l7k.nvd, _l7k.nvm, _l7k.si, 
_l7k_Lucene41WithOrds_0.doc, _l7k_Lucene41WithOrds_0.tib, 
_l7k_Lucene41WithOrds_0.tii, _l7l.fdt, _l7l.fdx, _l7l.fnm, _l7l.nvd, _l7l.nvm, 
_l7l.si, _l7l_Lucene41WithOrds_0.doc, _l7l_Lucene41WithOrds_0.tib, 
_l7l_Lucene41WithOrds_0.tii, _l7m.fdt, _l7m.fdx, _l7m.fnm, _l7m.nvd, _l7m.nvm, 
_l7m.si, _l7m_Lucene41WithOrds_0.doc, _l7m_Lucene41WithOrds_0.tib, 
_l7m_Lucene41WithOrds_0.tii, _l7n.fdt, _l7n.fdx, _l7n.fnm, _l7n.nvd, _l7n.nvm, 
_l7n.si, _l7n_Lucene41WithOrds_0.doc, _l7n_Lucene41WithOrds_0.tib, 
_l7n_Lucene41WithOrds_0.tii, _l7o.fdt, _l7o.fdx, _l7o.fnm, _l7o.nvd, _l7o.nvm, 
_l7o.si, _l7o_Lucene41WithOrds_0.doc, _l7o_Lucene41WithOrds_0.tib, 
_l7o_Lucene41WithOrds_0.tii, _l7p.cfe, _l7p.cfs, _l7p.si, _l7q.fdt, _l7q.fdx, 
_l7q.fnm, _l7q.nvd, _l7q.nvm, _l7q.si, _l7q_Lucene41WithOrds_0.doc, 
_l7q_Lucene41WithOrds_0.tib, _l7q_Lucene41WithOrds_0.tii, _l7r.fdt, _l7r.fdx, 
_l7r.fnm, _l7r.nvd, _l7r.nvm, _l7r.si, _l7r_Lucene41WithOrds_0.doc, 
_l7r_Lucene41WithOrds_0.tib, _l7r_Lucene41WithOrds_0.tii, _l7s.fdt, _l7s.fdx, 
_l7s.fnm, _l7s.nvd, _l7s.nvm, _l7s.si, _l7s_Lucene41WithOrds_0.doc, 
_l7s_Lucene41WithOrds_0.tib, _l7s_Lucene41WithOrds_0.tii, _l7t.fdt, _l7t.fdx, 
_l7t.fnm, _l7t.nvd, _l7t.nvm, _l7t.si, _l7t_Lucene41WithOrds_0.doc, 
_l7t_Lucene41WithOrds_0.tib, _l7t_Lucene41WithOrds_0.tii, _l7u.fdt, _l7u.fdx, 
_l7u.fnm, _l7u.nvd, _l7u.nvm, _l7u.si, _l7u_Lucene41WithOrds_0.doc, 
_l7u_Lucene41WithOrds_0.tib, _l7u_Lucene41WithOrds_0.tii, _l7v.fdt, _l7v.fdx, 
_l7v.fnm, _l7v.nvd, _l7v.nvm, _l7v.si, _l7v_Lucene41WithOrds_0.doc, 
_l7v_Lucene41WithOrds_0.tib, _l7v_Lucene41WithOrds_0.tii, _lch.fdt, _lch.fdx, 
_lch.fnm, _lch.nvd, _lch.nvm, _lch.si, _lch_Lucene41WithOrds_0.doc, 
_lch_Lucene41WithOrds_0.tib, _lch_Lucene41WithOrds_0.tii, _lco.fdt, _lco.fdx, 
_lco.fnm, _lco.nvd, _lco.nvm, _lco.si, _lco_Lucene41WithOrds_0.doc, 
_lco_Lucene41WithOrds_0.tib, _lco_Lucene41WithOrds_0.tii, _lcp.fdt, _lcp.fdx, 
_lcp.fnm, _lcp.nvd, _lcp.nvm, _lcp.si, _lcp_Lucene41WithOrds_0.doc, 
_lcp_Lucene41WithOrds_0.tib, _lcp_Lucene41WithOrds_0.tii, _lcr.fdt, _lcr.fdx, 
_lcr.fnm, _lcr.nvd, _lcr.nvm, _lcr.si, _lcr_Lucene41WithOrds_0.doc, 
_lcr_Lucene41WithOrds_0.tib, _lcr_Lucene41WithOrds_0.tii, _lct.fdt, _lct.fdx, 
_lct.fnm, _lct.nvd, _lct.nvm, _lct.si, _lct_Lucene41WithOrds_0.doc, 
_lct_Lucene41WithOrds_0.tib, _lct_Lucene41WithOrds_0.tii, _lcu.fdt, _lcu.fdx, 
_lcu.fnm, _lcu.nvd, _lcu.nvm, _lcu.si, _lcu_Lucene41WithOrds_0.doc, 
_lcu_Lucene41WithOrds_0.tib, _lcu_Lucene41WithOrds_0.tii, _lcv.fdt, _lcv.fdx, 
_lcv.fnm, _lcv.nvd, _lcv.nvm, _lcv.si, _lcv_Lucene41WithOrds_0.doc, 
_lcv_Lucene41WithOrds_0.tib, _lcv_Lucene41WithOrds_0.tii, _lcw.fdt, _lcw.fdx, 
_lcw.fnm, _lcw.nvd, _lcw.nvm, _lcw.si, _lcw_Lucene41WithOrds_0.doc, 
_lcw_Lucene41WithOrds_0.tib, _lcw_Lucene41WithOrds_0.tii, _lcx.fdt, _lcx.fdx, 
_lcx.fnm, _lcx.nvd, _lcx.nvm, _lcx.si, _lcx_Lucene41WithOrds_0.doc, 
_lcx_Lucene41WithOrds_0.tib, _lcx_Lucene41WithOrds_0.tii, _lcy.fdt, _lcy.fdx, 
_lcy.fnm, _lcy.nvd, _lcy.nvm, _lcy.si, _lcy_Lucene41WithOrds_0.doc, 
_lcy_Lucene41WithOrds_0.tib, _lcy_Lucene41WithOrds_0.tii, _lcz.fdt, _lcz.fdx, 
_lcz.fnm, _lcz.nvd, _lcz.nvm, _lcz.si, _lcz_Lucene41WithOrds_0.doc, 
_lcz_Lucene41WithOrds_0.tib, _lcz_Lucene41WithOrds_0.tii, _ld0.fdt, _ld0.fdx, 
_ld0.fnm, _ld0.nvd, _ld0.nvm, _ld0.si, _ld0_Lucene41WithOrds_0.doc, 
_ld0_Lucene41WithOrds_0.tib, _ld0_Lucene41WithOrds_0.tii, _ld2.fdt, _ld2.fdx, 
_ld2.fnm, _ld2.nvd, _ld2.nvm, _ld2.si, _ld2_Lucene41WithOrds_0.doc, 
_ld2_Lucene41WithOrds_0.tib, _ld2_Lucene41WithOrds_0.tii, segments_2]}, 
{indexVersion=1411556983488,generation=3,filelist=[_l7x.cfe, _l7x.cfs, _l7x.si, 
_ld2.fdt, _ld2.fdx, _ld2.fnm, _ld2.nvd, _ld2.nvm, _ld2.si, 
_ld2_Lucene41WithOrds_0.doc, _ld2_Lucene41WithOrds_0.tib, 
_ld2_Lucene41WithOrds_0.tii, _ld3.cfe, _ld3.cfs, _ld3.si, _ld4.cfe, _ld4.cfs, 
_ld4.si, segments_3]}]>

Stack Trace:
java.lang.AssertionError: 
expected:<[{indexVersion=1411556983488,generation=2,filelist=[_kz6.fdt, 
_kz6.fdx, _kz6.fnm, _kz6.nvd, _kz6.nvm, _kz6.si, _kz6_Lucene41WithOrds_0.doc, 
_kz6_Lucene41WithOrds_0.tib, _kz6_Lucene41WithOrds_0.tii, _l71.fdt, _l71.fdx, 
_l71.fnm, _l71.nvd, _l71.nvm, _l71.si, _l71_Lucene41WithOrds_0.doc, 
_l71_Lucene41WithOrds_0.tib, _l71_Lucene41WithOrds_0.tii, _l77.fdt, _l77.fdx, 
_l77.fnm, _l77.nvd, _l77.nvm, _l77.si, _l77_Lucene41WithOrds_0.doc, 
_l77_Lucene41WithOrds_0.tib, _l77_Lucene41WithOrds_0.tii, _l7c.fdt, _l7c.fdx, 
_l7c.fnm, _l7c.nvd, _l7c.nvm, _l7c.si, _l7c_Lucene41WithOrds_0.doc, 
_l7c_Lucene41WithOrds_0.tib, _l7c_Lucene41WithOrds_0.tii, _l7e.fdt, _l7e.fdx, 
_l7e.fnm, _l7e.nvd, _l7e.nvm, _l7e.si, _l7e_Lucene41WithOrds_0.doc, 
_l7e_Lucene41WithOrds_0.tib, _l7e_Lucene41WithOrds_0.tii, _l7i.fdt, _l7i.fdx, 
_l7i.fnm, _l7i.nvd, _l7i.nvm, _l7i.si, _l7i_Lucene41WithOrds_0.doc, 
_l7i_Lucene41WithOrds_0.tib, _l7i_Lucene41WithOrds_0.tii, _l7j.cfe, _l7j.cfs, 
_l7j.si, _l7k.fdt, _l7k.fdx, _l7k.fnm, _l7k.nvd, _l7k.nvm, _l7k.si, 
_l7k_Lucene41WithOrds_0.doc, _l7k_Lucene41WithOrds_0.tib, 
_l7k_Lucene41WithOrds_0.tii, _l7l.fdt, _l7l.fdx, _l7l.fnm, _l7l.nvd, _l7l.nvm, 
_l7l.si, _l7l_Lucene41WithOrds_0.doc, _l7l_Lucene41WithOrds_0.tib, 
_l7l_Lucene41WithOrds_0.tii, _l7m.fdt, _l7m.fdx, _l7m.fnm, _l7m.nvd, _l7m.nvm, 
_l7m.si, _l7m_Lucene41WithOrds_0.doc, _l7m_Lucene41WithOrds_0.tib, 
_l7m_Lucene41WithOrds_0.tii, _l7n.fdt, _l7n.fdx, _l7n.fnm, _l7n.nvd, _l7n.nvm, 
_l7n.si, _l7n_Lucene41WithOrds_0.doc, _l7n_Lucene41WithOrds_0.tib, 
_l7n_Lucene41WithOrds_0.tii, _l7o.fdt, _l7o.fdx, _l7o.fnm, _l7o.nvd, _l7o.nvm, 
_l7o.si, _l7o_Lucene41WithOrds_0.doc, _l7o_Lucene41WithOrds_0.tib, 
_l7o_Lucene41WithOrds_0.tii, _l7p.cfe, _l7p.cfs, _l7p.si, _l7q.fdt, _l7q.fdx, 
_l7q.fnm, _l7q.nvd, _l7q.nvm, _l7q.si, _l7q_Lucene41WithOrds_0.doc, 
_l7q_Lucene41WithOrds_0.tib, _l7q_Lucene41WithOrds_0.tii, _l7r.fdt, _l7r.fdx, 
_l7r.fnm, _l7r.nvd, _l7r.nvm, _l7r.si, _l7r_Lucene41WithOrds_0.doc, 
_l7r_Lucene41WithOrds_0.tib, _l7r_Lucene41WithOrds_0.tii, _l7s.fdt, _l7s.fdx, 
_l7s.fnm, _l7s.nvd, _l7s.nvm, _l7s.si, _l7s_Lucene41WithOrds_0.doc, 
_l7s_Lucene41WithOrds_0.tib, _l7s_Lucene41WithOrds_0.tii, _l7t.fdt, _l7t.fdx, 
_l7t.fnm, _l7t.nvd, _l7t.nvm, _l7t.si, _l7t_Lucene41WithOrds_0.doc, 
_l7t_Lucene41WithOrds_0.tib, _l7t_Lucene41WithOrds_0.tii, _l7u.fdt, _l7u.fdx, 
_l7u.fnm, _l7u.nvd, _l7u.nvm, _l7u.si, _l7u_Lucene41WithOrds_0.doc, 
_l7u_Lucene41WithOrds_0.tib, _l7u_Lucene41WithOrds_0.tii, _l7v.fdt, _l7v.fdx, 
_l7v.fnm, _l7v.nvd, _l7v.nvm, _l7v.si, _l7v_Lucene41WithOrds_0.doc, 
_l7v_Lucene41WithOrds_0.tib, _l7v_Lucene41WithOrds_0.tii, _lch.fdt, _lch.fdx, 
_lch.fnm, _lch.nvd, _lch.nvm, _lch.si, _lch_Lucene41WithOrds_0.doc, 
_lch_Lucene41WithOrds_0.tib, _lch_Lucene41WithOrds_0.tii, _lco.fdt, _lco.fdx, 
_lco.fnm, _lco.nvd, _lco.nvm, _lco.si, _lco_Lucene41WithOrds_0.doc, 
_lco_Lucene41WithOrds_0.tib, _lco_Lucene41WithOrds_0.tii, _lcp.fdt, _lcp.fdx, 
_lcp.fnm, _lcp.nvd, _lcp.nvm, _lcp.si, _lcp_Lucene41WithOrds_0.doc, 
_lcp_Lucene41WithOrds_0.tib, _lcp_Lucene41WithOrds_0.tii, _lcr.fdt, _lcr.fdx, 
_lcr.fnm, _lcr.nvd, _lcr.nvm, _lcr.si, _lcr_Lucene41WithOrds_0.doc, 
_lcr_Lucene41WithOrds_0.tib, _lcr_Lucene41WithOrds_0.tii, _lct.fdt, _lct.fdx, 
_lct.fnm, _lct.nvd, _lct.nvm, _lct.si, _lct_Lucene41WithOrds_0.doc, 
_lct_Lucene41WithOrds_0.tib, _lct_Lucene41WithOrds_0.tii, _lcu.fdt, _lcu.fdx, 
_lcu.fnm, _lcu.nvd, _lcu.nvm, _lcu.si, _lcu_Lucene41WithOrds_0.doc, 
_lcu_Lucene41WithOrds_0.tib, _lcu_Lucene41WithOrds_0.tii, _lcv.fdt, _lcv.fdx, 
_lcv.fnm, _lcv.nvd, _lcv.nvm, _lcv.si, _lcv_Lucene41WithOrds_0.doc, 
_lcv_Lucene41WithOrds_0.tib, _lcv_Lucene41WithOrds_0.tii, _lcw.fdt, _lcw.fdx, 
_lcw.fnm, _lcw.nvd, _lcw.nvm, _lcw.si, _lcw_Lucene41WithOrds_0.doc, 
_lcw_Lucene41WithOrds_0.tib, _lcw_Lucene41WithOrds_0.tii, _lcx.fdt, _lcx.fdx, 
_lcx.fnm, _lcx.nvd, _lcx.nvm, _lcx.si, _lcx_Lucene41WithOrds_0.doc, 
_lcx_Lucene41WithOrds_0.tib, _lcx_Lucene41WithOrds_0.tii, _lcy.fdt, _lcy.fdx, 
_lcy.fnm, _lcy.nvd, _lcy.nvm, _lcy.si, _lcy_Lucene41WithOrds_0.doc, 
_lcy_Lucene41WithOrds_0.tib, _lcy_Lucene41WithOrds_0.tii, _lcz.fdt, _lcz.fdx, 
_lcz.fnm, _lcz.nvd, _lcz.nvm, _lcz.si, _lcz_Lucene41WithOrds_0.doc, 
_lcz_Lucene41WithOrds_0.tib, _lcz_Lucene41WithOrds_0.tii, _ld0.fdt, _ld0.fdx, 
_ld0.fnm, _ld0.nvd, _ld0.nvm, _ld0.si, _ld0_Lucene41WithOrds_0.doc, 
_ld0_Lucene41WithOrds_0.tib, _ld0_Lucene41WithOrds_0.tii, _ld2.fdt, _ld2.fdx, 
_ld2.fnm, _ld2.nvd, _ld2.nvm, _ld2.si, _ld2_Lucene41WithOrds_0.doc, 
_ld2_Lucene41WithOrds_0.tib, _ld2_Lucene41WithOrds_0.tii, segments_2]}]> but 
was:<[{indexVersion=1411556983488,generation=2,filelist=[_kz6.fdt, _kz6.fdx, 
_kz6.fnm, _kz6.nvd, _kz6.nvm, _kz6.si, _kz6_Lucene41WithOrds_0.doc, 
_kz6_Lucene41WithOrds_0.tib, _kz6_Lucene41WithOrds_0.tii, _l71.fdt, _l71.fdx, 
_l71.fnm, _l71.nvd, _l71.nvm, _l71.si, _l71_Lucene41WithOrds_0.doc, 
_l71_Lucene41WithOrds_0.tib, _l71_Lucene41WithOrds_0.tii, _l77.fdt, _l77.fdx, 
_l77.fnm, _l77.nvd, _l77.nvm, _l77.si, _l77_Lucene41WithOrds_0.doc, 
_l77_Lucene41WithOrds_0.tib, _l77_Lucene41WithOrds_0.tii, _l7c.fdt, _l7c.fdx, 
_l7c.fnm, _l7c.nvd, _l7c.nvm, _l7c.si, _l7c_Lucene41WithOrds_0.doc, 
_l7c_Lucene41WithOrds_0.tib, _l7c_Lucene41WithOrds_0.tii, _l7e.fdt, _l7e.fdx, 
_l7e.fnm, _l7e.nvd, _l7e.nvm, _l7e.si, _l7e_Lucene41WithOrds_0.doc, 
_l7e_Lucene41WithOrds_0.tib, _l7e_Lucene41WithOrds_0.tii, _l7i.fdt, _l7i.fdx, 
_l7i.fnm, _l7i.nvd, _l7i.nvm, _l7i.si, _l7i_Lucene41WithOrds_0.doc, 
_l7i_Lucene41WithOrds_0.tib, _l7i_Lucene41WithOrds_0.tii, _l7j.cfe, _l7j.cfs, 
_l7j.si, _l7k.fdt, _l7k.fdx, _l7k.fnm, _l7k.nvd, _l7k.nvm, _l7k.si, 
_l7k_Lucene41WithOrds_0.doc, _l7k_Lucene41WithOrds_0.tib, 
_l7k_Lucene41WithOrds_0.tii, _l7l.fdt, _l7l.fdx, _l7l.fnm, _l7l.nvd, _l7l.nvm, 
_l7l.si, _l7l_Lucene41WithOrds_0.doc, _l7l_Lucene41WithOrds_0.tib, 
_l7l_Lucene41WithOrds_0.tii, _l7m.fdt, _l7m.fdx, _l7m.fnm, _l7m.nvd, _l7m.nvm, 
_l7m.si, _l7m_Lucene41WithOrds_0.doc, _l7m_Lucene41WithOrds_0.tib, 
_l7m_Lucene41WithOrds_0.tii, _l7n.fdt, _l7n.fdx, _l7n.fnm, _l7n.nvd, _l7n.nvm, 
_l7n.si, _l7n_Lucene41WithOrds_0.doc, _l7n_Lucene41WithOrds_0.tib, 
_l7n_Lucene41WithOrds_0.tii, _l7o.fdt, _l7o.fdx, _l7o.fnm, _l7o.nvd, _l7o.nvm, 
_l7o.si, _l7o_Lucene41WithOrds_0.doc, _l7o_Lucene41WithOrds_0.tib, 
_l7o_Lucene41WithOrds_0.tii, _l7p.cfe, _l7p.cfs, _l7p.si, _l7q.fdt, _l7q.fdx, 
_l7q.fnm, _l7q.nvd, _l7q.nvm, _l7q.si, _l7q_Lucene41WithOrds_0.doc, 
_l7q_Lucene41WithOrds_0.tib, _l7q_Lucene41WithOrds_0.tii, _l7r.fdt, _l7r.fdx, 
_l7r.fnm, _l7r.nvd, _l7r.nvm, _l7r.si, _l7r_Lucene41WithOrds_0.doc, 
_l7r_Lucene41WithOrds_0.tib, _l7r_Lucene41WithOrds_0.tii, _l7s.fdt, _l7s.fdx, 
_l7s.fnm, _l7s.nvd, _l7s.nvm, _l7s.si, _l7s_Lucene41WithOrds_0.doc, 
_l7s_Lucene41WithOrds_0.tib, _l7s_Lucene41WithOrds_0.tii, _l7t.fdt, _l7t.fdx, 
_l7t.fnm, _l7t.nvd, _l7t.nvm, _l7t.si, _l7t_Lucene41WithOrds_0.doc, 
_l7t_Lucene41WithOrds_0.tib, _l7t_Lucene41WithOrds_0.tii, _l7u.fdt, _l7u.fdx, 
_l7u.fnm, _l7u.nvd, _l7u.nvm, _l7u.si, _l7u_Lucene41WithOrds_0.doc, 
_l7u_Lucene41WithOrds_0.tib, _l7u_Lucene41WithOrds_0.tii, _l7v.fdt, _l7v.fdx, 
_l7v.fnm, _l7v.nvd, _l7v.nvm, _l7v.si, _l7v_Lucene41WithOrds_0.doc, 
_l7v_Lucene41WithOrds_0.tib, _l7v_Lucene41WithOrds_0.tii, _lch.fdt, _lch.fdx, 
_lch.fnm, _lch.nvd, _lch.nvm, _lch.si, _lch_Lucene41WithOrds_0.doc, 
_lch_Lucene41WithOrds_0.tib, _lch_Lucene41WithOrds_0.tii, _lco.fdt, _lco.fdx, 
_lco.fnm, _lco.nvd, _lco.nvm, _lco.si, _lco_Lucene41WithOrds_0.doc, 
_lco_Lucene41WithOrds_0.tib, _lco_Lucene41WithOrds_0.tii, _lcp.fdt, _lcp.fdx, 
_lcp.fnm, _lcp.nvd, _lcp.nvm, _lcp.si, _lcp_Lucene41WithOrds_0.doc, 
_lcp_Lucene41WithOrds_0.tib, _lcp_Lucene41WithOrds_0.tii, _lcr.fdt, _lcr.fdx, 
_lcr.fnm, _lcr.nvd, _lcr.nvm, _lcr.si, _lcr_Lucene41WithOrds_0.doc, 
_lcr_Lucene41WithOrds_0.tib, _lcr_Lucene41WithOrds_0.tii, _lct.fdt, _lct.fdx, 
_lct.fnm, _lct.nvd, _lct.nvm, _lct.si, _lct_Lucene41WithOrds_0.doc, 
_lct_Lucene41WithOrds_0.tib, _lct_Lucene41WithOrds_0.tii, _lcu.fdt, _lcu.fdx, 
_lcu.fnm, _lcu.nvd, _lcu.nvm, _lcu.si, _lcu_Lucene41WithOrds_0.doc, 
_lcu_Lucene41WithOrds_0.tib, _lcu_Lucene41WithOrds_0.tii, _lcv.fdt, _lcv.fdx, 
_lcv.fnm, _lcv.nvd, _lcv.nvm, _lcv.si, _lcv_Lucene41WithOrds_0.doc, 
_lcv_Lucene41WithOrds_0.tib, _lcv_Lucene41WithOrds_0.tii, _lcw.fdt, _lcw.fdx, 
_lcw.fnm, _lcw.nvd, _lcw.nvm, _lcw.si, _lcw_Lucene41WithOrds_0.doc, 
_lcw_Lucene41WithOrds_0.tib, _lcw_Lucene41WithOrds_0.tii, _lcx.fdt, _lcx.fdx, 
_lcx.fnm, _lcx.nvd, _lcx.nvm, _lcx.si, _lcx_Lucene41WithOrds_0.doc, 
_lcx_Lucene41WithOrds_0.tib, _lcx_Lucene41WithOrds_0.tii, _lcy.fdt, _lcy.fdx, 
_lcy.fnm, _lcy.nvd, _lcy.nvm, _lcy.si, _lcy_Lucene41WithOrds_0.doc, 
_lcy_Lucene41WithOrds_0.tib, _lcy_Lucene41WithOrds_0.tii, _lcz.fdt, _lcz.fdx, 
_lcz.fnm, _lcz.nvd, _lcz.nvm, _lcz.si, _lcz_Lucene41WithOrds_0.doc, 
_lcz_Lucene41WithOrds_0.tib, _lcz_Lucene41WithOrds_0.tii, _ld0.fdt, _ld0.fdx, 
_ld0.fnm, _ld0.nvd, _ld0.nvm, _ld0.si, _ld0_Lucene41WithOrds_0.doc, 
_ld0_Lucene41WithOrds_0.tib, _ld0_Lucene41WithOrds_0.tii, _ld2.fdt, _ld2.fdx, 
_ld2.fnm, _ld2.nvd, _ld2.nvm, _ld2.si, _ld2_Lucene41WithOrds_0.doc, 
_ld2_Lucene41WithOrds_0.tib, _ld2_Lucene41WithOrds_0.tii, segments_2]}, 
{indexVersion=1411556983488,generation=3,filelist=[_l7x.cfe, _l7x.cfs, _l7x.si, 
_ld2.fdt, _ld2.fdx, _ld2.fnm, _ld2.nvd, _ld2.nvm, _ld2.si, 
_ld2_Lucene41WithOrds_0.doc, _ld2_Lucene41WithOrds_0.tib, 
_ld2_Lucene41WithOrds_0.tii, _ld3.cfe, _ld3.cfs, _ld3.si, _ld4.cfe, _ld4.cfs, 
_ld4.si, segments_3]}]>
        at 
__randomizedtesting.SeedInfo.seed([2B6B51549F05F06F:EBC4A64EF4DFE6C]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at 
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1191)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12408 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/init-core-data-001
   [junit4]   2> 82940 T305 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (true)
   [junit4]   2> 82941 T305 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /_ow/nk
   [junit4]   2> 82946 T305 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 82947 T305 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 82948 T306 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 83047 T305 oasc.ZkTestServer.run start zk server on port:37258
   [junit4]   2> 83048 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 83049 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 83053 T312 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4582958e 
name:ZooKeeperConnection Watcher:127.0.0.1:37258 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 83053 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 83053 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 83053 T305 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 83056 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 83057 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 83058 T314 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@66e0c7d2 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 83058 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 83059 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 83059 T305 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 83062 T305 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 83064 T305 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 83067 T305 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 83070 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 83090 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 83095 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 83096 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 83199 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 83200 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 83203 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 83203 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 83206 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 83206 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 83209 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 83209 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 83212 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 83212 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 83215 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 83216 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 83218 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 83219 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 83221 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 83222 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 83224 T305 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 83225 T305 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 83232 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 83233 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 83235 T316 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@39ff1633 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 83235 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 83235 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 85057 T305 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 85570 T305 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 85615 T305 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:37264
   [junit4]   2> 85825 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 85826 T305 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 85826 T305 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002
   [junit4]   2> 85826 T305 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002/'
   [junit4]   2> 85873 T305 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002/solr.xml
   [junit4]   2> 85953 T305 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002
   [junit4]   2> 85953 T305 oasc.CoreContainer.<init> New CoreContainer 
1782833789
   [junit4]   2> 85953 T305 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002/]
   [junit4]   2> 86011 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 86012 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 86012 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 86012 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 86013 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 86013 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 86013 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 86013 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 86014 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 86017 T305 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 86020 T305 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 86020 T305 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 86021 T305 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 86021 T305 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:37258/solr
   [junit4]   2> 86042 T305 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 86042 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 86043 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 86045 T328 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3a594103 
name:ZooKeeperConnection Watcher:127.0.0.1:37258 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 86046 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 86046 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 86060 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 86062 T330 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@75a351ca 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 86062 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 86064 T305 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 86067 T305 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 86075 T305 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 86078 T305 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 86081 T305 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 86085 T305 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 86087 T305 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:37264__ow%2Fnk
   [junit4]   2> 86088 T305 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:37264__ow%2Fnk
   [junit4]   2> 86091 T305 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 86093 T305 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 86095 T305 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 86097 T305 oasc.OverseerElectionContext.runLeaderProcess I am 
going to be the leader 127.0.0.1:37264__ow%2Fnk
   [junit4]   2> 86098 T305 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 86100 T305 oasc.Overseer.start Overseer 
(id=92507658290790404-127.0.0.1:37264__ow%2Fnk-n_0000000000) starting
   [junit4]   2> 86115 T305 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 86142 T305 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 86159 T332 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 86159 T305 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 86162 T305 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 86164 T305 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 86184 T331 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 86190 T305 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002
   [junit4]   2> 86368 T305 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-002/conf/
   [junit4]   2> 87405 T305 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 87407 T305 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 87408 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 87498 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 87499 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 87501 T336 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@10384a3b 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 87501 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 87502 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 87503 T305 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 87510 T305 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 87510 T305 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 87511 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 87511 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 87513 T338 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@55901196 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 87514 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 87514 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 87523 T339 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 87542 T331 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: collection1
   [junit4]   2> 87542 T331 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 87551 T331 oasc.Overseer$ClusterStateUpdater.createCollection 
state version collection1 2
   [junit4]   2> 87563 T331 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 87585 T339 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 87585 T340 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 89043 T305 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 89044 T305 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 89050 T305 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 89053 T305 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:37269
   [junit4]   2> 89055 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 89056 T305 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 89056 T305 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003
   [junit4]   2> 89056 T305 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003/'
   [junit4]   2> 89114 T305 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003/solr.xml
   [junit4]   2> 89164 T305 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003
   [junit4]   2> 89164 T305 oasc.CoreContainer.<init> New CoreContainer 
776002649
   [junit4]   2> 89165 T305 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003/]
   [junit4]   2> 89166 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 89166 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 89166 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 89167 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 89167 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 89167 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 89167 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 89168 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 89168 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 89171 T305 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 89173 T305 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 89174 T305 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 89174 T305 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 89174 T305 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:37258/solr
   [junit4]   2> 89175 T305 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 89175 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 89176 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 89177 T351 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4420f065 
name:ZooKeeperConnection Watcher:127.0.0.1:37258 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 89178 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 89178 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 89180 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 89181 T353 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2ce806a3 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 89181 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 89189 T305 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 90195 T305 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:37269__ow%2Fnk
   [junit4]   2> 90196 T305 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:37269__ow%2Fnk
   [junit4]   2> 90200 T305 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 90204 T305 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003
   [junit4]   2> 91391 T305 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-003/conf/
   [junit4]   2> 91392 T305 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 91393 T305 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 91394 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 92849 T305 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 92850 T305 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 92857 T305 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 92860 T305 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:37272
   [junit4]   2> 92864 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 92865 T305 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 92865 T305 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004
   [junit4]   2> 92865 T305 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004/'
   [junit4]   2> 92915 T305 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004/solr.xml
   [junit4]   2> 92999 T305 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004
   [junit4]   2> 92999 T305 oasc.CoreContainer.<init> New CoreContainer 
1376426182
   [junit4]   2> 93000 T305 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004/]
   [junit4]   2> 93001 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 93002 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 93002 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 93002 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 93003 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 93003 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 93004 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 93004 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 93004 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 93009 T305 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 93013 T305 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 93013 T305 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 93014 T305 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 93014 T305 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:37258/solr
   [junit4]   2> 93015 T305 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 93015 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 93016 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 93018 T366 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3d68ca31 
name:ZooKeeperConnection Watcher:127.0.0.1:37258 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 93019 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 93019 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 93022 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 93023 T368 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5bc5fd48 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 93024 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 93034 T305 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 94042 T305 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:37272__ow%2Fnk
   [junit4]   2> 94044 T305 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:37272__ow%2Fnk
   [junit4]   2> 94049 T305 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 94054 T305 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004
   [junit4]   2> 94057 T305 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-004/conf/
   [junit4]   2> 95659 T305 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 95661 T305 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 95661 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 96813 T305 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 96814 T305 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 96821 T305 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 96823 T305 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:37277
   [junit4]   2> 96827 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 96827 T305 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 96827 T305 oasc.SolrResourceLoader.locateSolrHome using system 
property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005
   [junit4]   2> 96827 T305 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005/'
   [junit4]   2> 96859 T305 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005/solr.xml
   [junit4]   2> 96906 T305 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005
   [junit4]   2> 96907 T305 oasc.CoreContainer.<init> New CoreContainer 
568272577
   [junit4]   2> 96907 T305 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005/]
   [junit4]   2> 96908 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 96908 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 96909 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 96909 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 96909 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 96909 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 96910 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 96910 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 96910 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 96913 T305 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 96915 T305 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 96916 T305 oasl.LogWatcher.newRegisteredLogWatcher Registering 
Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 96916 T305 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 96916 T305 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:37258/solr
   [junit4]   2> 96917 T305 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 96917 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 96918 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 96919 T381 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@79025994 
name:ZooKeeperConnection Watcher:127.0.0.1:37258 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 96920 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 96920 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 96922 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 96923 T383 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2bbf1910 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 96924 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 96932 T305 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 97940 T305 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:37277__ow%2Fnk
   [junit4]   2> 97942 T305 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:37277__ow%2Fnk
   [junit4]   2> 97947 T305 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 97953 T305 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005
   [junit4]   2> 99162 T305 oasc.CorePropertiesLocator.discoverUnder Found core 
conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-005/conf/
   [junit4]   2> 99308 T305 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 99309 T305 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 99309 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 100356 T305 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 100356 T305 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 100363 T305 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 100365 T305 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:37280
   [junit4]   2> 100368 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 100368 T305 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 100368 T305 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006
   [junit4]   2> 100369 T305 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006/'
   [junit4]   2> 100402 T305 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006/solr.xml
   [junit4]   2> 100450 T305 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006
   [junit4]   2> 100450 T305 oasc.CoreContainer.<init> New CoreContainer 
1083495002
   [junit4]   2> 100451 T305 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006/]
   [junit4]   2> 100452 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 90000
   [junit4]   2> 100452 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: 
   [junit4]   2> 100452 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 100453 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 100453 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 100453 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 100453 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 100454 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 100454 T305 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 100456 T305 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 100459 T305 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 100459 T305 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 100459 T305 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 100459 T305 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:37258/solr
   [junit4]   2> 100460 T305 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 100460 T305 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 100461 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 100463 T396 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7b934d02 
name:ZooKeeperConnection Watcher:127.0.0.1:37258 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 100463 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 100464 T305 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 100466 T305 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 100467 T398 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7b884488 
name:ZooKeeperConnection Watcher:127.0.0.1:37258/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 100467 T305 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 100475 T305 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 101483 T305 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:37280__ow%2Fnk
   [junit4]   2> 101485 T305 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:37280__ow%2Fnk
   [junit4]   2> 101490 T305 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 101496 T305 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006
   [junit4]   2> 101637 T305 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-2B6B51549F05F06F-001/tempDir-006/conf/
   [junit4]   2> 103781 T305 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 103783 T305 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 103783 T305 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 105588 T346 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
collection.configName=conf1&wt=javabin&router.field=myOwnField&name=solrj_collection&action=CREATE&replicationFactor=2&version=2&numShards=2
   [junit4]   2> 105592 T339 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 105594 T332 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 105605 T402 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 105617 T402 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 105618 T402 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 105624 T339 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 105630 T331 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: solrj_collection
   [junit4]   2> 105631 T331 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 105632 T331 oasc.Overseer$ClusterStateUpdater.createCollection 
state version solrj_collection 1
   [junit4]   2> 105636 T339 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 105636 T340 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 105636 T354 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 105636 T369 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 105636 T384 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 105636 T399 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 105726 T402 oasc.OverseerCollectionProcessor.createCollection 
Creating SolrCores for new collection solrj_collection, shardNames [shard1, 
shard2] , replicationFactor : 2
   [junit4]   2> 105727 T402 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:37264__ow%2Fnk
   [junit4]   2> 105764 T402 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:37280__ow%2Fnk
   [junit4]   2> 105767 T402 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:37272__ow%2Fnk
   [junit4]   2> 105769 T402 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:37269__ow%2Fnk
   [junit4]   2> 105969 T321 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&wt=javabin&shard=shard1&collection=solrj_collection&qt=/admin/cores&name=solrj_collection_shard1_replica1&action=CREATE&version=2&numShards=2
   [junit4]   2> 105970 T388 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&wt=javabin&shard=shard1&collection=solrj_collection&qt=/admin/cores&name=solrj_collection_shard1_replica2&action=CREATE&version=2&numShards=2
   [junit4]   2> 105970 T348 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&wt=javabin&shard=shard2&collection=solrj_collection&qt=/admin/cores&name=solrj_collection_shard2_replica2&action=CREATE&version=2&numShards=2
   [junit4]   2> 105969 T364 oasha.CoreAdminHandler.handleCreateAction core 
create command 
collection.configName=conf1&wt=javabin&shard=shard2&collection=solrj_collection&qt=/admin/cores&name=solrj_collection_shard2_replica1&action=CREATE&version=2&numShards=2
   [junit4]   2> 105982 T388 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 105983 T348 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 105982 T321 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 105982 T364 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 105989 T339 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 105989 T321 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 105989 T388 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 105989 T348 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 105989 T364 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 105999 T331 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "node_name":"127.0.0.1:37272__ow%2Fnk",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:37272/_ow/nk";,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2"}
   [junit4]   2> 106008 T331 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "node_name":"127.0.0.1:37269__ow%2Fnk",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:37269/_ow/nk";,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2"}
   [junit4]   2> 106012 T339 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 106014 T331 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "node_name":"127.0.0.1:37280__ow%2Fnk",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:37280/_ow/nk";,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2"}
   [junit4]   2> 106019 T331 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "roles":null,
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "node_name":"127.0.0.1:37264__ow%2Fnk",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:37264/_ow/nk";,
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"2"}
   [junit4]   2> 106024 T339 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 106025 T339 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 106026 T340 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 106026 T384 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 106026 T354 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 106026 T369 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 106025 T399 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 106990 T321 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 106991 T321 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 106991 T348 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 106992 T321 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 106992 T348 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 106992 T388 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 106992 T321 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/solrj_collection
   [junit4]   2> 106993 T364 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 106993 T388 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 106993 T348 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 106994 T388 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 106994 T348 oascc.ZkStateReader.readCo

[...truncated too long message...]

it4]   2> 2857270 T2390 oasc.CachingDirectoryFactory.close Closing directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-003/collection1/data/index.20140924082018328
   [junit4]   2> 2857271 T2390 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 2862267 T2390 oas.SolrTestCaseJ4.tearDown ###Ending 
doTestRepeater
   [junit4]   2> 2862268 T2390 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=45338002
   [junit4]   2> 2862269 T2390 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@5588e2b6
   [junit4]   2> 2862269 T2390 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=2,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=6,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2862269 T2390 oasu.SolrCoreState.decrefSolrCoreState Closing 
SolrCoreState
   [junit4]   2> 2862270 T2390 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2862270 T2390 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2862271 T2390 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
   [junit4]   2> 2862271 T2390 oasc.CachingDirectoryFactory.close Closing 
MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2862272 T2390 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-001/collection1/data
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-001/collection1/data;done=false>>]
   [junit4]   2> 2862272 T2390 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-001/collection1/data
   [junit4]   2> 2862272 T2390 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-001/collection1/data/index
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-001/collection1/data/index;done=false>>]
   [junit4]   2> 2862273 T2390 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-001/collection1/data/index
   [junit4]   2> 2862273 T2390 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 2867275 T2390 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=2037369437
   [junit4]   2> 2867277 T2390 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@76cc9c95
   [junit4]   2> 2867277 T2390 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2867278 T2390 oasu.SolrCoreState.decrefSolrCoreState Closing 
SolrCoreState
   [junit4]   2> 2867278 T2390 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2867278 T2390 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2867280 T2390 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
   [junit4]   2> 2867280 T2390 oasc.CachingDirectoryFactory.close Closing 
MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2867281 T2390 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-002/collection1/data/index
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-002/collection1/data/index;done=false>>]
   [junit4]   2> 2867281 T2390 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-002/collection1/data/index
   [junit4]   2> 2867282 T2390 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-002/collection1/data
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-002/collection1/data;done=false>>]
   [junit4]   2> 2867282 T2390 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001/solr-instance-002/collection1/data
   [junit4]   2> 2867283 T2390 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 2872290 T2390 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler-2B6B51549F05F06F-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): 
{id=PostingsFormat(name=Lucene41WithOrds), 
newname=PostingsFormat(name=Lucene41WithOrds), 
name=PostingsFormat(name=Lucene41WithOrds)}, docValues:{}, 
sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=lt_LT, 
timezone=America/Recife
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=1,free=142978856,total=400556032
   [junit4]   2> NOTE: All tests run in this JVM: [TestRawResponseWriter, 
DistributedFacetPivotLargeTest, URLClassifyProcessorTest, TestReload, 
SolrCoreTest, DateFieldTest, TestQuerySenderNoQuery, TestLFUCache, SampleTest, 
PrimitiveFieldTypeTest, SolrIndexConfigTest, TestGroupingSearch, TestConfig, 
SolrRequestParserTest, DirectUpdateHandlerOptimizeTest, 
TestSweetSpotSimilarityFactory, TestSystemIdResolver, TestStressVersions, 
TestAtomicUpdateErrorCases, TestMissingGroups, CursorMarkTest, 
DirectUpdateHandlerTest, DistributedSuggestComponentTest, 
SignatureUpdateProcessorFactoryTest, AutoCommitTest, SystemInfoHandlerTest, 
TestPivotHelperCode, TestFunctionQuery, TestRecovery, SortByFunctionTest, 
TestDefaultSearchFieldResource, TestCloudManagedSchema, 
TestReplicationHandlerBackup, PeerSyncTest, SuggesterFSTTest, 
MultiThreadedOCPTest, CursorPagingTest, DebugComponentTest, 
AnalysisErrorHandlingTest, TestCollationField, BasicZkTest, 
OpenCloseCoreStressTest, NotRequiredUniqueKeyTest, TestLeaderElectionZkExpiry, 
DistribCursorPagingTest, TestDistributedMissingSort, 
SolrCoreCheckLockOnStartupTest, RequiredFieldsTest, MBeansHandlerTest, 
FastVectorHighlighterTest, TestReplicationHandler]
   [junit4] Completed on J1 in 1282.22s, 13 tests, 1 failure <<< FAILURES!

[...truncated 173 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:498:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:471:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:60:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1358:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:961:
 There were test failures: 429 suites, 1773 tests, 2 errors, 1 failure, 55 
ignored (11 assumptions)

Total time: 184 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-trunk #636
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 737696446 bytes
Compression is 0.0%
Took 2 min 6 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to