Build: https://builds.apache.org/job/Solr-trunk/1907/
1 tests failed.
FAILED: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch
Error Message:
Thread threw an uncaught exception, thread: Thread[Lucene Merge Thread #2,6,]
Stack Trace:
java.lang.RuntimeException: Thread threw an uncaught exception, thread:
Thread[Lucene Merge Thread #2,6,]
at
com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:859)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
at
org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
at
org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
Caused by: org.apache.lucene.index.MergePolicy$MergeException:
org.apache.lucene.store.AlreadyClosedException: this Directory is closed
at __randomizedtesting.SeedInfo.seed([DD847BC39AB622CF]:0)
at
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:507)
at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:480)
Caused by: org.apache.lucene.store.AlreadyClosedException: this Directory is
closed
at org.apache.lucene.store.Directory.ensureOpen(Directory.java:244)
at org.apache.lucene.store.RAMDirectory.listAll(RAMDirectory.java:107)
at
org.apache.lucene.store.NRTCachingDirectory.listAll(NRTCachingDirectory.java:124)
at
org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:320)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3135)
at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:382)
at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:451)
Build Log:
[...truncated 44279 lines...]
[junit4:junit4] 2> 25733 T2082 oascc.ZkStateReader.updateCloudState Manual
update of cluster state initiated
[junit4:junit4] 2> 25733 T2082 oascc.ZkStateReader.updateCloudState Updating
cloud state from ZooKeeper...
[junit4:junit4] 2> 25736 T2094 C127 P29756 /update {wt=javabin&version=2}
{add=[980 (1407022674297749504)]} 0 2
[junit4:junit4] 2> 25736 T2183 C129 P29760 REQ /update
{update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 25737 T2110 C128 P29758 /update {wt=javabin&version=2}
{delete=[10952 (-1407022674296700928)]} 0 4
[junit4:junit4] 2> 25740 T2094 C127 P29756 /update {wt=javabin&version=2}
{add=[10974 (1407022674302992384)]} 0 1
[junit4:junit4] 2> 25742 T2183 C129 P29760 REQ /update
{update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 25743 T2109 C128 P29758 /update {wt=javabin&version=2}
{add=[980 (1407022674301943808)]} 0 5
[junit4:junit4] 2> added docs:980 with 0 fails deletes:470
[junit4:junit4] 2> 25748 T2183 C129 P29760 REQ /update
{update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 25749 T2110 C128 P29758 /update {wt=javabin&version=2}
{add=[10974 (1407022674307186688)]} 0 6
[junit4:junit4] 2> added docs:974 with 0 fails deletes:466
[junit4:junit4] 2> 25752 T2094 C127 P29756 oasu.DirectUpdateHandler2.commit
start
commit{flags=0,version=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 26022 T2094 C127 P29756 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2>
commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341841361349/control/data/index
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@99e8fdf;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2>
commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341841361349/control/data/index
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@99e8fdf;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_60_nrm.cfs,
_63_nrm.cfs, _61_Lucene40_0.frq, _63.fdt, _64_Lucene40_0.frq, _66_nrm.cfe,
_66_Lucene40_0.tim, _63.fdx, _64_Lucene40_0.prx, _65_Lucene40_0.frq, _66.si,
_66_Lucene40_0.tip, _66_Lucene40_0.prx, _63_Lucene40_0.tim, _65_Lucene40_0.tim,
_60.fdx, _63_Lucene40_0.tip, _64_nrm.cfs, _65.fdt, _65_Lucene40_0.tip, _60.fdt,
_65.si, _60.fnm, _65.fdx, _62.fdx, _62.fdt, _65_nrm.cfs, _60_Lucene40_0.tip,
_61.fnm, _62_Lucene40_0.tip, _66_Lucene40_0.frq, _62.si, _64_Lucene40_0.tip,
_64_Lucene40_0.tim, _61_nrm.cfs, _63.si, _64.fdx, _64.si, _61.fdt, _62_nrm.cfs,
_66.fdx, _61.fdx, _66.fdt, _64.fdt, _63_Lucene40_0.prx, _61_1.del, _60.si,
_61_nrm.cfe, _65.fnm, _65_Lucene40_0.prx, _62_nrm.cfe, _62_Lucene40_0.tim,
_65_nrm.cfe, _60_Lucene40_0.frq, _66.fnm, _60_Lucene40_0.tim, _63.fnm,
_61_Lucene40_0.tim, _62_Lucene40_0.frq, _61_Lucene40_0.tip, _61.si,
_64_nrm.cfe, _60_1.del, _62_1.del, _62.fnm, _63_Lucene40_0.frq, _64.fnm,
_60_nrm.cfe, _63_nrm.cfe, _66_nrm.cfs, segments_2, _60_Lucene40_0.prx,
_61_Lucene40_0.prx, _62_Lucene40_0.prx]
[junit4:junit4] 2> 26023 T2094 C127 P29756
oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4] 2> 26043 T2094 C127 P29756 oass.SolrIndexSearcher.<init>
Opening Searcher@34db28a1 main
[junit4:junit4] 2> 26043 T2094 C127 P29756 oasu.DirectUpdateHandler2.commit
end_commit_flush
[junit4:junit4] 2> 26044 T2105 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@34db28a1
main{StandardDirectoryReader(segments_2:475 _61(5.0):C992/20 _60(5.0):C10/7
_62(5.0):C10/1 _63(5.0):C10 _64(5.0):C10 _65(5.0):C7 _66(5.0):C7)}
[junit4:junit4] 2> 26045 T2094 C127 P29756 /update
{waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=}
0 293
[junit4:junit4] 2> 26048 T2110 C128 P29758 oasu.DirectUpdateHandler2.commit
start
commit{flags=0,version=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 26158 T2110 C128 P29758 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2>
commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341841361349/jetty1/index
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@703113b4;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_5d_Lucene40_0.tim,
_5g.fnm, _5e.si, _5e_nrm.cfs, _5d_Lucene40_0.tip, _5d_nrm.cfs, _5h.fnm,
_5g_nrm.cfs, _5f_Lucene40_0.tim, _5c_Lucene40_0.frq, _5f_Lucene40_0.tip,
_5h_Lucene40_0.prx, _5e_nrm.cfe, _5f.fnm, _5e.fdt, _5g_Lucene40_0.tip, _5e.fdx,
_5g_Lucene40_0.tim, _5d.si, _5g_Lucene40_0.frq, _5g_nrm.cfe, _5d_nrm.cfe,
_5f_nrm.cfs, _5d_Lucene40_0.prx, _5c_Lucene40_0.prx, _5h.fdt, _5f.si, _5g.si,
_5h.fdx, _5h_Lucene40_0.frq, _5h_nrm.cfs, _5f_nrm.cfe, _5d.fnm,
_5c_Lucene40_0.tip, _5f.fdx, _5d_Lucene40_0.frq, _5f.fdt, _5c_Lucene40_0.tim,
_5c.fnm, _5h_nrm.cfe, _5e_Lucene40_0.tip, _5d.fdx, _5e_Lucene40_0.tim, _5d.fdt,
_5g.fdx, _5c.fdt, _5g.fdt, _5d_1.del, _5e.fnm, _5c.fdx, _5e_Lucene40_0.prx,
_5e_Lucene40_0.frq, _5c_nrm.cfs, _5h_Lucene40_0.tip, _5f_Lucene40_0.frq,
_5h.si, _5c.si, _5c_nrm.cfe, _5g_Lucene40_0.prx, _5h_Lucene40_0.tim,
_5f_Lucene40_0.prx, segments_3]
[junit4:junit4] 2>
commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341841361349/jetty1/index
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@703113b4;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_6a_nrm.cfe,
_68.fnm, _68.si, _6a_Lucene40_0.tip, _68_1.del, _69_Lucene40_0.prx,
_68_Lucene40_0.prx, _68_nrm.cfs, _69.si, _69_Lucene40_0.frq, _68.fdt, _6a.fdx,
_69.fdx, _6a_Lucene40_0.frq, _68.fdx, _6a.fdt, _69.fdt, _6a_Lucene40_0.tim,
_6a_nrm.cfs, _69_Lucene40_0.tip, _69_nrm.cfe, _68_Lucene40_0.frq, _69_nrm.cfs,
_69_Lucene40_0.tim, _6a.si, _68_Lucene40_0.tim, _69.fnm, _6a_Lucene40_0.prx,
_6a.fnm, _68_Lucene40_0.tip, _68_nrm.cfe, segments_4]
[junit4:junit4] 2> 26159 T2110 C128 P29758
oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4] 2> 26171 T2110 C128 P29758 oass.SolrIndexSearcher.<init>
Opening Searcher@2bf9490a main
[junit4:junit4] 2> 26172 T2110 C128 P29758 oasu.DirectUpdateHandler2.commit
end_commit_flush
[junit4:junit4] 2> 26173 T2117 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@2bf9490a
main{StandardDirectoryReader(segments_4:485 _68(5.0):C1016/5 _69(5.0):C3
_6a(5.0):C4)}
[junit4:junit4] 2> 26176 T2183 C129 P29760 oasu.DirectUpdateHandler2.commit
start
commit{flags=0,version=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 26294 T2183 C129 P29760 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2>
commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341841361349/jetty2/index.20120709094305001
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6190a6f4;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_5y_Lucene40_0.prx,
_5z.fnm, _5y.si, _5w_Lucene40_0.frq, _5w_Lucene40_0.prx, _60.fnm, _5v.fnm,
_5x_1.del, _5m_1.del, _5x_Lucene40_0.tim, _60_Lucene40_0.tip, _5w.fdt, _5z.fdt,
_5w.fdx, _5x_Lucene40_0.tip, _5x_Lucene40_0.frq, _63.si, _5v.fdx, _61.fdt,
_5z_1.del, _5v.fdt, _61.fdx, _5z.fdx, _5y_1.del, _63_Lucene40_0.prx, _60.si,
_5v_Lucene40_0.frq, _5x.si, _5m_Lucene40_0.frq, _5m.fnm, _5x.fnm,
_60_Lucene40_0.tim, _5m.si, _63.fnm, _5w.si, _5m.fdx, _63_Lucene40_0.frq,
_5w_Lucene40_0.tip, _5w_Lucene40_0.tim, _60_Lucene40_0.prx, _5z.si,
_5y_Lucene40_0.frq, _60_nrm.cfs, _63_nrm.cfs, _5m.fdt, _5z_Lucene40_0.prx,
_5w_nrm.cfs, _61_Lucene40_0.frq, _63.fdt, _63.fdx, _63_Lucene40_0.tim, _60.fdx,
_63_Lucene40_0.tip, _60.fdt, _61.fnm, _5z_Lucene40_0.tim, _5z_Lucene40_0.tip,
_5v_Lucene40_0.tip, _5v_Lucene40_0.tim, _5x.fdt, _5x.fdx, _61_nrm.cfs,
_5x_nrm.cfs, _5z_Lucene40_0.frq, _5w_nrm.cfe, _5m_Lucene40_0.tip, _5x_nrm.cfe,
_5m_Lucene40_0.tim, _5v_Lucene40_0.prx, _5x_Lucene40_0.prx, _61_nrm.cfe,
_5v_nrm.cfs, _60_Lucene40_0.frq, _5y.fnm, _5y_Lucene40_0.tip,
_5y_Lucene40_0.tim, _5m_nrm.cfs, _61_Lucene40_0.tim, _61_Lucene40_0.tip,
_61.si, _5v.si, _5z_nrm.cfs, _60_1.del, _5m_Lucene40_0.prx, _5m_nrm.cfe,
_5y.fdx, _5z_nrm.cfe, _5y_nrm.cfe, _5y.fdt, _5w_1.del, _60_nrm.cfe,
_63_nrm.cfe, _5v_nrm.cfe, _5v_1.del, _5y_nrm.cfs, _61_Lucene40_0.prx, _5w.fnm,
segments_4]
[junit4:junit4] 2>
commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341841361349/jetty2/index.20120709094305001
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6190a6f4;
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[_6a_nrm.cfe,
_6a_Lucene40_0.tip, _6c_Lucene40_0.prx, _6a_1.del, _6b_Lucene40_0.frq, _6a.fdx,
_6a_Lucene40_0.frq, _6a.fdt, _6c_Lucene40_0.frq, _6a_Lucene40_0.tim, _6c.si,
_6a_nrm.cfs, _6b_Lucene40_0.tim, _6c_nrm.cfs, _6b_nrm.cfs, _6b.fdx,
_6c_Lucene40_0.tip, _6c_Lucene40_0.tim, _6b.fnm, _6b.fdt, _6c.fdx, _6a.si,
_6c_nrm.cfe, _6a_Lucene40_0.prx, _6b_nrm.cfe, _6b_Lucene40_0.tip, _6b.si,
_6c.fdt, _6c.fnm, segments_5, _6a.fnm, _6b_Lucene40_0.prx]
[junit4:junit4] 2> 26295 T2183 C129 P29760
oasc.SolrDeletionPolicy.updateCommits newest commit = 5
[junit4:junit4] 2> 26306 T2183 C129 P29760 oass.SolrIndexSearcher.<init>
Opening Searcher@65403418 main
[junit4:junit4] 2> 26306 T2183 C129 P29760 oasu.DirectUpdateHandler2.commit
end_commit_flush
[junit4:junit4] 2> 26307 T2197 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@65403418
main{StandardDirectoryReader(segments_5:488:nrt _6a(5.0):C1015/11 _6b(5.0):C10
_6c(5.0):C4)}
[junit4:junit4] 2> 26308 T2183 C129 P29760 /update
{waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2}
{commit=} 0 132
[junit4:junit4] 2> 26308 T2110 C128 P29758 /update
{waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=}
0 260
[junit4:junit4] 2> 26310 T2112 C128 P29758 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1018 status=0 QTime=0
[junit4:junit4] 2> 26313 T2182 C129 P29760 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1018 status=0 QTime=1
[junit4:junit4] 2> 26316 T2112 C128 P29758 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1018 status=0 QTime=0
[junit4:junit4] 2> 26319 T2182 C129 P29760 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1018 status=0 QTime=0
[junit4:junit4] 2> 26320 T2082 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=1237218665
[junit4:junit4] 2> 26320 T2082 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@471f412d
[junit4:junit4] 2> 26321 T2082 oasc.SolrCore.closeSearcher [collection1]
Closing main searcher on request.
[junit4:junit4] 2> 26322 T2082 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=1,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1954,cumulative_deletesById=936,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 26324 T2087 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386bfa49cb0002
[junit4:junit4] 2> 26326 T2102 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26326 T2136 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26326 T2116 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26326 T2102 oascc.ZkStateReader$3.process WARNING
ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 26326 T2082 oaz.ZooKeeper.close Session: 0x1386bfa49cb0002
closed
[junit4:junit4] 2> 26326 T2084 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:29757 which had sessionid
0x1386bfa49cb0002
[junit4:junit4] 2> 26326 T2189 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26326 T2132 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26326 T2082 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 26327 T2102 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 26327 T2116 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4:junit4] 2> 26329 T2116 oasc.Overseer.<init> Overseer
(id=87938915457761283-127.0.0.1:29758_solr-n_0000000001) starting
[junit4:junit4] 2> 26330 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0003
type:create cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26331 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0003
type:create cxid:0x62 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26340 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0003
type:create cxid:0x63 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26341 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0003
type:create cxid:0x64 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26342 T2254 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4:junit4] 2> 26343 T2253 oasc.Overseer$CloudStateUpdater.run Starting
to work on the main queue
[junit4:junit4] 2> 26379 T2082 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=1357983019
[junit4:junit4] 2> 26379 T2082 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@1c1e96e4
[junit4:junit4] 2> 26381 T2082 oasc.SolrCore.closeSearcher [collection1]
Closing main searcher on request.
[junit4:junit4] 2> 26381 T2082 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=3,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1954,cumulative_deletesById=936,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 26382 T2087 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386bfa49cb0003
[junit4:junit4] 2> 26383 T2116 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26383 T2132 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26383 T2084 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:29759 which had sessionid
0x1386bfa49cb0003
[junit4:junit4] 2> 26383 T2136 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26384 T2189 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4:junit4] 2> 26383 T2082 oaz.ZooKeeper.close Session: 0x1386bfa49cb0003
closed
[junit4:junit4] 2> 26384 T2116 oascc.ZkStateReader$3.process WARNING
ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 26384 T2116 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 26385 T2082 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 26386 T2189 oasc.Overseer.<init> Overseer
(id=87938915457761287-127.0.0.1:29760_solr-n_0000000004) starting
[junit4:junit4] 2> 26386 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0007
type:create cxid:0x46 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26388 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0007
type:create cxid:0x47 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26396 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0007
type:create cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26397 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0007
type:create cxid:0x49 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26399 T2256 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4:junit4] 2> 26399 T2255 oasc.Overseer$CloudStateUpdater.run Starting
to work on the main queue
[junit4:junit4] 2> 26399 T2189 oasu.PeerSync.sync PeerSync: core=collection1
url=127.0.0.1:29752/solr START replicas=[] nUpdates=100
[junit4:junit4] 2> 26401 T2189 oasu.PeerSync.sync PeerSync: core=collection1
url=127.0.0.1:29752/solr DONE. sync succeeded
[junit4:junit4] 2> 26401 T2189 oasc.SyncStrategy.syncToMe try and ask
http://127.0.0.1:29758/solr/collection1/ to sync
[junit4:junit4] 2> 26402 T2196 C129 P29760 oasu.PeerSync.sync PeerSync:
core=collection1 url=127.0.0.1:29752/solr START
replicas=[127.0.0.1:29760/solr/collection1/] nUpdates=100
[junit4:junit4] 2> 26405 T2185 C129 P29760 REQ /get
{distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2
[junit4:junit4] 2> 26405 T2196 C129 P29760 oasu.PeerSync.handleVersions
PeerSync: core=collection1 url=127.0.0.1:29752/solr Received 100 versions from
127.0.0.1:29760/solr/collection1/
[junit4:junit4] 2> 26406 T2196 C129 P29760 oasu.PeerSync.handleVersions
PeerSync: core=collection1 url=127.0.0.1:29752/solr Our versions are newer.
ourLowThreshold=1407022673786044416 otherHigh=1407022674171920384
[junit4:junit4] 2> 26406 T2196 C129 P29760 oasu.PeerSync.sync PeerSync:
core=collection1 url=127.0.0.1:29752/solr DONE. sync succeeded
[junit4:junit4] 2> 26406 T2196 C129 P29760 REQ /get
{sync=127.0.0.1:29760/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2}
status=0 QTime=4
[junit4:junit4] 2> 26406 T2189 oasc.RecoveryStrategy.close WARNING Stopping
recovery for core collection1 zkNodeName=127.0.0.1:29760_solr_collection1
[junit4:junit4] 2> 26408 T2189 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard1
[junit4:junit4] 2> 26410 T2087 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386bfa49cb0007
type:create cxid:0x5a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26421 T2189 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26437 T2082 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=772410051
[junit4:junit4] 2> 26437 T2082 oasc.RecoveryStrategy.close WARNING Stopping
recovery for core collection1 zkNodeName=127.0.0.1:29760_solr_collection1
[junit4:junit4] 2> 26437 T2082 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@661e855f
[junit4:junit4] 2> 26439 T2082 oasc.SolrCore.closeSearcher [collection1]
Closing main searcher on request.
[junit4:junit4] 2> 26439 T2082 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=4,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1043,cumulative_deletesById=516,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 26440 T2082 oasc.RecoveryStrategy.close WARNING Stopping
recovery for core collection1 zkNodeName=127.0.0.1:29760_solr_collection1
[junit4:junit4] 2> 26440 T2087 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386bfa49cb0007
[junit4:junit4] 2> 26441 T2136 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26441 T2132 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26441 T2189 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 26441 T2082 oaz.ZooKeeper.close Session: 0x1386bfa49cb0007
closed
[junit4:junit4] 2> 26442 T2084 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:29785 which had sessionid
0x1386bfa49cb0007
[junit4:junit4] 2> 26442 T2189 oascc.ZkStateReader$3.process WARNING
ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 26442 T2189 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 26442 T2082 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 26495 T2087 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386bfa49cb0006
[junit4:junit4] 2> 26496 T2136 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 26496 T2082 oaz.ZooKeeper.close Session: 0x1386bfa49cb0006
closed
[junit4:junit4] 2> 26496 T2084 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:29766 which had sessionid
0x1386bfa49cb0006
[junit4:junit4] 2> 26496 T2087 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386bfa49cb0005
[junit4:junit4] 2> 26497 T2132 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 26497 T2084 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:29763 which had sessionid
0x1386bfa49cb0005
[junit4:junit4] 2> 26497 T2082 oaz.ZooKeeper.close Session: 0x1386bfa49cb0005
closed
[junit4:junit4] 2> 26497 T2087 oazs.PrepRequestProcessor.run
PrepRequestProcessor exited loop!
[junit4:junit4] 2> 26497 T2086 oazs.SyncRequestProcessor.run
SyncRequestProcessor exited!
[junit4:junit4] 2> 26498 T2082 oazs.FinalRequestProcessor.shutdown shutdown
of request processor complete
[junit4:junit4] 2> 26617 T2084 oazs.NIOServerCnxn$Factory.run NIOServerCnxn
factory exited run method
[junit4:junit4] 2> 26618 T2082 oazs.FinalRequestProcessor.shutdown shutdown
of request processor complete
[junit4:junit4] 2> 26655 T2082 oas.SolrTestCaseJ4.tearDown ###Ending
testDistribSearch
[junit4:junit4] 2> 26668 T2103 oasc.Overseer$CloudStateUpdater.amILeader
WARNING org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4] 2> at
org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4] 2> at
org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2>
[junit4:junit4] 2> 26668 T2103 oasc.Overseer$CloudStateUpdater.amILeader
According to ZK I (id=87938915457761282-127.0.0.1:29756_solr-n_0000000000) am
no longer a leader.
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest
-Dtests.method=testDistribSearch -Dtests.seed=DD847BC39AB622CF
-Dtests.slow=true -Dtests.locale=es_AR -Dtests.timezone=America/Virgin
-Dtests.file.encoding=ISO8859-1
[junit4:junit4] 2>
[junit4:junit4] > (@AfterClass output)
[junit4:junit4] 2> 26710 T2082 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40: {},
sim=DefaultSimilarity, locale=es_AR, timezone=America/Virgin
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc.
1.6.0_32 (64-bit)/cpus=16,threads=11,free=175816488,total=325058560
[junit4:junit4] 2> NOTE: All tests run in this JVM:
[TestJapaneseBaseFormFilterFactory, TestHindiFilters, TestNumberUtils,
TestRangeQuery, OpenExchangeRatesOrgProviderTest,
TestFrenchLightStemFilterFactory, TestGroupingSearch,
TestThaiWordFilterFactory, TestFastLRUCache, LegacyHTMLStripCharFilterTest,
SortByFunctionTest, CoreAdminHandlerTest, TestStressRecovery,
DocumentAnalysisRequestHandlerTest, CloudStateUpdateTest,
QueryElevationComponentTest, IndexSchemaTest, TestQuerySenderNoQuery,
TestPropInjectDefaults, TestRandomFaceting, SystemInfoHandlerTest,
IndexReaderFactoryTest, SearchHandlerTest, TestUtils,
FullSolrCloudDistribCmdsTest, TestShingleFilterFactory,
UniqFieldsUpdateProcessorFactoryTest, DistributedTermsComponentTest,
TestPhraseSuggestions, TestIBSimilarityFactory, JsonLoaderTest,
TestTurkishLowerCaseFilterFactory, TestHunspellStemFilterFactory, TestConfig,
TestWordDelimiterFilterFactory, TestStopFilterFactory,
TestBrazilianStemFilterFactory, SOLR749Test,
TestFrenchMinimalStemFilterFactory, AlternateDirectoryTest,
XmlUpdateRequestHandlerTest, TestDistributedGrouping,
TestSuggestSpellingConverter, TestTypeTokenFilterFactory, UpdateParamsTest,
TestSolrQueryParser, ResourceLoaderTest, TestPHPSerializedResponseWriter,
TestDFRSimilarityFactory, TestWikipediaTokenizerFactory,
TestSolrCoreProperties, TestCJKWidthFilterFactory, DateMathParserTest,
TestFinnishLightStemFilterFactory, TestJapaneseTokenizerFactory,
WordBreakSolrSpellCheckerTest, TestQuerySenderListener, DateFieldTest,
TestReversedWildcardFilterFactory, TestSearchPerf,
TestCapitalizationFilterFactory, TestBinaryResponseWriter,
SignatureUpdateProcessorFactoryTest, TestJmxMonitoredMap,
TestCzechStemFilterFactory, TestMultiWordSynonyms, FullSolrCloudTest,
TestPseudoReturnFields, TestElisionFilterFactory,
TestEnglishMinimalStemFilterFactory, ZkSolrClientTest, DOMUtilTest,
BadComponentTest, TestFunctionQuery, TestCollationField, TestCodecSupport,
TestGreekStemFilterFactory, TestUpdate, TestRemoteStreaming,
TestGreekLowerCaseFilterFactory, DirectUpdateHandlerTest,
TestLuceneMatchVersion, SuggesterFSTTest, TestBeiderMorseFilterFactory,
TestPersianNormalizationFilterFactory, TestDocSet, ZkControllerTest,
TestStressLucene, TestPortugueseStemFilterFactory, SolrCoreTest,
BinaryUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest,
SolrInfoMBeanTest, TestCharFilters, SoftAutoCommitTest,
TestGermanNormalizationFilterFactory, FieldAnalysisRequestHandlerTest,
SpatialFilterTest, TestPhoneticFilterFactory, TestGalicianStemFilterFactory,
LeaderElectionIntegrationTest, TestPropInject, TestOmitPositions,
TestExtendedDismaxParser, TestBinaryField, FileUtilsTest, SuggesterTest,
DisMaxRequestHandlerTest, TestSolrDeletionPolicy2,
TestPortugueseLightStemFilterFactory, SpellPossibilityIteratorTest,
TestGermanLightStemFilterFactory, StatsComponentTest,
TestJapaneseReadingFormFilterFactory, TestSurroundQueryParser,
SolrIndexConfigTest, TestMultiCoreConfBootstrap, FileBasedSpellCheckerTest,
TestDelimitedPayloadTokenFilterFactory, TermsComponentTest,
TestPortugueseMinimalStemFilterFactory, DirectSolrConnectionTest,
HighlighterTest, TermVectorComponentTest, TestBadConfig, TestStressVersions,
TestMappingCharFilterFactory, TestPatternTokenizerFactory, TestIndexSearcher,
SpellCheckComponentTest, SampleTest, TestDefaultSimilarityFactory,
BadIndexSchemaTest, IndexBasedSpellCheckerTest, TestStandardFactories,
TimeZoneUtilsTest, CommonGramsFilterFactoryTest,
TestDictionaryCompoundWordTokenFilterFactory, BasicDistributedZkTest,
OverseerTest, RecoveryZkTest]
[junit4:junit4] 2>
[junit4:junit4] Completed in 26.72s, 1 test, 1 error <<< FAILURES!
[...truncated 461 lines...]
[...truncated 44891 lines...]
[...truncated 44891 lines...]
[...truncated 44891 lines...]
[...truncated 44891 lines...]
[...truncated 44872 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build.xml:144:
The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/lucene/module-build.xml:62:
The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/lucene/common-build.xml:1096:
The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/lucene/common-build.xml:793:
There were test failures: 290 suites, 1026 tests, 1 error, 5 ignored
Total time: 39 minutes 1 second
Build step 'Execute shell' marked build as failure
[TASKS] Scanning folder '/home/hudson/hudson-slave/workspace/Solr-trunk' for
files matching the pattern '**/*.java' - excludes:
[TASKS] Found 3790 files to scan for tasks
[TASKS] Found 1318 open tasks.
[TASKS] Computing warning deltas based on reference build #1905
Archiving artifacts
Publishing Clover coverage report...
No Clover report will be published due to a Build Failure
Recording test results
Publishing Javadoc
Email was triggered for: Failure
Sending email for trigger: Failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
