Build: https://builds.apache.org/job/Solr-trunk/1906/
1 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch
Error Message:
Thread threw an uncaught exception, thread: Thread[Lucene Merge Thread #2,6,]
Stack Trace:
java.lang.RuntimeException: Thread threw an uncaught exception, thread:
Thread[Lucene Merge Thread #2,6,]
at
com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:859)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
at
org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
at
org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
Caused by: org.apache.lucene.index.MergePolicy$MergeException:
org.apache.lucene.store.AlreadyClosedException: this Directory is closed
at __randomizedtesting.SeedInfo.seed([23C40DAD0203120E]:0)
at
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:507)
at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:480)
Caused by: org.apache.lucene.store.AlreadyClosedException: this Directory is
closed
at org.apache.lucene.store.Directory.ensureOpen(Directory.java:244)
at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:241)
at
org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:320)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3135)
at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:382)
at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:451)
Build Log:
[...truncated 46148 lines...]
[junit4:junit4] 2> 25225 T2248 C165 P23461 oass.SolrIndexSearcher.<init>
Opening Searcher@167dbf04 main
[junit4:junit4] 2> 25225 T2248 C165 P23461 oasu.DirectUpdateHandler2.commit
end_commit_flush
[junit4:junit4] 2> 25226 T2258 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@167dbf04
main{StandardDirectoryReader(segments_2:507 _61(5.0):C1021/19 _6i(5.0):C95/15
_6h(5.0):C10/1 _6j(5.0):C10/4 _6k(5.0):C10 _6l(5.0):C2)}
[junit4:junit4] 2> 25227 T2248 C165 P23461 /update
{waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=}
0 102
[junit4:junit4] 2> 25229 T2262 C166 P23463 oasu.DirectUpdateHandler2.commit
start
commit{flags=0,version=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 25331 T2262 C166 P23463 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2>
commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341760582046/jetty1/index,segFN=segments_3,generation=3,filenames=[_61_1.del,
_63_nrm.cfs, _60_nrm.cfs, _60.si, _61_Lucene40_0.frq, _63.fdt, _61_nrm.cfe,
_63.fdx, _62_nrm.cfe, _63_Lucene40_0.tim, _62_Lucene40_0.tim, _60.fdx,
_63_Lucene40_0.tip, _60_Lucene40_0.frq, _60.fdt, _60.fnm, _60_Lucene40_0.tim,
_62.fdx, _63.fnm, _62_2.del, _61_Lucene40_0.tim, _62.fdt, _62_Lucene40_0.frq,
_61_Lucene40_0.tip, _61.si, _62_Lucene40_0.tip, _60_1.del, _61.fnm,
_60_Lucene40_0.tip, _62.si, _62.fnm, _63.si, _61_nrm.cfs, _63_Lucene40_0.frq,
_61.fdt, _62_nrm.cfs, _63_nrm.cfe, _61.fdx, _60_nrm.cfe, _60_Lucene40_0.prx,
_61_Lucene40_0.prx, segments_3, _63_Lucene40_0.prx, _62_Lucene40_0.prx]
[junit4:junit4] 2>
commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341760582046/jetty1/index,segFN=segments_4,generation=4,filenames=[_6i_Lucene40_0.tim,
_6j_nrm.cfs, _61_Lucene40_0.frq, _6k_nrm.cfs, _6l.fnm, _6j_nrm.cfe, _6h_2.del,
_6i_Lucene40_0.tip, _61_2.del, _6i_Lucene40_0.prx, _6h_Lucene40_0.prx, _6k.si,
_6k.fdx, _6k_Lucene40_0.tip, _6j.fdt, _6i.si, _6k_Lucene40_0.tim, _6j.fdx,
_6l_nrm.cfe, _6h.si, _6h_nrm.cfe, _6l_Lucene40_0.prx, _61.fnm,
_6j_Lucene40_0.frq, _6k.fdt, _6i_nrm.cfe, _61_nrm.cfs, _6j_Lucene40_0.prx,
_61.fdt, _6h_nrm.cfs, _6h_Lucene40_0.tim, _6k_1.del, _61.fdx,
_6l_Lucene40_0.frq, _6h_Lucene40_0.tip, _6i_nrm.cfs, _6h.fnm,
_6l_Lucene40_0.tip, _6l_Lucene40_0.tim, _6i.fnm, _61_nrm.cfe,
_6h_Lucene40_0.frq, _6j_Lucene40_0.tim, _6j.si, _6l.si, _6l.fdx, _6h.fdt,
_61_Lucene40_0.tim, _6j_Lucene40_0.tip, _6h.fdx, _6j.fnm, _61_Lucene40_0.tip,
_61.si, _6i_1.del, _6j_1.del, _6l_nrm.cfs, _6l.fdt, _6k.fnm, _6i.fdt,
_6k_Lucene40_0.prx, _6i.fdx, _6i_Lucene40_0.frq, _6k_nrm.cfe,
_6k_Lucene40_0.frq, _61_Lucene40_0.prx, segments_4]
[junit4:junit4] 2> 25331 T2262 C166 P23463
oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4] 2> 25341 T2262 C166 P23463 oass.SolrIndexSearcher.<init>
Opening Searcher@1d151288 main
[junit4:junit4] 2> 25342 T2262 C166 P23463 oasu.DirectUpdateHandler2.commit
end_commit_flush
[junit4:junit4] 2> 25342 T2270 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@1d151288
main{StandardDirectoryReader(segments_4:509 _61(5.0):C1020/20 _6i(5.0):C95/15
_6h(5.0):C10/4 _6j(5.0):C10/2 _6k(5.0):C10/2 _6l(5.0):C7)}
[junit4:junit4] 2> 25345 T2340 C167 P23465 oasu.DirectUpdateHandler2.commit
start
commit{flags=0,version=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 25459 T2340 C167 P23465 oasc.SolrDeletionPolicy.onCommit
SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2>
commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341760582046/jetty2/index.20120708211645906,segFN=segments_4,generation=4,filenames=[_6d_1.del,
_6e.fdx, _6d.fdt, _61_Lucene40_0.frq, _6e_nrm.cfs, _6b_1.del, _6e.fdt,
_6d.fdx, _61_2.del, _6c_Lucene40_0.prx, _6a_Lucene40_0.frq, _6e_nrm.cfe,
_61.fnm, _6d_nrm.cfe, _6e_Lucene40_0.frq, _6d_Lucene40_0.prx, _6c_nrm.cfs,
_6b_nrm.cfs, _6b.fdx, _6b.fdt, _61_nrm.cfs, _6d_nrm.cfs, _61.fdt, _6e.si,
_6c_nrm.cfe, _61.fdx, _6b_nrm.cfe, _6c.fnm, _6b_Lucene40_0.prx, _6a_nrm.cfe,
_6a_Lucene40_0.tip, _61_nrm.cfe, _6d_Lucene40_0.tip, _6d_Lucene40_0.tim,
_6a_1.del, _6b_Lucene40_0.frq, _6a.fdx, _6a.fdt, _6c_1.del, _6c_Lucene40_0.frq,
_6e_Lucene40_0.prx, _6e_Lucene40_0.tip, _6e_Lucene40_0.tim, _61_Lucene40_0.tim,
_6a_Lucene40_0.tim, _6a_nrm.cfs, _6c.si, _61_Lucene40_0.tip, _61.si, _6d.fnm,
_6b_Lucene40_0.tim, _6c_Lucene40_0.tip, _6b.fnm, _6c_Lucene40_0.tim,
_6d_Lucene40_0.frq, _6e.fnm, _6c.fdx, _6a.si, _6d.si, _6a_Lucene40_0.prx,
_6b_Lucene40_0.tip, _6b.si, _6c.fdt, _6a.fnm, _61_Lucene40_0.prx, segments_4]
[junit4:junit4] 2>
commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1341760582046/jetty2/index.20120708211645906,segFN=segments_5,generation=5,filenames=[_6i_Lucene40_0.tim,
_6n_Lucene40_0.prx, _6j_nrm.cfs, _6k_nrm.cfs, _6l.fnm, _6j_nrm.cfe,
_6i_Lucene40_0.tip, _6i_Lucene40_0.prx, _6h_Lucene40_0.prx, _6k.si, _6k.fdx,
_6m.si, _6m.fdx, _6j.fdt, _6k_Lucene40_0.tip, _6i.si, _6k_Lucene40_0.tim,
_6j.fdx, _6l_nrm.cfe, _6h_nrm.cfe, _6h.si, _6l_Lucene40_0.prx,
_6n_Lucene40_0.frq, _6j_Lucene40_0.frq, _6n_nrm.cfs, _6m.fdt,
_6m_Lucene40_0.prx, _6k.fdt, _6i_nrm.cfe, _6j_Lucene40_0.prx, _6h_nrm.cfs,
_6h_Lucene40_0.tim, _6k_1.del, _6m_Lucene40_0.frq, _6l_Lucene40_0.frq,
_6h_Lucene40_0.tip, _6m_nrm.cfe, _6n.fnm, _6i_nrm.cfs, _6h_1.del, _6h.fnm,
_6m_nrm.cfs, _6l_Lucene40_0.tip, _6n.fdx, _6l_Lucene40_0.tim, _6m.fnm, _6i.fnm,
_6h_Lucene40_0.frq, _6m_1.del, _6j_Lucene40_0.tim, _6j.si, _6m_Lucene40_0.tip,
_6m_Lucene40_0.tim, _6l.si, _6l.fdx, _6h.fdt, _6n_Lucene40_0.tim,
_6j_Lucene40_0.tip, _6h.fdx, _6n_Lucene40_0.tip, _6j.fnm, _6n_nrm.cfe,
_6l_1.del, _6n.si, _6j_1.del, _6i_1.del, _6l_nrm.cfs, _6l.fdt, _6k.fnm,
_6i.fdt, _6k_Lucene40_0.prx, _6i.fdx, _6i_Lucene40_0.frq, _6n.fdt, _6k_nrm.cfe,
_6k_Lucene40_0.frq, segments_5]
[junit4:junit4] 2> 25460 T2340 C167 P23465
oasc.SolrDeletionPolicy.updateCommits newest commit = 5
[junit4:junit4] 2> 25467 T2340 C167 P23465 oass.SolrIndexSearcher.<init>
Opening Searcher@44df2769 main
[junit4:junit4] 2> 25468 T2340 C167 P23465 oasu.DirectUpdateHandler2.commit
end_commit_flush
[junit4:junit4] 2> 25468 T2371 oasc.SolrCore.registerSearcher [collection1]
Registered new searcher Searcher@44df2769
main{StandardDirectoryReader(segments_5:514:nrt _6h(5.0):C1085/19
_6i(5.0):C10/2 _6j(5.0):C10/4 _6k(5.0):C10/3 _6l(5.0):C10/2 _6m(5.0):C10/2
_6n(5.0):C6)}
[junit4:junit4] 2> 25470 T2340 C167 P23465 /update
{waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2}
{commit=} 0 125
[junit4:junit4] 2> 25471 T2262 C166 P23463 /update
{waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=}
0 242
[junit4:junit4] 2> 25472 T2265 C166 P23463 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1109 status=0 QTime=0
[junit4:junit4] 2> 25474 T2374 C167 P23465 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1109 status=0 QTime=0
[junit4:junit4] 2> 25477 T2265 C166 P23463 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1109 status=0 QTime=0
[junit4:junit4] 2> 25480 T2374 C167 P23465 REQ /select
{distrib=false&wt=javabin&q=*:*&version=2} hits=1109 status=0 QTime=0
[junit4:junit4] 2> 25481 T2235 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=390264955
[junit4:junit4] 2> 25481 T2235 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@4831d1a9
[junit4:junit4] 2> 25482 T2235 oasc.SolrCore.closeSearcher [collection1]
Closing main searcher on request.
[junit4:junit4] 2> 25483 T2235 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=1,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2082,cumulative_deletesById=973,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25485 T2242 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386729b2210002
[junit4:junit4] 2> 25486 T2347 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25486 T2269 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25486 T2255 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25486 T2289 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25486 T2235 oaz.ZooKeeper.close Session: 0x1386729b2210002
closed
[junit4:junit4] 2> 25486 T2285 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25486 T2237 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:23462 which had sessionid
0x1386729b2210002
[junit4:junit4] 2> 25487 T2255 oascc.ZkStateReader$3.process WARNING
ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 25487 T2255 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 25487 T2235 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 25488 T2269 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4:junit4] 2> 25490 T2269 oasc.Overseer.<init> Overseer
(id=87933621513551875-127.0.0.1:23463_solr-n_0000000001) starting
[junit4:junit4] 2> 25490 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210003
type:create cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25498 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210003
type:create cxid:0x62 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25499 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210003
type:create cxid:0x63 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25501 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210003
type:create cxid:0x64 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25510 T2424 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4:junit4] 2> 25510 T2423 oasc.Overseer$CloudStateUpdater.run Starting
to work on the main queue
[junit4:junit4] 2> 25541 T2235 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=287123178
[junit4:junit4] 2> 25541 T2235 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@164ac4ab
[junit4:junit4] 2> 25553 T2235 oasc.SolrCore.closeSearcher [collection1]
Closing main searcher on request.
[junit4:junit4] 2> 25554 T2235 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=3,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2082,cumulative_deletesById=973,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25572 T2242 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386729b2210003
[junit4:junit4] 2> 25573 T2285 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25573 T2289 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25573 T2269 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25573 T2269 oascc.ZkStateReader$3.process WARNING
ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 25573 T2237 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:23464 which had sessionid
0x1386729b2210003
[junit4:junit4] 2> 25573 T2235 oaz.ZooKeeper.close Session: 0x1386729b2210003
closed
[junit4:junit4] 2> 25573 T2269 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 25574 T2235 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 25574 T2347 oasu.PeerSync.sync PeerSync: core=collection1
url=127.0.0.1:23458/solr START replicas=[] nUpdates=100
[junit4:junit4] 2> 25575 T2347 oasu.PeerSync.sync PeerSync: core=collection1
url=127.0.0.1:23458/solr DONE. sync succeeded
[junit4:junit4] 2> 25575 T2347 oasc.SyncStrategy.syncToMe try and ask
http://127.0.0.1:23463/solr/collection1/ to sync
[junit4:junit4] 2> 25576 T2363 C167 P23465 oasu.PeerSync.sync PeerSync:
core=collection1 url=127.0.0.1:23458/solr START
replicas=[127.0.0.1:23465/solr/collection1/] nUpdates=100
[junit4:junit4] 2> 25579 T2362 C167 P23465 REQ /get
{distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2
[junit4:junit4] 2> 25579 T2363 C167 P23465 oasu.PeerSync.handleVersions
PeerSync: core=collection1 url=127.0.0.1:23458/solr Received 100 versions from
127.0.0.1:23465/solr/collection1/
[junit4:junit4] 2> 25580 T2363 C167 P23465 oasu.PeerSync.handleVersions
PeerSync: core=collection1 url=127.0.0.1:23458/solr Our versions are newer.
ourLowThreshold=1406937969967759360 otherHigh=1406937970324275200
[junit4:junit4] 2> 25580 T2363 C167 P23465 oasu.PeerSync.sync PeerSync:
core=collection1 url=127.0.0.1:23458/solr DONE. sync succeeded
[junit4:junit4] 2> 25580 T2363 C167 P23465 REQ /get
{sync=127.0.0.1:23465/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2}
status=0 QTime=4
[junit4:junit4] 2> 25582 T2347 oasc.RecoveryStrategy.close WARNING Stopping
recovery for core collection1 zkNodeName=127.0.0.1:23465_solr_collection1
[junit4:junit4] 2> 25583 T2347 oascc.SolrZkClient.makePath makePath:
/collections/collection1/leaders/shard1
[junit4:junit4] 2> 25585 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210007
type:create cxid:0x4a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25587 T2347 oascc.SolrZkClient.makePath makePath:
/overseer_elect/leader
[junit4:junit4] 2> 25596 T2347 oasc.Overseer.<init> Overseer
(id=87933621513551879-127.0.0.1:23465_solr-n_0000000004) starting
[junit4:junit4] 2> 25597 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210007
type:create cxid:0x51 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25597 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210007
type:create cxid:0x52 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25604 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210007
type:create cxid:0x53 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25605 T2242 oazs.PrepRequestProcessor.pRequest Got
user-level KeeperException when processing sessionid:0x1386729b2210007
type:create cxid:0x54 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25613 T2347 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25613 T2428 oasc.OverseerCollectionProcessor.run Process
current queue of collection creations
[junit4:junit4] 2> 25613 T2427 oasc.Overseer$CloudStateUpdater.run Starting
to work on the main queue
[junit4:junit4] 2> 25613 T2427 oascc.ZkStateReader.updateCloudState Manual
update of cluster state initiated
[junit4:junit4] 2> 25614 T2427 oascc.ZkStateReader.updateCloudState Updating
cloud state from ZooKeeper...
[junit4:junit4] 2> 25626 T2235 oasc.CoreContainer.shutdown Shutting down
CoreContainer instance=538561722
[junit4:junit4] 2> 25626 T2235 oasc.RecoveryStrategy.close WARNING Stopping
recovery for core collection1 zkNodeName=127.0.0.1:23465_solr_collection1
[junit4:junit4] 2> 25626 T2235 oasc.SolrCore.close [collection1] CLOSING
SolrCore org.apache.solr.core.SolrCore@46b4c0af
[junit4:junit4] 2> 25628 T2235 oasc.SolrCore.closeSearcher [collection1]
Closing main searcher on request.
[junit4:junit4] 2> 25628 T2285 oascc.ZkStateReader$2.process A cluster state
change has occurred
[junit4:junit4] 2> 25628 T2347 oascc.ZkStateReader$2.process A cluster state
change has occurred
[junit4:junit4] 2> 25628 T2289 oascc.ZkStateReader$2.process A cluster state
change has occurred
[junit4:junit4] 2> 25628 T2235 oasu.DirectUpdateHandler2.close closing
DirectUpdateHandler2{commits=4,autocommits=0,soft
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=959,cumulative_deletesById=467,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25631 T2235 oasc.RecoveryStrategy.close WARNING Stopping
recovery for core collection1 zkNodeName=127.0.0.1:23465_solr_collection1
[junit4:junit4] 2> 25631 T2242 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386729b2210007
[junit4:junit4] 2> 25638 T2427 oasc.Overseer$CloudStateUpdater.run WARNING
Overseer cannot talk to ZK
[junit4:junit4] 2> 25751 T2285 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25751 T2289 oascc.ZkStateReader$3.process Updating live
nodes
[junit4:junit4] 2> 25751 T2237 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:23481 which had sessionid
0x1386729b2210007
[junit4:junit4] 2> 25751 T2235 oaz.ZooKeeper.close Session: 0x1386729b2210007
closed
[junit4:junit4] 2> 25766 T2235 oejsh.ContextHandler.doStop stopped
o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 25818 T2242 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386729b2210006
[junit4:junit4] 2> 25819 T2289 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 25819 T2237 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:23471 which had sessionid
0x1386729b2210006
[junit4:junit4] 2> 25819 T2235 oaz.ZooKeeper.close Session: 0x1386729b2210006
closed
[junit4:junit4] 2> 25820 T2242 oazs.PrepRequestProcessor.pRequest Processed
session termination for sessionid: 0x1386729b2210005
[junit4:junit4] 2> 25821 T2285 oaz.ClientCnxn$EventThread.run EventThread
shut down
[junit4:junit4] 2> 25821 T2237 oazs.NIOServerCnxn.closeSock Closed socket
connection for client /140.211.11.196:23468 which had sessionid
0x1386729b2210005
[junit4:junit4] 2> 25821 T2235 oaz.ZooKeeper.close Session: 0x1386729b2210005
closed
[junit4:junit4] 2> 25822 T2242 oazs.PrepRequestProcessor.run
PrepRequestProcessor exited loop!
[junit4:junit4] 2> 25842 T2256 oasc.Overseer$CloudStateUpdater.amILeader
WARNING org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4] 2> at
org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4] 2> at
org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2>
[junit4:junit4] 2> 25822 T2241 oazs.SyncRequestProcessor.run
SyncRequestProcessor exited!
[junit4:junit4] 2> 25844 T2256 oasc.Overseer$CloudStateUpdater.amILeader
According to ZK I (id=87933621513551874-127.0.0.1:23461_solr-n_0000000000) am
no longer a leader.
[junit4:junit4] 2> 25844 T2235 oazs.FinalRequestProcessor.shutdown shutdown
of request processor complete
[junit4:junit4] 2> 25913 T2237 oazs.NIOServerCnxn$Factory.run NIOServerCnxn
factory exited run method
[junit4:junit4] 2> 25961 T2240 oazs.SessionTrackerImpl.run SessionTrackerImpl
exited loop!
[junit4:junit4] 2> 25960 T2235 oazs.FinalRequestProcessor.shutdown shutdown
of request processor complete
[junit4:junit4] 2> 26012 T2423 oasc.Overseer$CloudStateUpdater.amILeader
WARNING org.apache.zookeeper.KeeperException$SessionExpiredException:
KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4] 2> at
org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4] 2> at
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4] 2> at
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4] 2> at
org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4] 2> at
org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2>
[junit4:junit4] 2> 26012 T2423 oasc.Overseer$CloudStateUpdater.amILeader
According to ZK I (id=87933621513551875-127.0.0.1:23463_solr-n_0000000001) am
no longer a leader.
[junit4:junit4] 2> 26020 T2235 oas.SolrTestCaseJ4.tearDown ###Ending
testDistribSearch
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest
-Dtests.method=testDistribSearch -Dtests.seed=23C40DAD0203120E
-Dtests.slow=true -Dtests.locale=bg -Dtests.timezone=Asia/Bishkek
-Dtests.file.encoding=UTF-8
[junit4:junit4] 2>
[junit4:junit4] > (@AfterClass output)
[junit4:junit4] 2> 26194 T2235 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40: {},
sim=DefaultSimilarity, locale=bg, timezone=Asia/Bishkek
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc.
1.6.0_32 (64-bit)/cpus=16,threads=9,free=91757448,total=284491776
[junit4:junit4] 2> NOTE: All tests run in this JVM:
[DefaultValueUpdateProcessorTest, TestJoin, RAMDirectoryFactoryTest,
DistributedQueryElevationComponentTest, FileBasedSpellCheckerTest,
DateFieldTest, DocumentAnalysisRequestHandlerTest,
TestHunspellStemFilterFactory, TestLatvianStemFilterFactory,
SolrPluginUtilsTest, TestQueryTypes, TestCJKBigramFilterFactory,
HighlighterTest, BasicDistributedZkTest, TestHindiFilters,
TestGalicianMinimalStemFilterFactory, EchoParamsTest, SolrCmdDistributorTest,
TestPerFieldSimilarity, JsonLoaderTest, TestIndonesianStemFilterFactory,
TestGreekLowerCaseFilterFactory, TestRecovery, TestSolrJ, TestRealTimeGet,
TestElisionFilterFactory, TestBadConfig, CloudStateUpdateTest,
TestFrenchLightStemFilterFactory, TermVectorComponentTest, DateMathParserTest,
TestMultiWordSynonyms, TestGalicianStemFilterFactory, TestExtendedDismaxParser,
TestStopFilterFactory, TestArabicFilters,
TestDictionaryCompoundWordTokenFilterFactory, MultiTermTest, TestFaceting,
MBeansHandlerTest, TestRangeQuery, TestConfig, TestTrimFilterFactory,
TestKeywordMarkerFilterFactory, SuggesterTSTTest, ResourceLoaderTest,
TestStressVersions, SpatialFilterTest, TestHungarianLightStemFilterFactory,
TestGroupingSearch, TestRemoveDuplicatesTokenFilterFactory, TestLRUCache,
TestValueSourceCache, TestGermanMinimalStemFilterFactory,
AlternateDirectoryTest, SolrCoreTest, OpenExchangeRatesOrgProviderTest,
PrimUtilsTest, TestWriterPerf, DocumentBuilderTest, ReturnFieldsTest,
XmlUpdateRequestHandlerTest, TestFiltering, CloudStateTest,
TestPortugueseMinimalStemFilterFactory, TestIndexSearcher,
DirectSolrSpellCheckerTest, TestUtils, IndexSchemaRuntimeFieldTest,
TestSystemIdResolver, DirectUpdateHandlerTest, TestCoreContainer,
OutputWriterTest, DisMaxRequestHandlerTest, TestDistributedSearch,
TestSolrXMLSerializer, TestPhoneticFilterFactory, SuggesterFSTTest,
SystemInfoHandlerTest, LeaderElectionTest, SpellCheckCollatorTest,
TestCJKWidthFilterFactory, TestBulgarianStemFilterFactory, TestPropInject,
LoggingHandlerTest, TestLMJelinekMercerSimilarityFactory,
TestSwedishLightStemFilterFactory, TestPHPSerializedResponseWriter,
SimpleFacetsTest, XsltUpdateRequestHandlerTest,
TestPatternReplaceFilterFactory, TestIndexingPerformance,
TestRussianLightStemFilterFactory, AnalysisAfterCoreReloadTest,
TestSolrQueryParser, TestMappingCharFilterFactory, TestArbitraryIndexDir,
RequiredFieldsTest, TestSuggestSpellingConverter, SoftAutoCommitTest,
ZkControllerTest, TestWordDelimiterFilterFactory, TestFastLRUCache,
TestCharFilters, BasicZkTest, TestJapanesePartOfSpeechStopFilterFactory,
TestFoldingMultitermQuery, TestMultiCoreConfBootstrap, FullSolrCloudTest,
PingRequestHandlerTest, TestJmxMonitoredMap, TestRandomFaceting,
DistributedTermsComponentTest, TestHTMLStripCharFilterFactory,
DirectSolrConnectionTest, DebugComponentTest, TestPatternTokenizerFactory,
StandardRequestHandlerTest, TestStressRecovery, MinimalSchemaTest, TestRTGBase,
TestGermanLightStemFilterFactory, TestEnglishMinimalStemFilterFactory,
UniqFieldsUpdateProcessorFactoryTest, TestMergePolicyConfig, TestQueryUtils,
TestGermanStemFilterFactory, StatsComponentTest, HighlighterConfigTest,
TestReplicationHandler, TestReversedWildcardFilterFactory,
LukeRequestHandlerTest, FastVectorHighlighterTest, TestFunctionQuery,
TestIrishLowerCaseFilterFactory, TestCapitalizationFilterFactory,
LengthFilterTest, SpellPossibilityIteratorTest, DOMUtilTest, OverseerTest,
RecoveryZkTest]
[junit4:junit4] 2>
[junit4:junit4] Completed in 26.24s, 1 test, 1 error <<< FAILURES!
[...truncated 491 lines...]
[...truncated 46790 lines...]
[...truncated 46790 lines...]
[...truncated 46790 lines...]
[...truncated 46790 lines...]
[...truncated 46771 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build.xml:144:
The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/lucene/module-build.xml:62:
The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/lucene/common-build.xml:1096:
The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/lucene/common-build.xml:793:
There were test failures: 290 suites, 1026 tests, 1 error, 5 ignored
Total time: 82 minutes 39 seconds
Build step 'Execute shell' marked build as failure
[TASKS] Scanning folder '/home/hudson/hudson-slave/workspace/Solr-trunk' for
files matching the pattern '**/*.java' - excludes:
[TASKS] Found 3790 files to scan for tasks
[TASKS] Found 1318 open tasks.
[TASKS] Computing warning deltas based on reference build #1905
Archiving artifacts
Publishing Clover coverage report...
No Clover report will be published due to a Build Failure
Recording test results
Publishing Javadoc
Email was triggered for: Failure
Sending email for trigger: Failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
