Re: Lucene gobbling file descriptors

2009-09-01 Thread Erick Erickson
rs after a period of > inactivity? > > Thanks for any wisdom / thoughts/ ideas. > > - Chris > > > > - Original Message - > From: Erick Erickson > Sent: Thu, 27/8/2009 4:49pm > To: java-user@lucene.apache.org > Subject: Re: Lucene gobbling file descri

RE: Lucene gobbling file descriptors

2009-09-01 Thread Chris Bamford
:-) Kind regards - Chris - Original Message - From: Michael McCandless Sent: Tue, 1/9/2009 1:23pm To: java-user@lucene.apache.org Subject: Re: Lucene gobbling file descriptors setUseCompoundFile is an IndexWriter method. It already defaults to "true", so you probably are alr

Re: Lucene gobbling file descriptors

2009-09-01 Thread Michael McCandless
evelopment Engineer > Scalix > chris.bamf...@scalix.com > Tel: +44 (0)1344 381814 > www.scalix.com > > > > - Original Message - > From: Michael McCandless > Sent: Tue, 1/9/2009 12:03pm > To: java-user@lucene.apache.org > Subject: Re: Lucene gobbling file descriptors

RE: Lucene gobbling file descriptors

2009-09-01 Thread Chris Bamford
dless Sent: Tue, 1/9/2009 12:03pm To: java-user@lucene.apache.org Subject: Re: Lucene gobbling file descriptors In this approach it's expected you'll run out of file descriptors, when "enough" users attempt to search at the same time. You can reduce the number of file descriptors

Re: Lucene gobbling file descriptors

2009-09-01 Thread Michael McCandless
Would > performance suffer that much if we did an open/close for each search?  Or > would it perhaps be better to close open readers after a period of inactivity? > > Thanks for any wisdom / thoughts/ ideas. > > - Chris > > > > - Original Message - > From: Eric

RE: Lucene gobbling file descriptors

2009-09-01 Thread Chris Bamford
activity? Thanks for any wisdom / thoughts/ ideas. - Chris - Original Message - From: Erick Erickson Sent: Thu, 27/8/2009 4:49pm To: java-user@lucene.apache.org Subject: Re: Lucene gobbling file descriptors Note that for search speed reasons, you really, really want to share your rea

Re: Lucene gobbling file descriptors

2009-08-27 Thread Andrzej Bialecki
Erick Erickson wrote: Note that for search speed reasons, you really, really want to share your readers and NOT open/close for every request. FWIW Erick On Thu, Aug 27, 2009 at 9:10 AM, Chris Bamford wrote: I'm glad its not normal. That means we can fix it! I will conduct a review of IndexRe

Re: Lucene gobbling file descriptors

2009-08-27 Thread Erick Erickson
archer open/close ops. > > Thanks! > > Chris > > - Original Message - > From: Michael McCandless > Sent: Wed, 26/8/2009 2:26pm > To: java-user@lucene.apache.org > Subject: Re: Lucene gobbling file descriptors > > This is not normal. As long as you are cert

RE: Lucene gobbling file descriptors

2009-08-27 Thread Chris Bamford
I'm glad its not normal. That means we can fix it! I will conduct a review of IndexReader/Searcher open/close ops. Thanks! Chris - Original Message - From: Michael McCandless Sent: Wed, 26/8/2009 2:26pm To: java-user@lucene.apache.org Subject: Re: Lucene gobbling file descri

Re: Lucene gobbling file descriptors

2009-08-26 Thread Michael McCandless
This is not normal. As long as you are certain you close every IndexReader/Searcher that you opened, the number of file descriptors should stay "contained". Though: how many files are there in your index directory? Mike On Wed, Aug 26, 2009 at 9:18 AM, Chris Bamford wrote: > Hi there, > > I won

Re: Lucene gobbling file descriptors

2009-08-26 Thread Shai Erera
That's strange ... how do you execute your searches - each search opens up an IndexReader? Do you make sure to close them? Maybe those are file descriptors of files you index? Forgive the silly questions, but I've never seen Lucene run into out-of-files handles ... Shai On Wed, Aug 26, 2009 at 4

Lucene gobbling file descriptors

2009-08-26 Thread Chris Bamford
Hi there, I wonder if someone can help? We have a successful Lucene app deployed on Tomcat which works well. As far as we can tell, our developers have observed all the guidelines in the Lucene FAQ, but on some of our installations, Tomcat eventually runs out of file descriptors and needs a r