I have investigated some of the changes in Lucene and here is what I found:
- optimize has been deprecated but there is a new method called forceMerge which basically does the same. - MergePolicy is a new(ish) API that performs automatic merges under specified circumstances. Back to CRIS, I don't think the actual issue is gone. It looks like Lucene has been optimized a lot so it is possible that the open file descriptors problem is somehow mitigated compared to older releases. But principally it still exists. I am pretty much out of the loop when it comes to Lucene so I did not initially find a way to reproduce the circumstances that lead to an explosion of open file descriptors that plagued us before. But more investigation is necessary. For now I suggest: - keep the optimize logic but use forceMerge method instead Subsequently I will look into CRIS and check if optimize can be replaced by a merge policy or some other method. 2013/4/19 Reto Bachmann-Gmür <[email protected]> > Ok good. I'm currently using the system with some data. If no problem occur > with the new version I'll remove those methods from the interfaces too. > > Cheers, > Reto > > > On Fri, Apr 19, 2013 at 2:39 PM, Daniel Spicar <[email protected]> wrote: > > > Hi reto, > > > > No I did not check anything recently. I can review the changes if you > like. > > If optimize is not needed anymore that is good news. AFAIK it has been > > mostly needed to keep the number of open file descriptors limited. > > > > Daniel > > > > > > 2013/4/19 Reto Bachmann-Gmür <[email protected]> > > > > > Hi Daniel > > > > > > I'm wondering if you had a look at the recent changes to CRIS to work > > with > > > a more recent lucene version. > > > > > > With this update the optimize methods have become obsolete. > > > > > > Cheers, > > > Reto > > > > > >
