[ https://issues.apache.org/jira/browse/LUCENE-982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12544722 ]
Michael Busch commented on LUCENE-982: -------------------------------------- {quote} I think people optimize because they want to pay a high cost, once, now, in order to have fast[er] searches. So by limiting segment count during optimizing, we still leave the increasing cost (as your index grows) on the optimize() call. {quote} Yeah good point. I understand the usecase for maxNumSegments. {quote} I think we should eventually do both? {quote} +1 > Create new method optimize(int maxNumSegments) in IndexWriter > ------------------------------------------------------------- > > Key: LUCENE-982 > URL: https://issues.apache.org/jira/browse/LUCENE-982 > Project: Lucene - Java > Issue Type: Improvement > Affects Versions: 2.3 > Reporter: Michael McCandless > Assignee: Michael McCandless > Priority: Minor > Fix For: 2.3 > > Attachments: LUCENE-982.patch > > > Spinning this out from the discussion in LUCENE-847. > I think having a way to "slightly optimize" your index would be useful > for many applications. > The current optimize() call is very expensive for large indices > because it always optimizes fully down to 1 segment. If we add a new > method which instead is allowed to stop optimizing once it has <= > maxNumSegments segments in the index, this would allow applications to > eg optimize down to say <= 10 segments after doing a bunch of updates. > This should be a nice compromise of gaining good speedups of searching > while not spending the full (and typically very high) cost of > optimizing down to a single segment. > Since LUCENE-847 is now formalizing an API for decoupling merge policy > from IndexWriter, if we want to add this new optimize method we need > to take it into account in LUCENE-847. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]