Avoid optimize like the plague. Instead focus on tuning the segment merging process. As you commit index files, segments are created. But they're periodically merged. Merging removes remnants of the tombstoned docs. You can optimize this, tune it, etc. If you're dealing with a lot of updates, this is something you definitely want to tune. See this document, scroll down to the merge parameters. https://cwiki.apache.org/confluence/display/solr/IndexConfig+in+SolrConfig
There are other options for dealing with high update speed. You could shard SolrCloud further and minimize replication. You could put things in Kafka and work through them as you can, catching if you have any slow time. You can tune your hard and soft commits to create segments of an appropriate size, etc. -Doug On Tue, Sep 22, 2015 at 9:01 PM, CrazyDiamond <crazy_diam...@mail.ru> wrote: > my index is updating frequently and i need to remove unused documents from > index after update/reindex. > Optimizaion is very expensive so what should i do? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/is-there-a-way-to-remove-deleted-documents-from-index-without-optimize-tp4230691.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- *Doug Turnbull **| *Search Relevance Consultant | OpenSource Connections <http://opensourceconnections.com>, LLC | 240.476.9983 Author: Relevant Search <http://manning.com/turnbull> This e-mail and all contents, including attachments, is considered to be Company Confidential unless explicitly stated otherwise, regardless of whether attachments are marked as such.
