On 12/3/2012 9:46 PM, Yonik Seeley wrote:
On Mon, Dec 3, 2012 at 11:36 PM, Shawn Heisey <s...@elyograg.org> wrote:<updateHandler class="solr.DirectUpdateHandler2"> <autoCommit> <maxDocs>65536</maxDocs> <maxTime>300000</maxTime> </autoCommit> <updateLog /> </updateHandler>Yeah, seems like that just should generate hard commits. Are you using delete by querys at all? The current implementation can do an NRT reopen as part of it's implementation.
When I do deletes, it's done exclusively using deleteByQuery in SolrJ, with something like "did:(1000 OR 1001 OR 1002 OR 1003)" as the query. Before doing the delete, I do a search using the same query and only proceed to do the delete on that shard if numFound from the query is more than zero.
I don't know if this is necessary information, but no deletes are happening while I do my full-import. Nothing else happens to the index at all while DIH is doing its thing.
This is new experimentation with autocommit. By using autocommit, the commit at the end of an import is much faster. When autocommit is turned off, it is several minutes between the last document add and the handler returning to "idle" status. I like this new faster commit, but if I can't get an autocommit to only produce one segment, I may go back to the old way, to reduce the I/O impact from the more frequent merges.
Thanks, Shawn --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
