msokolov commented on issue #580: LUCENE-8700: IndexWriter.yield() URL: https://github.com/apache/lucene-solr/pull/580#issuecomment-466049738 In our specific case, we create a small index ~3G for some integration tests that can fit entirely in RAM, and we index all the documents, using large buffers with IndexWriter, using multiple indexing threads, and only when we are done do we commit. Adding this, together with some logic in the caller to supply the threads, reduced our time to commit from ~10 minutes to ~5 minutes on one host (we are sorting the index, so it takes a while), and the situation is even more embarassing on hosts with more cores (where we use more indexing threads).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
