romseygeek opened a new pull request, #16867: URL: https://github.com/apache/lucene/pull/16867
The delete queue for IndexWriter is shared between all indexing threads, and holds a ByteBlockPool that tracks all terms being used for delete queries. While the individual indexing threads have their own maximum buffer size of 1945Mb to avoid overflowing any internal data structures, it is possible for this shared buffer to overflow if multiple threads are adding to it, and a particularly slow flush prevents it from being cleared. This adds a specific limit to the delete buffer (at the same size as the limits in DocumentsWriterPerThread), and also wires it into stall control so that other threads don't prevent the buffer being flushed once it hits the limit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
