Hi Lucene devs! I have 2 PRs to optimize Lucene PostingsFormat (Lucene90BlockTreePostingsFormat and FSTPostingsFormat) by utilizing a new feature to stream the FST to IndexOutput directly, bypassing the on-heap writing: - https://github.com/apache/lucene/pull/12980 - https://github.com/apache/lucene/pull/12985
It would be great if someone can help reviewing. I also have some general questions: - How do I measure the memory improvement impact in Lucene? - Is Lucene90BlockTreePostingsFormat the main index format used in Lucene? If not, what is the main format? - Are there other places worth using the new streaming FST feature? Thank you! Anh Dung Bui