nsivabalan commented on issue #17106: URL: https://github.com/apache/hudi/issues/17106#issuecomment-4800777290
This appears to be implemented on master via [HUDI-9628] / PR #13563 (commit `4cb57c14ec05` — *"Add bloom filtering to prune keys prior to lookup in Metadata HFiles"*). The pruning lives in `HoodieNativeAvroHFileReader.RecordByKeyIterator` — before each `seekTo`, the iterator calls `bloomFilter.mightContain(rawKey)` and skips the lookup when the bloom filter says the key is absent. It's gated by `HoodieMetadataConfig.BLOOM_FILTER_ENABLE` (`hoodie.metadata.bloom.filter.enable`). Note: the JIRA linked here is HUDI-9627, while the fix is tagged HUDI-9628 — the descriptions match verbatim, so they look like duplicates. If this issue tracked the same work, it can likely be closed; if it was meant to track something distinct (e.g. enabling by default, or extending to the prefix-iterator path which still does range-only seeking), please clarify and we can keep it open. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
