Rajesh Mahindra created HUDI-9628:
-------------------------------------
Summary: Add bloom filter pruning when looking up keys in metadata
files
Key: HUDI-9628
URL: https://issues.apache.org/jira/browse/HUDI-9628
Project: Apache Hudi
Issue Type: Improvement
Reporter: Rajesh Mahindra
When looking up keys in metadata(hfile) files, we are not leveraging the bloom
filters to prune out keys and avoid download and deser of the relevant Hfile
blocks. This task tracks implementing optional bloom filtering of keys prior to
hfile lookup. For instance, in RLI with insert heavy workloads, we can achieve
significant speedup by pruning most of the keys prior to hfile lookup.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
