xanderbailey opened a new pull request, #2398: URL: https://github.com/apache/iceberg-rust/pull/2398
## Which issue does this PR close? - Closes #. ## What changes are included in this PR? Adds bloom filter pushdown for equality predicates during Parquet reads. When enabled, the reader loads bloom filters from row group column chunks and uses them to skip row groups that definitely don't contain the queried values. Key points: - New `bloom_filter_enabled` option on `TableScanBuilder` and `ArrowReaderBuilder` (off by default since it requires extra I/O per column per row group) - Only loads bloom filters for columns referenced in `eq` or `in` predicates — range predicates and other operators are ignored ## Are these changes tested? - Unit tests covering the bloom filter evaluator: eq/in present/absent, AND/OR/NOT logic, all decimal physical types (INT32, INT64, FIXED_LEN_BYTE_ARRAY), negative values, missing bloom filters etc - Integration tests writing multi-row-group Parquet files with bloom filters enabled and verifying end-to-end row group pruning -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
