QuakeWang opened a new pull request, #783: URL: https://github.com/apache/paimon-rust/pull/783
### Purpose Closes #780 FileIndex outer-format support, Bitmap/Bloom readers, and predicate composition already existed, but production raw scans did not consume embedded indexes or `.index` sidecars. Therefore, Rust table reads could not use FileIndexes written by Java Paimon. ### Brief change log - Add `file-index.read.enabled`, defaulting to `true`, and enable it for ordinary, incremental, and audit raw reads. - Read embedded or aligned sidecar FileIndexes with Java-compatible precedence. - Evaluate indexes against conservatively remapped file-schema predicates while ignoring unsupported index identifiers. - Apply `Skip` and `Selection` before opening data files, intersecting selections with split row ranges and deletion vectors. - Preserve residual predicates and conservatively fall back for unsafe schema evolution or overly fragmented selections. - Add coverage for embedded and sidecar indexes, schema evolution, Bitmap/Bloom pruning, deletion vectors, row ranges, unsupported indexes, and enabled/disabled result equivalence. ### Tests - `cargo fmt --all -- --check` - `cargo clippy --locked --all-targets --workspace --features fulltext,vortex -- -D warnings` - `cargo test --locked -p paimon --all-targets --features fulltext,vortex` - `cargo test --locked -p paimon-rest-server --all-targets` ### API and Format No public API or storage-format changes. This reads existing Java-compatible FileIndex containers and Bitmap/Bloom payloads. ### Documentation No documentation changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
