DerGut opened a new pull request, #3708: URL: https://github.com/apache/iceberg-rust/pull/3708
Avoid opening manifests whose list counts prove there are no added or existing files. Cover normal and copy-on-write planning with a removed dead-only manifest. ## Which issue does this PR close? While working on https://github.com/apache/iceberg-rust/issues/1466 I noticed a mismatch between Java-reported scan metrics and Rust-reported ones. This PR aligns the Rust planner behavior with Java by saving some IO. ## What changes are included in this PR? A scan is now skipping delete manifest reads ([as Java does](https://github.com/apache/iceberg/blob/4e61757dcf568051a13bb8d4c00ef57c9f248947/core/src/main/java/org/apache/iceberg/ManifestGroup.java#L311-L319)) if they doesn't apply to any live files. ```java manifest.hasAddedFiles() || manifest.hasExistingFiles() ``` ## Are these changes tested? Yes, scan reports are matching. ## AI Disclosure AI found this and I used AI to generate the fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
