Priyadarshini-Mitra commented on PR #16967: URL: https://github.com/apache/iceberg/pull/16967#issuecomment-4949538683
Thanks @szehon-ho for the insights. Your questions really helped me sharpen the design. I have pushed an update: renamed to ValidateTableIntegrity and rewrote the description to lead with the integrity check. Two supported shapes: Self-audit : Single table, no destination. Walks the metadata graph and verifies each referenced file exists at its stated location. Fits post-rollback verification, catalog audits, and detecting storage-side drift (files removed out-of-band while metadata still references them). Source-vs-destination : Walks source metadata, applies the configured prefix rewrite, and verifies each referenced file exists at the destination. Fits pre-registration copy verification, DR sync, migration audits, and any out-of-band copy audit (backups, Distcp output, manual file copies). Happy to iterate on this idea further. Thanks for taking the time to review and think through this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
