ayushtkn opened a new pull request, #4934: URL: https://github.com/apache/polaris/pull/4934
During `commitTransaction`, Iceberg metadata files are written before Polaris persists the corresponding entity updates. If the final metadata store update (updateEntitiesPropertiesIfNotChanged) fails (for example, due to a CAS/conflict failure), the transaction is aborted, but the newly written metadata files remain in storage. Since these metadata files are never referenced by any committed entity, they become orphaned and accumulate over time, resulting in unnecessary storage usage. ## Checklist - [ ] ๐ก๏ธ Don't disclose security issues! (contact [email protected]) - [ ] ๐ Clearly explained why the changes are needed, or linked related issues: Fixes # - [ ] ๐งช Added/updated tests with good coverage, or manually tested (and explained how) - [ ] ๐ก Added comments for complex logic - [ ] ๐งพ Updated `CHANGELOG.md` (if needed) - [ ] ๐ Updated documentation in `site/content/in-dev/unreleased` (if needed) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
