badalprasadsingh opened a new issue, #2160: URL: https://github.com/apache/iceberg-go/issues/2160
### Apache Iceberg version main (development) ### Please describe the bug 🐞 COW Delete and filtered Overwrite read every live delete file in the table before rewriting or removing data files. Function: `readPlanningDeletes`, added in #2046. Even a small delete on a table with many delete files pays for all of them. The row filter can't skip them, since rewritten files keep non-matching rows that older deletes still cover. Instead: - skip delete manifests whose partitions don't overlap the affected files - skip delete files older than every affected data file Expected: delete-file reads grow with the files touched, not with the table. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
