aokolnychyi commented on pull request #1471: URL: https://github.com/apache/iceberg/pull/1471#issuecomment-694600590
I've been thinking about this for a while but could not come up with a good alternative. The only other option is to ignore or fail if we could not resolve files against the root location we list. That means some files can be orphan forever. It seems that checking paths should be ok as it will contain both the table location + partition path + file name (that most likely will include some UUID). In the worst case, we will not remove some orphan files and that should be extremely unlikely. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
