aokolnychyi commented on pull request #1211: URL: https://github.com/apache/iceberg/pull/1211#issuecomment-659490881
Thanks, @RussellSpitzer! Let me take a look at this today. To give a bit of background, we had a case where people compacted their table that reduced the number of files from 5+ million to under 1 million in a short period of time. That processed generated a huge number of new snapshots as different parts were optimized separately (one leaf partition at a time). As a result, the expiry of snapshots was really slow. This is an attempt to fix those edge cases. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
