zhuxiangyi commented on PR #9667: URL: https://github.com/apache/paimon/pull/9667#issuecomment-5713287273
Confirmed and reproduced for both a completed and a failed cleanup with later snapshot data in between. Fixed in 3556a3736: on retry the callback removes only the files the snapshot branch held in those partitions when the overwrite was published, intersected with what it holds now — later data is kept, and the retry is idempotent. Two tests cover both cases; core, chain table and Spark streaming suites pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
