JingsongLi commented on PR #7715: URL: https://github.com/apache/paimon/pull/7715#issuecomment-5104967325
In Flink's distributed orphan file cleanup, the `missing-manifest` sentinel generated by the `keyBy` operation is sent to only one join sub-task. Unless that sub-task has `abortDeletion` enabled, other parallel sub-tasks may still delete the file, making it impossible to prevent accidental deletions globally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
