klion26 commented on issue #3790: URL: https://github.com/apache/amoro/issues/3790#issuecomment-3327183808
IIUC, Flink uses the snapshot info when restoring because it needs to re-commit the uncommitted file, otherwise some **files may be lost**. Maybe we can add some config like `expire.snapshot.blindly` for the table, when - `expire.snapshot.blindly` is true, Amore can safely expire the snapshot if it's too old, whether it's generated by Flink or not - `expire.snapshot.blindly` is false, we need to keep the snapshot generated by Flink even if it's too old - the default value needs to be false, as only the user know how to handle this case, set the default value to `true` may lead to **file lost** if there is a negative positive case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
