Zakelly Lan created FLINK-37437:
-----------------------------------
Summary: ForSt checkpoint failure due to file not visible when
writing
Key: FLINK-37437
URL: https://issues.apache.org/jira/browse/FLINK-37437
Project: Flink
Issue Type: Bug
Components: Runtime / State Backends
Affects Versions: 2.0.0
Reporter: Zakelly Lan
We leverage `disableFileDeletions` and `enableFileDeletions` of ForSt to keep
files alive during checkpoint. When checkpoint finished, the
`enableFileDeletions` will be invoked, while ForSt will list all the files and
check status. These files, however, include the writing ones, which is not
visible in some DFS (e.g. oss or s3) yet. Although the checkpoints are actually
not missing, the thrown exception make the finalization of checkpoint failed,
resulting in consecutive cp failures.
The impact would be setups with object storages (e.g. oss or s3).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
