[
https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Khachatryan updated FLINK-18753:
--------------------------------------
Description:
There is standard mechanism of writing two duplicating streams with state data:
to DFS and to local FS. On recovery, if local state is present and it matches
state on JM then it will be used (instead of downloading state from DFS).
Currently, local recovery is not supported if running with Unaligned
checkpoints enabled.
To enable it, we need to
# write this second stream (see
CheckpointStreamWithResultProvider.getCheckpointOutputStream)
# make sure localState is included into the snapshot reported to JM
> Support local recovery for Unaligned checkpoints
> ------------------------------------------------
>
> Key: FLINK-18753
> URL: https://issues.apache.org/jira/browse/FLINK-18753
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Checkpointing, Runtime / Task
> Affects Versions: 1.11.0
> Reporter: Roman Khachatryan
> Priority: Major
> Fix For: 1.12.0
>
>
> There is standard mechanism of writing two duplicating streams with state
> data: to DFS and to local FS. On recovery, if local state is present and it
> matches state on JM then it will be used (instead of downloading state from
> DFS).
> Currently, local recovery is not supported if running with Unaligned
> checkpoints enabled.
> To enable it, we need to
> # write this second stream (see
> CheckpointStreamWithResultProvider.getCheckpointOutputStream)
> # make sure localState is included into the snapshot reported to JM
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
