[
https://issues.apache.org/jira/browse/FLINK-25192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Wysakowicz updated FLINK-25192:
-------------------------------------
Description:
In the no-claim mode should not depend on any artefacts of the initial snapshot
after the restore. In order to do that we should pass a flag along with the RPC
and later on with a CheckpointBarrier to notify TaskManagers about that
intention. Moreover state backends should take the flag into consideration and
take "full snapshots".
The flag should be passed until the first checkpoint succeeds
* RocksDB state backend should upload all files instead of reusing artefacts
from the initial one
https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-No-claimmode(defaultmode)
was:
In the no-claim mode should not depend on any artefacts of the initial snapshot
after the restore. In order to do that we should pass a flag along with the RPC
and later on with a CheckpointBarrier to notify TaskManagers about that
intention. Moreover state backends should take the flag into consideration and
take "full snapshots"
* RocksDB state backend should upload all files instead of reusing artefacts
from the initial one
* Changelog state backend should materialize the changelog upon the flag
https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-No-claimmode(defaultmode)
> Implement proper no-claim mode support
> --------------------------------------
>
> Key: FLINK-25192
> URL: https://issues.apache.org/jira/browse/FLINK-25192
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Checkpointing, Runtime / State Backends
> Reporter: Dawid Wysakowicz
> Priority: Major
> Fix For: 1.15.0
>
>
> In the no-claim mode should not depend on any artefacts of the initial
> snapshot after the restore. In order to do that we should pass a flag along
> with the RPC and later on with a CheckpointBarrier to notify TaskManagers
> about that intention. Moreover state backends should take the flag into
> consideration and take "full snapshots".
> The flag should be passed until the first checkpoint succeeds
> * RocksDB state backend should upload all files instead of reusing artefacts
> from the initial one
> https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-No-claimmode(defaultmode)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
