[
https://issues.apache.org/jira/browse/BEAM-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maximilian Michels resolved BEAM-5396.
--------------------------------------
Resolution: Fixed
Fix Version/s: 2.11.0
Resolving. The initial scope of this issue is fulfilled, i.e. savepoints of
portable pipelines can be taken and pipelines can be restored from it, even
when new operators have been added.
There are more challenges to tackle which were mentioned here:
1) Upgrades between Flink versions
2) Conversion of state with pipeline evolution
I suggest that we tackle those in separate issues.
> Flink portable runner savepoint / upgrade support
> -------------------------------------------------
>
> Key: BEAM-5396
> URL: https://issues.apache.org/jira/browse/BEAM-5396
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Reporter: Thomas Weise
> Assignee: Maximilian Michels
> Priority: Major
> Labels: portability, portability-flink
> Fix For: 2.11.0
>
> Time Spent: 11h 40m
> Remaining Estimate: 0h
>
> The portable Flink runner needs to support Flink savepoints for production
> use. It should be possible to upgrade a stateful portable Beam pipeline that
> runs on Flink, which involves taking a savepoint and then starting the new
> version of the pipeline from that savepoint. The potential issues with
> pipeline evolution and migration are similar to those when using the Flink
> DataStream API (schema / name changes etc.).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
