[
https://issues.apache.org/jira/browse/FLINK-26372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17559149#comment-17559149
]
Feifan Wang commented on FLINK-26372:
-------------------------------------
Hi [~roman], since I'm inexperienced with the job, I'd like to briefly describe
my thinking to you before I start coding, and hope for your guidance. The
following is my immature thinking :
1. add a class 'StateChangelogConfig' contains
setPeriodicMaterializationInterval(Duration),
setMaterializationMaxFailuresAllowed(Integer),
setStateChangelogStorage(StateChangelogStorage)
2. make StateChangelogStorage extends java.io.Serializable.
3. add field 'stateChangelogConfig' and method getStateChangelogConfig() to
StreamExecutionEnvironment
4. save StateChangelogConfig to taskConfigration
5. StateChangelogStorageLoader.load(Configuration,TaskManagerJobMetricGroup)
add parameter '@Nullable StateChangelogStorage fromApplication'
6. extract stateChangelogStorageFromApplication from taskConfiguration and pass
it to StateChangelogStorageLoader.load()
> Allow to configure Changelog Storage per program
> ------------------------------------------------
>
> Key: FLINK-26372
> URL: https://issues.apache.org/jira/browse/FLINK-26372
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Configuration, Runtime / State Backends
> Affects Versions: 1.15.0
> Reporter: Roman Khachatryan
> Assignee: Feifan Wang
> Priority: Major
> Fix For: 1.16.0
>
>
> It's currently possible to override state.backend.changelog.enabled per job,
> but it's not possible to override Changelog storage settings (i.e. writer
> settings).
> There should be 1) an API and 2) runtime support for that.
> See this
> [discussion|https://github.com/apache/flink/pull/16341#discussion_r663749681]
> and the corresponding
> [TODO|https://github.com/apache/flink/pull/16341/files#diff-2c21555dcab689ec27c0ab981852a2bfa787695fb2fe04b24c22b89c63d98b73R680].
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
