[
https://issues.apache.org/jira/browse/FLINK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574091#comment-17574091
]
tanjialiang commented on FLINK-28728:
-------------------------------------
[~martijnvisser] Such as kafka, when kafka's data is not frequently, i would
like to consume it's data by scheduing rather than a long-term running job,
because a long-term running job will wasting the cluster resource. I think this
kind of job running in batch is ok, but i don't known if the job running in
batch, can it do savepoint when the job batch finished? So that i can restore
the job from savepoint in the next schedule.
> Support to set the end offset for streaming connector
> -----------------------------------------------------
>
> Key: FLINK-28728
> URL: https://issues.apache.org/jira/browse/FLINK-28728
> Project: Flink
> Issue Type: Improvement
> Reporter: tanjialiang
> Priority: Major
>
> Like MQ or CDC connector, it support set the startup mode for reading, but
> not support set the end offset/position. When the MQ's or CDC's data is not
> frequently, consume their data in period can cut lots of kubernetes/YARN
> resource, such as startup from earliest, and end to the current offset, save
> current offset in savepoint, and using the savepoint to startup in the next
> period time, in a loop.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
