[
https://issues.apache.org/jira/browse/FLINK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tanjialiang updated FLINK-28728:
--------------------------------
Description: Like MQ or CDC connector, it support set the startup mode for
reading, but not support set the end offset/position. When the MQ's or CDC's
data is not frequently, consume their data in period can cut lots of
kubernetes/YARN resource, such as startup from earliest, and end to the current
offset, save current offset in savepoint, and using the savepoint to startup in
the next period time, in a loop. (was: Like MQ or CDC connector, it support
set the startup mode for reading, but not support set the end offset/position.
When the MQ's or CDC's data is not frequently, consume their data in period
can cut lots of kubernetes/YARN resource, such as startup from earliest, and
end to the current offset, save current offset in savepoint, and using the
savepoint to startup in the next period time, in a loop.)
> Support to set the end offset for streaming connector
> -----------------------------------------------------
>
> Key: FLINK-28728
> URL: https://issues.apache.org/jira/browse/FLINK-28728
> Project: Flink
> Issue Type: Improvement
> Reporter: tanjialiang
> Priority: Major
>
> Like MQ or CDC connector, it support set the startup mode for reading, but
> not support set the end offset/position. When the MQ's or CDC's data is not
> frequently, consume their data in period can cut lots of kubernetes/YARN
> resource, such as startup from earliest, and end to the current offset, save
> current offset in savepoint, and using the savepoint to startup in the next
> period time, in a loop.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
