[
https://issues.apache.org/jira/browse/HUDI-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-3675:
-----------------------------
Sprint: Cont' improve - 2022/03/7, Hudi-Sprint-Apr-19, Hudi-Sprint-Apr-25,
Hudi-Sprint-May-02 (was: Cont' improve - 2022/03/7, Hudi-Sprint-Apr-19,
Hudi-Sprint-Apr-25)
> Add support to shutdown Deltastreamer gracefully on certain conditions w/
> continuous mode
> -----------------------------------------------------------------------------------------
>
> Key: HUDI-3675
> URL: https://issues.apache.org/jira/browse/HUDI-3675
> Project: Apache Hudi
> Issue Type: New Feature
> Components: deltastreamer
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.12.0
>
>
> Here is the use-case:
> With continuous mode deltastreamer, the process have to be fully up consuming
> resources even if there is no data on the source. So, users may want to
> shutdown the process if there is no data to consume for some consecutive
> amount of times.
>
> and later can restart a new pipeline after sometime. something like, restart
> deltastreamer continuous mode after 1 hour of shutdown.
>
> But when started w/ continuous mode, do gracefull shudown if there is no new
> data for 5 consecutive times.
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
