[
https://issues.apache.org/jira/browse/HUDI-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan reassigned HUDI-3675:
-----------------------------------------
Assignee: sivabalan narayanan
> Add support to shutdown Deltastreamer gracefully on certain conditions
> w/continuous mode
> ----------------------------------------------------------------------------------------
>
> Key: HUDI-3675
> URL: https://issues.apache.org/jira/browse/HUDI-3675
> Project: Apache Hudi
> Issue Type: Task
> Components: deltastreamer
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
>
> Here is the use-case:
> With continuous mode deltastreamer, the process have to be fully up consuming
> resources even if there is no data on the source. So, users may want to
> shutdown the process if there is no data to consume for some consecutive
> amount of times.
>
> and later can restart a new pipeline after sometime. something like, restart
> deltastreamer continuous mode after 1 hour of shutdown.
>
> But when started w/ continuous mode, do gracefull shudown if there is no new
> data for 5 consecutive times.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
