[ 
https://issues.apache.org/jira/browse/HUDI-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sivabalan narayanan updated HUDI-3675:
--------------------------------------
    Status: In Progress  (was: Open)

> Add support to shutdown Deltastreamer gracefully on certain conditions w/ 
> continuous mode
> -----------------------------------------------------------------------------------------
>
>                 Key: HUDI-3675
>                 URL: https://issues.apache.org/jira/browse/HUDI-3675
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: deltastreamer
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.12.0
>
>
> Here is the use-case: 
> With continuous mode deltastreamer, the process have to be fully up consuming 
> resources even if there is no data on the source. So, users may want to 
> shutdown the process if there is no data to consume for some consecutive 
> amount of times.
>  
> and later can restart a new pipeline after sometime.  something like, restart 
> deltastreamer continuous mode after 1 hour of shutdown. 
>  
> But when started w/ continuous mode, do gracefull shudown if there is no new 
> data for 5 consecutive times. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to