sivabalan narayanan created HUDI-3675:
-----------------------------------------
Summary: Add support to shutdown Deltastreamer gracefully on
certain conditions w/continuous mode
Key: HUDI-3675
URL: https://issues.apache.org/jira/browse/HUDI-3675
Project: Apache Hudi
Issue Type: Task
Components: deltastreamer
Reporter: sivabalan narayanan
Here is the use-case:
With continuous mode deltastreamer, the process have to be fully up consuming
resources even if there is no data on the source. So, users may want to
shutdown the process if there is no data to consume for some consecutive amount
of times.
and later can restart a new pipeline after sometime. something like, restart
deltastreamer continuous mode after 1 hour of shutdown.
But when started w/ continuous mode, do gracefull shudown if there is no new
data for 5 consecutive times.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
