wangxianghu created HUDI-1269:
---------------------------------

             Summary: Make whether the failure of sync hudi data to hive 
affects hudi ingest process configurable
                 Key: HUDI-1269
                 URL: https://issues.apache.org/jira/browse/HUDI-1269
             Project: Apache Hudi
          Issue Type: New Feature
          Components: Hive Integration
            Reporter: wangxianghu
            Assignee: wangxianghu
             Fix For: 0.6.1


Currently, In an ETL pipeline(eg, kafka -> hudi -> hive), If the process of 
hudi to hive failed, the job is still running.
I think we can add a switch to control the job behavior(fail or keep running) 
when kafka to hudi is ok, while hudi to hive failed, leave the choice to user. 
since ingesting data to hudi and sync to hive is a complete task in some scenes.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to