[
https://issues.apache.org/jira/browse/HUDI-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-5207:
-----------------------------
Description:
when commit contains error in WriteStatus in
org.apache.hudi.HoodieSparkSqlWriter#commitAndPerformPostOperations, some logic
flow can be added to handle error'ed records.
This can work jointly with error table HUDI-648. This can be generalized into
error handling configuration: save error table, save to custom dead letter
queue, fail and rollback, log and ignore.
was:when commit contains error in WriteStatus in
org.apache.hudi.HoodieSparkSqlWriter#commitAndPerformPostOperations, some logic
flow can be added to handle error'ed records.
> Add error handling logic flow for WriteStatus in spark sql writer
> -----------------------------------------------------------------
>
> Key: HUDI-5207
> URL: https://issues.apache.org/jira/browse/HUDI-5207
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Raymond Xu
> Priority: Major
>
> when commit contains error in WriteStatus in
> org.apache.hudi.HoodieSparkSqlWriter#commitAndPerformPostOperations, some
> logic flow can be added to handle error'ed records.
> This can work jointly with error table HUDI-648. This can be generalized into
> error handling configuration: save error table, save to custom dead letter
> queue, fail and rollback, log and ignore.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)