[
https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324600#comment-17324600
]
Raymond Xu commented on HUDI-648:
---------------------------------
[~vinoth] The PR is [https://github.com/apache/hudi/pull/2710]
somehow not linked by itself.
We previously discussed over the RFC about putting error table alongside the
main table or having a global error table. I'm also ok with putting it
alongside metadata table, having everything in one place.
[~liujinhui] would you kindly update the RFC to reflect the latest design
please? given you've implemented in a slightly different way.
> Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction
> writes
> ------------------------------------------------------------------------------------
>
> Key: HUDI-648
> URL: https://issues.apache.org/jira/browse/HUDI-648
> Project: Apache Hudi
> Issue Type: New Feature
> Components: DeltaStreamer, Spark Integration, Writer Core
> Reporter: Vinoth Chandar
> Assignee: liujinhui
> Priority: Major
> Labels: sev:normal, user-support-issues
> Attachments: image-2021-03-03-11-40-21-083.png
>
>
> We would like a way to hand the erroring records from writing or compaction
> back to the users, in a separate table or log. This needs to work generically
> across all the different writer paths.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
