[
https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063001#comment-17063001
]
Vinoth Chandar commented on HUDI-648:
-------------------------------------
[~liujinhui] Actually, skipping should be supported today with the following
deltastreamer config.. are you using deltastreamer or spark datasource
{code}
@Parameter(names = {"--commit-on-errors"}, description = "Commit even when some
records failed to be written")
public Boolean commitOnErrors = false;
{code}
> Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction
> writes
> ------------------------------------------------------------------------------------
>
> Key: HUDI-648
> URL: https://issues.apache.org/jira/browse/HUDI-648
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: DeltaStreamer, Spark Integration, Writer Core
> Reporter: Vinoth Chandar
> Priority: Major
> Fix For: 0.6.0
>
>
> We would like a way to hand the erroring records from writing or compaction
> back to the users, in a separate table or log. This needs to work generically
> across all the different writer paths.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
