[
https://issues.apache.org/jira/browse/FLINK-20789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18134009#comment-18134009
]
Hao Yu commented on FLINK-20789:
--------------------------------
I think it is necessary to set up a metric for "ignore-parse-errors" because
users will feel that Flink keeps dropping data even when ignore-parse-errors is
enabled, while in fact the data itself is problematic.
> Add a metric named `deserializeFailedCount` for formats which has option
> `ignore-parse-errors`
> ----------------------------------------------------------------------------------------------
>
> Key: FLINK-20789
> URL: https://issues.apache.org/jira/browse/FLINK-20789
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile),
> Runtime / Metrics
> Affects Versions: 1.12.0
> Reporter: xiaozilong
> Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Counts the number of deserialize failed when the option `ignore-parse-errors`
> is enabled.
>
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
