[
https://issues.apache.org/jira/browse/NIFI-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523803#comment-14523803
]
Ricky Saltzer commented on NIFI-551:
------------------------------------
Hey Joe -
Thanks for your reply, I think I understand the problem a bit more now.
Currently, the processor doesn't mark an entire flowfile as failed unless
there's a DatasetException, ProcessException, or DatasetIOException. In case of
a DatasetRecordException (failed to convert a single record), it just continues
onto the next record and increments the errors count. Maybe it would make more
sense to handle record exceptions like you mentioned, and fail the entire
flowfile, then attach all of the failed record exceptions (de-duped of course)
inside the flowfile's attribute.
[[email protected]], do you have an opinion on that?
Ricky
> Improve error handling for ConvertJSONToAvro processor
> ------------------------------------------------------
>
> Key: NIFI-551
> URL: https://issues.apache.org/jira/browse/NIFI-551
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Ricky Saltzer
> Labels: patch, review
> Fix For: 0.1.0
>
> Attachments: NIFI-551.1.patch, NIFI-551.2.patch
>
>
> Currently, if the ConvertJSONToAvro processor fails to process an individual
> record, a counter is incremented, but no alerts are produced. It would be
> better to notify the bulletin board that we've failed to process some records
> for a flowfile. Further, we should stream the records we fail to process down
> the failure relationship for further inspection.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
