[
https://issues.apache.org/jira/browse/NIFI-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026893#comment-17026893
]
ASF subversion and git services commented on NIFI-7073:
-------------------------------------------------------
Commit 76e8c51e11ce42fc99d48722507e101a05bec868 in nifi's branch
refs/heads/master from Matt Burgess
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=76e8c51 ]
NIFI-7073: This closes #4025. Route to failure when error on PutHDFS file
system close
Signed-off-by: Joe Witt <[email protected]>
> PutHDFS silently ignores exceptions when closing temporary file output stream
> -----------------------------------------------------------------------------
>
> Key: NIFI-7073
> URL: https://issues.apache.org/jira/browse/NIFI-7073
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Reporter: Michael Hogue
> Assignee: Matt Burgess
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> The PutHDFS processor can silently fail when closing an output stream when
> it's finished writing FlowFiles to a temporary space in HDFS.
> {{DFSOutputStream}} can throw an {{IOException}} when it's closed and that's
> ignored by the processor. This results in the FlowFile getting dropped (e.g.
> a loss of data) when it should be routed to the failure relationship.
> Source:
> [https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/src/main/java/org/apache/nifi/processors/hadoop/PutHDFS.java#L365]
> Instead, the exception should be caught & thrown and the FlowFile should be
> routed to the failure relationship. There's probably an argument to avoid
> ignoring _any_ exception.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
