[
https://issues.apache.org/jira/browse/APEXMALHAR-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15600713#comment-15600713
]
Matt Zhang commented on APEXMALHAR-2269:
----------------------------------------
The function failureHandling() will add the failed file to the failedFiles. So
if we hit this during replay() it will break idempotency as the failedFiles
will be different than the original run. It's better just throw
RuntimeException() and restart the replay() from beginning. Revert to original
code.
> AbstractFileInputOperator: During replay, IO errors not handled
> ---------------------------------------------------------------
>
> Key: APEXMALHAR-2269
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2269
> Project: Apache Apex Malhar
> Issue Type: Bug
> Reporter: Munagala V. Ramanath
> Assignee: Matt Zhang
>
> In AbstractFileInputOperator, during replay(), if any IOExceptions occur, they
> are not handled gracefully -- the code simply throws a RuntimeException.
> Code similar to the behavior of emitTuples() needs to be added where
> the falureHandling() method is called.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)