[
https://issues.apache.org/jira/browse/TEZ-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559521#comment-14559521
]
Siddharth Seth commented on TEZ-2483:
-------------------------------------
Agree with what Rajesh said. It would be better to add this to cleanup. Another
thing to consider is exceptions which are thrown while invoking close on a
failed Processor / Input / Output - those should be ignored so that each
Input/Output gets closed. The TEZ-2003 branch already has some of this code in
place.
> Tez should close task if processor fail
> ---------------------------------------
>
> Key: TEZ-2483
> URL: https://issues.apache.org/jira/browse/TEZ-2483
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Daniel Dai
> Fix For: 0.7.1
>
> Attachments: TEZ-2483-1.patch, TEZ-2483-2.patch
>
>
> The symptom is if PigProcessor fail, MRInput is not closed. On Windows, this
> creates a problem since Pig client cannot remove the input file.
> In general, if a task fail, Tez shall close all input/output handles in
> cleanup. MROutput is closed in MROutput.abort() which Pig invokes explicitly
> right now. Attach a demo patch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
