[
https://issues.apache.org/jira/browse/FALCON-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973721#comment-14973721
]
Pallavi Rao commented on FALCON-1555:
-------------------------------------
The below excerpt of stack in the log shows that FS was closed when a job
commit was attempted:
{code}
2015-10-23 06:02:04,115 ERROR [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: could not
create failure file.
java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:795)
{code}
fs.close() in HiveDRTool had nothing to do with this particular bug. As
mentioned by me and [~sriksun] in other comments using fs.close() is not
recommended. Hence, we removed it from all the places where it was used.
> succeeded-post-processing action fails in Oozie uber mode
> ---------------------------------------------------------
>
> Key: FALCON-1555
> URL: https://issues.apache.org/jira/browse/FALCON-1555
> Project: Falcon
> Issue Type: Bug
> Affects Versions: 0.8
> Environment: QA
> Reporter: Pragya Mittal
> Assignee: Pragya Mittal
> Fix For: 0.8
>
> Attachments: FALCON-1555-v1.patch, FALCON-1555.patch,
> post-processing.log
>
>
> Falcon succeeded-post-processing action fails with uber mode enable in oozie.
> This is happening because filesystem is closed in post processing action in
> WorkflowExecutionContext.
> Attaching yarn logs for the same.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
