[
https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091387#comment-14091387
]
Hitesh Shah commented on TEZ-1216:
----------------------------------
bq. can you please explain the change in isLastAMRetry
With YARN preemption, there is no "correct" way to detect whether the current
attempt is the last attempt. Based on discussions in MAPREDUCE-5956, the
approach seems to be that we do a best effort of cleaning up when we know this
is our last attempt ( this is only known to the AM when the AM itself decides
to unregister ). As for getting killed due to OOMs or being preempted by the
RM, there is no way to distinguish between the 2 signals today.
> Clean up the staging directory when the application completes
> -------------------------------------------------------------
>
> Key: TEZ-1216
> URL: https://issues.apache.org/jira/browse/TEZ-1216
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Mohammad Kamrul Islam
> Assignee: Hitesh Shah
> Priority: Critical
> Attachments: TEZ-1216.1.patch, TEZ-1216.2.patch
>
>
> This JIRA is a part of TEZ-693. It includes the removal of stage directory
> when application's last attempt is done. In addition, it will check a config
> to determine whether to auto clean it or not.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
