[
https://issues.apache.org/jira/browse/MAPREDUCE-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hemanth Yamijala updated MAPREDUCE-947:
---------------------------------------
Release Note: Introduced abortJob() method in OutputCommitter which will be
invoked when the job fails or is killed. By default it invokes
OutputCommitter.cleanupJob(). Deprecated OutputCommitter.cleanupJob() and
introduced OutputCommitter.commitJob() method which will be invoked for
successful jobs. Also a _SUCCESS file is created in the output folder for
successful jobs. A configuration parameter
mapreduce.fileoutputcommitter.marksuccessfuljobs can be set to false to disable
creation of _SUCCESS file, or to true to enable creation of the _SUCCESS file.
(was: Introduced abortJob() method in OutputCommitter which will be invoked
when the job fails or is killed. By default it invokes
OutputCommitter.cleanupJob(). Deprecated OutputCommitter.cleanupJob() and
introduced OutputCommitter.commitJob() method which will be invoked for
successful jobs. Also a _SUCCESS file is created in the output folder for
successful jobs.)
> OutputCommitter should have an abortJob method
> ----------------------------------------------
>
> Key: MAPREDUCE-947
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-947
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Owen O'Malley
> Assignee: Amar Kamat
> Fix For: 0.22.0
>
> Attachments: mapred-948-v1.12-branch-0.20-internal.patch,
> mapred-948-v1.12.patch, mapred-948-v1.13-branch-0.20-internal.patch,
> mapred-948-v1.2.patch, mapred-948-v1.3.patch, mapred-948-v1.4.patch,
> mapred-948-v1.7.patch, mapred-948-v2.1-branch-0.20.patch,
> mapred-948-v2.3-branch-0.20.patch, mapred-948-v2.3.patch,
> mapred-948-v3.1.patch, mapred-948-v3.2.patch, mapred-948-v3.4.patch,
> mr-947-trunk-new.patch, mr-947-trunk-new.patch, mr-947-trunk.patch,
> mr-947-trunk.patch, mr-947-trunk.patch, mr-947-y20-new.patch,
> mr-947-y20.patch, mr-947-y20.patch, yhadoop20-bug-fix-947.patch
>
>
> The OutputCommitter needs an abortJob method to clean up from failed jobs.
> Currently there is no way to distinguish between failed or succeeded jobs,
> making it impossible to write output promotion code.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
