[
https://issues.apache.org/jira/browse/MAPREDUCE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hemanth Yamijala updated MAPREDUCE-896:
---------------------------------------
Attachment: MR-896.v6.patch
In MAPREDUCE-181, the job submission mechanism was changed to transfer job info
via a staging directory and the jobtracker completely owns creation of the job
directory under the mapreduce system directory. As a result, the code in
Jobtracker to do with cleaning up the mapred system directory using the cleanup
queue when job submission fails, is no longer needed. Note that the staging
directory is cleaned up on client in a finally block, so the functionality is
still available, though not in Jobtracker.
The new patch removes changes in Jobtracker.java and adjusts a merge conflict
in JobInProgress.java. Other things are the same.
> Users can set non-writable permissions on temporary files for TT and can
> abuse disk usage.
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-896
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-896
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0
> Reporter: Vinod K V
> Assignee: Ravi Gummadi
> Fix For: 0.21.0
>
> Attachments: MR-896.patch, MR-896.v1.patch, MR-896.v2.patch,
> MR-896.v3.patch, MR-896.v4.patch, MR-896.v5.patch, MR-896.v6.patch,
> y896.v1.patch, y896.v2.1.fix.patch, y896.v2.1.fix.v1.patch,
> y896.v2.1.fix.v2.patch, y896.v2.1.patch, y896.v2.patch
>
>
> As of now, irrespective of the TaskController in use, TT itself does a full
> delete on local files created by itself or job tasks. This step, depending
> upon TT's umask and the permissions set by files by the user, for e.g in
> job-work/task-work or child.tmp directories, may or may not go through
> successful completion fully. Thus is left an opportunity for abusing disk
> space usage either accidentally or intentionally by TT/users.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
