[
https://issues.apache.org/jira/browse/MAPREDUCE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod K V updated MAPREDUCE-856:
--------------------------------
Attachment: MAPREDUCE-856-20090820.txt
Attaching patch. It has to be applied over the latest one at MAPREDUCE-476.
This does the following:
- Changes dir structure to the following:
{code}
$mapred.local.dir
`-- taskTracker
`-- $user
|- distcache
|
`-- jobcache
{code}
- Adds a new initializeDistributedCache(InitializationContext context) to
secure distributed cache files via TaskRunner
- Adds a new INITIALIZE_DISTRIBUTEDCACHE command for LinuxTaskController
binary which takes a user name as argument and sets private permissions for the
corresponding distcache files in $mapred.local.dir/taskTracker/$user/distcache
- Adds a new INITIALIZE_USER command to set secure permissions for the
$mapred.local.dir/taskTracker/$user directories.
- Adds user as part of Task serialization as TT needs user name even before
job-conf is localized. The user-name is needed for creating user specific
directories $mapred.local.dir/taskTracker/$user.
- Moves some of the old and newly added localization code in TaskTracker.java
to org.apache.hadoop.mapreduce.server.tasktracker.Localizer as per
MAPREDUCE-759 and MAPREDUCE-303. Had to change the scope of few things to
public, but marked them only for internal use.
- Adds functionality to clean up stale user directories whenever possible.
- Adds a new test in TestTaskTrackerLocalization to verify cleanup of task
files when needed.
- Adds a new testcase
TestTrackerDistributedCacheManagerWithLinuxTaskController to verify permissions
set on distributed cache files by LinuxTaskController
> Localized files from DistributedCache should have right access-control
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-856
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-856
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: tasktracker
> Reporter: Arun C Murthy
> Assignee: Vinod K V
> Attachments: MAPREDUCE-856-20090820.txt
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
