[ https://issues.apache.org/jira/browse/MAPREDUCE-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko resolved MAPREDUCE-4246. -------------------------------------------- Resolution: Fixed Target Version/s: 0.22.1 Hadoop Flags: Reviewed +1 I just committed this to branch 0.22.1. Thank you Benoy. > Failure in deleting user directories in Secure hadoop > ----------------------------------------------------- > > Key: MAPREDUCE-4246 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4246 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: security > Affects Versions: 0.22.0 > Reporter: Benoy Antony > Assignee: Benoy Antony > Fix For: 0.22.1 > > Attachments: cleanup-user-dir.patch > > > This happens when security is enabled on 22 > When TaskTracker starts p, it invokes MRAsyncDiskService moves the contents > of scratch/tasktracker to toBeDeleted under a directory created with the > current timestamp. > The owner of this directory is hadoop (owner of tasktracker) > The contents of this directory are various usernames and they are owned by > individual users. But MRAsyncDiskService tries to delete the newly created > directory as hadoop and it fails. > 2012-05-01 16:04:58,805 DEBUG org.apache.hadoop.mapred.LinuxTaskController: > deleteAsUser: > [/apache/hadoop-assemble-argon-0.228/hadoop-0.22-argon-0.105/bin/../bin/task-controller, > hadoop, 3, /hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0] > 2012-05-01 16:04:58,809 WARN > org.apache.hadoop.mapreduce.util.MRAsyncDiskService: Failure in deletion of > toBeDeleted/2012-04-17_16-22-03.965_0 on /hadoop00/scratch with original name > /hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0 with exception > org.apache.hadoop.util.Shell$ExitCodeException: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:256) > at org.apache.hadoop.util.Shell.run(Shell.java:183) > at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:376) > at > org.apache.hadoop.mapred.LinuxTaskController.deleteAsUser(LinuxTaskController.java:273) > at > org.apache.hadoop.mapreduce.util.MRAsyncDiskService$DeleteTask.run(MRAsyncDiskService.java:237) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira