symlinks in cwd of the task are not handled properly after MAPREDUCE-896
------------------------------------------------------------------------
Key: MAPREDUCE-1435
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1435
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: tasktracker
Affects Versions: 0.22.0
Reporter: Amareshwari Sriramadasu
Fix For: 0.22.0
With JVM reuse, TaskRunner.setupWorkDir() lists the contents of workDir and
does a fs.delete on each path listed. If the listed file is a symlink to
directory, it will delete the contents of those linked directories. This would
delete files from distributed cache and jars directory,if mapred.create.symlink
is true.
Changing ownership/permissions of symlinks through ENABLE_TASK_FOR_CLEANUP
would change ownership/permissions of underlying files.
This is observed by Karam while running streaming jobs with DistributedCache
and jvm reuse.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.