Permissions race can make getStagingDir fail on local filesystem
----------------------------------------------------------------
Key: MAPREDUCE-2289
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2289
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: job submission
Affects Versions: 0.22.0
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Fix For: 0.22.0
I've observed the following race condition in TestFairSchedulerSystem which
uses a MiniMRCluster on top of RawLocalFileSystem:
- two threads call getStagingDir at the same time
- Thread A checks fs.exists(stagingArea) and sees false
-- Calls mkdirs(stagingArea, JOB_DIR_PERMISSIONS)
--- mkdirs calls the Java mkdir API which makes the file with umask-based
permissions
- Thread B runs, checks fs.exists(stagingArea) and sees true
-- checks permissions, sees the default permissions, and throws IOE
- Thread A resumes and sets correct permissions
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
