Santhosh G Nayak created MAPREDUCE-6792:

             Summary: Allow user's full principal name as owner of MapReduce 
staging directory in JobSubmissionFiles#JobStagingDir()
                 Key: MAPREDUCE-6792
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: client
            Reporter: Santhosh G Nayak

Background - 
Currently, {{JobSubmissionFiles#JobStagingDir()}} assumes that file owner 
returned as part of {{FileSystem#getFileStatus()}} is always user's short 
principal name, which is true for HDFS. But, some file systems which are HDFS 
compatible like [Azure Data Lake Store (ADLS) 
|] and work in multi 
tenant environment can have users with same names belonging to different 
domains. For example, {{}} and {{}}. It 
will be ambiguous, if {{FileSystem#getFileStatus()}} returns only the user's 
short principal name (without domain name) as the owner of the file/directory. 

The following code block allows only short user principal name as owner. It 
simply fails saying that ownership on the staging directory is not as expected, 
if owner returned by the {{FileStatus#getOwner()}} is not equal to short 
principal name of the current user.
    String realUser;
    String currentUser;
    UserGroupInformation ugi = UserGroupInformation.getLoginUser();
    realUser = ugi.getShortUserName();
    currentUser = UserGroupInformation.getCurrentUser().getShortUserName();
    if (fs.exists(stagingArea)) {
      FileStatus fsStatus = fs.getFileStatus(stagingArea);
      String owner = fsStatus.getOwner();
      if (!(owner.equals(currentUser) || owner.equals(realUser))) {
         throw new IOException("The ownership on the staging directory " +
                      stagingArea + " is not as expected. " +
                      "It is owned by " + owner + ". The directory must " +
                      "be owned by the submitter " + currentUser + " or " +
                      "by " + realUser);
The proposal is to remove the strict restriction on short principal name by 
allowing the user's full principal name as owner of staging area directory in 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to