[jira] [Commented] (MAPREDUCE-6007) Create a new option for distcp -p which causes raw.* namespace extended attributes to not be preserved

[Andrew Wang (JIRA)]

    [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089890#comment-14089890
 ] 

Andrew Wang commented on MAPREDUCE-6007:
----------------------------------------

Okay, so I need to stop rushing this :) If you fix my above test by removing 
the "raw" path components, you'll see that the target path isn't being 
qualified before being checked. Try adding this near the top of 
SimpleCopyListing#validatePaths:

{code}
    # Qualify the target path before checking
    targetPath = targetFS.makeQualified(targetPath);
    final boolean targetIsReservedRaw =
        Path.getPathWithoutSchemeAndAuthority(targetPath).toString().
            startsWith(HDFS_RESERVED_RAW_DIRECTORY_NAME);
{code}

> Create a new option for distcp -p which causes raw.* namespace extended 
> attributes to not be preserved
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6007
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6007
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: distcp
>    Affects Versions: fs-encryption
>            Reporter: Charles Lamb
>            Assignee: Charles Lamb
>         Attachments: MAPREDUCE-6007.001.patch, MAPREDUCE-6007.002.patch, 
> MAPREDUCE-6007.003.patch
>
>
> As part of the Data at Rest Encryption work (HDFS-6134), we need to create a 
> new option for distcp which causes raw.* namespace extended attributes to not 
> be preserved. See the doc in HDFS-6509 for details. The default for this 
> option will be to preserve raw.* xattrs.



--
This message was sent by Atlassian JIRA
(v6.2#6252)