[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032352#comment-14032352 ] Hudson commented on MAPREDUCE-5898: --- SUCCESS: Integrated in Hadoop-Yarn-trunk #585 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/585/]) Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2 (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1602699) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0, 2.5.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032448#comment-14032448 ] Hudson commented on MAPREDUCE-5898: --- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1776 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1776/]) Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2 (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1602699) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0, 2.5.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032532#comment-14032532 ] Hudson commented on MAPREDUCE-5898: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1803 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1803/]) Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2 (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1602699) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0, 2.5.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031903#comment-14031903 ] Hudson commented on MAPREDUCE-5898: --- FAILURE: Integrated in Hadoop-trunk-Commit #5707 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5707/]) Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2 (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1602699) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0, 2.5.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029022#comment-14029022 ] Uma Maheswara Rao G commented on MAPREDUCE-5898: I have merged this to branch-2 as well. distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0, 2.5.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028088#comment-14028088 ] Chris Nauroth commented on MAPREDUCE-5898: -- I filed MAPREDUCE-5922 as a follow-up to update the distcp documentation to mention the new option for preserving xattrs. distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028149#comment-14028149 ] Uma Maheswara Rao G commented on MAPREDUCE-5898: Thanks Chris for filing it. I actually filed that jira already MAPREDUCE-5920. So, I will mark MAPREDUCE-5922 as dupe of this. Will take care of merging this along with disctcp issue after HDFS-2006 merge to branch-2. distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020774#comment-14020774 ] Hudson commented on MAPREDUCE-5898: --- FAILURE: Integrated in Hadoop-Yarn-trunk #576 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/576/]) MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu. (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1600900) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListingFileStatus.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpConstants.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptions.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpWithXAttrs.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020802#comment-14020802 ] Hudson commented on MAPREDUCE-5898: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1767 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1767/]) MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu. (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1600900) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListingFileStatus.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpConstants.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptions.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpWithXAttrs.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020827#comment-14020827 ] Hudson commented on MAPREDUCE-5898: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1794 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1794/]) MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu. (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1600900) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListingFileStatus.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpConstants.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptions.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpWithXAttrs.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019902#comment-14019902 ] Hudson commented on MAPREDUCE-5898: --- SUCCESS: Integrated in Hadoop-trunk-Commit #5654 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5654/]) MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu. (umamahesh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1600900) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/CopyListingFileStatus.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpConstants.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptions.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/SimpleCopyListing.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpWithXAttrs.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java * /hadoop/common/trunk/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyMapper.java distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Fix For: 3.0.0 Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016918#comment-14016918 ] Uma Maheswara Rao G commented on MAPREDUCE-5898: Thanks a lot Yi for the patch! +1 patch looks good to me. distcp to support preserving HDFS extended attributes(XAttrs) - Key: MAPREDUCE-5898 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898 Project: Hadoop Map/Reduce Issue Type: Bug Components: distcp Affects Versions: 3.0.0 Reporter: Uma Maheswara Rao G Assignee: Yi Liu Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch This JIRA to track the distcp support to handle the Xattrs with preserving options. Add new command line argument to support that. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[
https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011172#comment-14011172
]
Uma Maheswara Rao G commented on MAPREDUCE-5898:
Thanks a lot Yi for the patch.
I have few comments below.
DistCpUtils.java:
file system rooot. --- file system root.
{code}
try {
fs.getXAttrs(new Path(Path.SEPARATOR));
} catch (Exception e) {
throw new XAttrsNotSupportedException(XAttrs not supported for file
system:
+ fs.getUri());
}
{code}
seems like we are generically handling Exception and saying xattrs not
supported in fs. But the api call can fail due to many other reasons like
permission issues. Does it possible to bring down to handle specific
exception?ex: no such method etc.
{code}
new Option(p, true, preserve status (rbugpca)(replication, +
{code}
we need to change from rbugpca - rbugpcax?
distcp to support preserving HDFS extended attributes(XAttrs)
-
Key: MAPREDUCE-5898
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
Attachments: MAPREDUCE-5898.patch
This JIRA to track the distcp support to handle the Xattrs with preserving
options.
Add new command line argument to support that.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[
https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012003#comment-14012003
]
Yi Liu commented on MAPREDUCE-5898:
---
Thanks Uma for your detailed review.
{quote}
file system rooot. --- file system root.
{quote}
Right, I will update it.
{quote}
seems like we are generically handling Exception and saying xattrs not
supported in fs. But the api call can fail due to many other reasons like
permission issues. Does it possible to bring down to handle specific
exception?ex: no such method etc.
{quote}
Actually we getXAttrs on *root dir*, and the failure could be one of following
reasons:
1. File system is HDFS 2.4, so getXAttrs RPC endpoint doesn't exist
2. File system is HDFS = 2.4, but XAttrs are not enabled.
3. FileSystem subclass doesn't override the XAttr APIs, and throw
{{UnsupportedOperationException}}.
All the above failues indicates XAttrs not supported.
Furthermore, it's a bit difficult to handle specific exception, since they all
are IOException subtype, and different FileSystem implementation may throw
different IOException subtype.
{quote}
we need to change from rbugpca - rbugpcax?
{quote}
Right, I will update it.
distcp to support preserving HDFS extended attributes(XAttrs)
-
Key: MAPREDUCE-5898
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
Attachments: MAPREDUCE-5898.patch
This JIRA to track the distcp support to handle the Xattrs with preserving
options.
Add new command line argument to support that.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[
https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012021#comment-14012021
]
Hadoop QA commented on MAPREDUCE-5898:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12647284/MAPREDUCE-5898.1.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-tools/hadoop-distcp.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4633//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4633//console
This message is automatically generated.
distcp to support preserving HDFS extended attributes(XAttrs)
-
Key: MAPREDUCE-5898
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
Attachments: MAPREDUCE-5898.1.patch, MAPREDUCE-5898.patch
This JIRA to track the distcp support to handle the Xattrs with preserving
options.
Add new command line argument to support that.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[
https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009627#comment-14009627
]
Hadoop QA commented on MAPREDUCE-5898:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12646902/MAPREDUCE-5898.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-tools/hadoop-distcp.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4626//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4626//console
This message is automatically generated.
distcp to support preserving HDFS extended attributes(XAttrs)
-
Key: MAPREDUCE-5898
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
Attachments: MAPREDUCE-5898.patch
This JIRA to track the distcp support to handle the Xattrs with preserving
options.
Add new command line argument to support that.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5898) distcp to support preserving HDFS extended attributes(XAttrs)
[
https://issues.apache.org/jira/browse/MAPREDUCE-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008896#comment-14008896
]
Yi Liu commented on MAPREDUCE-5898:
---
As we know, xattrs can be stored in 4 namespaces: user, trusted, security and
system.
{{user}} and {{trusted}} namespaces xattr are available to user, but
{{security}} and {{system}} namespaces xattr are only for HDFS core.
Initial thought is distcp supports preserving {{user}} and {{trusted}}
namespaces xattr; for {{security}} and {{system}} namespaces, they should be
managed by target FS through pre-configuration.
For example, in HDFS transparent encryption, {{security}} namespace xattrs are
used. To copy encryption dir from src HDFS to target HDFS, user needs to create
the encryption zone in target HDFS firstly, then data written to the encryption
dir of target HDFS will be encrypted automatically.
Agree with [~andrew.wang] to use new option flag -px of distcp for preserve
XAttrs.
distcp to support preserving HDFS extended attributes(XAttrs)
-
Key: MAPREDUCE-5898
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5898
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
This JIRA to track the distcp support to handle the Xattrs with preserving
options.
Add new command line argument to support that.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
