[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-12 Thread Chris Nauroth (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Nauroth updated HADOOP-10561:
---

Target Version/s: 3.0.0, 2.5.0
Hadoop Flags: Reviewed

+1 for the patch.  I'll commit this.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.4.patch, HADOOP-10561.5.patch, 
 HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 exception about XAttrs not supported will be thrown.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-12 Thread Chris Nauroth (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Nauroth updated HADOOP-10561:
---

   Resolution: Fixed
Fix Version/s: 2.5.0
   3.0.0
   Status: Resolved  (was: Patch Available)

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Fix For: 3.0.0, 2.5.0

 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.4.patch, HADOOP-10561.5.patch, 
 HADOOP-10561.branch-2.patch, HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 exception about XAttrs not supported will be thrown.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-12 Thread Chris Nauroth (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Nauroth updated HADOOP-10561:
---

Attachment: HADOOP-10561.branch-2.patch

I committed this to trunk and branch-2.  Yi, thank you for contributing the 
patch.  Uma, thank you for the code review.

There was a merge conflict when I took this to branch-2, but it was trivial to 
resolve.  I'm attaching the branch-2 diff to maintain the history.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Fix For: 3.0.0, 2.5.0

 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.4.patch, HADOOP-10561.5.patch, 
 HADOOP-10561.branch-2.patch, HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 exception about XAttrs not supported will be thrown.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-11 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Description: 
The design docs for Xattrs stated that we handle preserve options with copy 
commands

From doc:
Preserve option of commands like “cp -p” shell command and “distcp -p” should 
work on XAttrs. 
In the case of source fs supports XAttrs but target fs does not support, 
exception about XAttrs not supported will be thrown.

  was:
The design docs for Xattrs stated that we handle preserve options with copy 
commands

From doc:
Preserve option of commands like “cp -p” shell command and “distcp -p” should 
work on XAttrs. 
In the case of source fs supports XAttrs but target fs does not support, XAttrs 
will be ignored 
with warning message


 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.4.patch, HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 exception about XAttrs not supported will be thrown.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-11 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: HADOOP-10561.5.patch

Add user doc for {{-p}} option of  {{fsshell#cp}} command to the patch.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.4.patch, HADOOP-10561.5.patch, 
 HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 exception about XAttrs not supported will be thrown.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-08 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: HADOOP-10561.4.patch

Thanks Uma for review. The new patch includes update for your comments.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.4.patch, HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-04 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: HADOOP-10561.3.patch

Thanks Andrew and Charles for review. The new patch includes update for the 
comments.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.3.patch, HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-03 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: (was: HADOOP-10561.1.patch)

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-03 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: HADOOP-10561.2.patch

Charles, the new patch includes update for your comments. Fix the test failure.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.2.patch, 
 HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-02 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Status: Patch Available  (was: Open)

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-02 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: HADOOP-10561.patch

The patch supports preserving xattr using -px flag.

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-06-02 Thread Yi Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Liu updated HADOOP-10561:


Attachment: HADOOP-10561.1.patch
HADOOP-10561.1.patch

Thanks @Charles Lamb for your comments. The new patch includes update for your 
comments.
{quote}
The usage message is a little bit confusing. At first it was unclear to me that 
-ptopx was really -p with options for t, o, p, and x. I would if we could make 
this a little clearer by saying something like this instead?
public static final String USAGE = \[-f\] \[-p | -p\[t|o|p|x\]\] src ... 
dst;
or maybe
public static final String USAGE = \[-f\] \[-p | -p\[topx\]\] src ... dst;
{quote}
OK, let's use the {{\[-f\] \[-p | -p\[topx\]\] src ... dst}}. For the 
detail, user can get from {{hadoop fs -usage cp}}

{quote}
+ must be a directory. Passing -p preserves status\n +
+ (\[topx\]) (timestamps, ownership, permission, XATTR). \n +
+ If -p is specified with no arg, then preserves  +
+ timestamps, ownership, permission. Passing -f\n +

Also, s/XATTR/XAttr/.
{quote}
Right, I change {{XATTR}} to {{xattr}}.


 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu
 Attachments: HADOOP-10561.1.patch, HADOOP-10561.1.patch, 
 HADOOP-10561.patch


 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-05-21 Thread Uma Maheswara Rao G (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uma Maheswara Rao G updated HADOOP-10561:
-

Issue Type: Improvement  (was: Bug)

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu

 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-05-21 Thread Uma Maheswara Rao G (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uma Maheswara Rao G updated HADOOP-10561:
-

Issue Type: Bug  (was: Sub-task)
Parent: (was: HADOOP-10514)

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu

 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-05-21 Thread Uma Maheswara Rao G (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uma Maheswara Rao G updated HADOOP-10561:
-

Affects Version/s: (was: HDFS XAttrs (HDFS-2006))
   3.0.0

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu

 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HADOOP-10561) Copy command with preserve option should handle Xattrs

2014-05-01 Thread Uma Maheswara Rao G (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Uma Maheswara Rao G updated HADOOP-10561:
-

Assignee: Yi Liu

 Copy command with preserve option should handle Xattrs
 --

 Key: HADOOP-10561
 URL: https://issues.apache.org/jira/browse/HADOOP-10561
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs
Affects Versions: HDFS XAttrs (HDFS-2006)
Reporter: Uma Maheswara Rao G
Assignee: Yi Liu

 The design docs for Xattrs stated that we handle preserve options with copy 
 commands
 From doc:
 Preserve option of commands like “cp -p” shell command and “distcp -p” should 
 work on XAttrs. 
 In the case of source fs supports XAttrs but target fs does not support, 
 XAttrs will be ignored 
 with warning message



--
This message was sent by Atlassian JIRA
(v6.2#6252)