[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947477#comment-15947477 ] Manoj Govindassamy commented on HDFS-10971: --- Thanks for the review and commit help

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946551#comment-15946551 ] Hudson commented on HDFS-10971: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11486 (See

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946532#comment-15946532 ] Andrew Wang commented on HDFS-10971: LGTM will commit this shortly. Thanks for working on this Manoj!

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946461#comment-15946461 ] Hadoop QA commented on HDFS-10971: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946138#comment-15946138 ] Andrew Wang commented on HDFS-10971: This looks great. A couple nitty comments: {noformat} 170

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946050#comment-15946050 ] Wei-Chiu Chuang commented on HDFS-10971: Thanks [~manojg] for the patch. Looks good to me. Would

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944423#comment-15944423 ] Hadoop QA commented on HDFS-10971: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569491#comment-15569491 ] Wei-Chiu Chuang commented on HDFS-10971: Thanks for the discussion! I filed HADOOP-13715 to work

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-11 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567108#comment-15567108 ] Kai Zheng commented on HDFS-10971: -- HSM storage policy is per file, erasure coding policy could also be

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566485#comment-15566485 ] Andrew Wang commented on HDFS-10971: Thanks for commenting Zhe, good thoughts, bq. Extending this

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566464#comment-15566464 ] Andrew Wang commented on HDFS-10971: I thought we were going to copy S3's behavior, which shows

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566341#comment-15566341 ] Wei-Chiu Chuang commented on HDFS-10971: That sounds an easy solution. I can check the replication

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566111#comment-15566111 ] Zhe Zhang commented on HDFS-10971: -- Thanks for the discussions Andrew / Wei-Chiu. For the initial 3.0

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562891#comment-15562891 ] Wei-Chiu Chuang commented on HDFS-10971: I think it makes sense to me to add a CreateFlag for

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562859#comment-15562859 ] Andrew Wang commented on HDFS-10971: I wonder what the right distcp behavior is in this case of "-pr".

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556868#comment-15556868 ] Kai Zheng commented on HDFS-10971: -- Sounds good to me, Andrew and Zhe. So for this issue, the

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556537#comment-15556537 ] Zhe Zhang commented on HDFS-10971: -- Thanks Andrew. SGTM to expose replication factor 1 in {{FileStatus}},

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553330#comment-15553330 ] Andrew Wang commented on HDFS-10971: 1, based on this code from S3AFileStatus: {code} // Files

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553245#comment-15553245 ] Zhe Zhang commented on HDFS-10971: -- Thanks for identifying the issue [~jojochuang] and [~andrew.wang]

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553236#comment-15553236 ] Wei-Chiu Chuang commented on HDFS-10971: THat's a valid point. Currently HdfsFileStatus has a

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553164#comment-15553164 ] Andrew Wang commented on HDFS-10971: If the EC policy is showing up as the replication factor in

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552903#comment-15552903 ] Wei-Chiu Chuang commented on HDFS-10971: The other place to check is