[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-04-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955938#comment-15955938 ] Wei-Chiu Chuang commented on HDFS-10999: [~manojg] thanks for working on this. The direction of

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-02-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886693#comment-15886693 ] Manoj Govindassamy commented on HDFS-10999: --- [~tasanuma0829], thanks for sharing your thoughts

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-02-24 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882803#comment-15882803 ] Takanobu Asanuma commented on HDFS-10999: - Thanks for the good summary, [~manojg]! I agree with

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-02-23 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881777#comment-15881777 ] Manoj Govindassamy commented on HDFS-10999: --- Based on the discussions and consensus above, my

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-02-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877224#comment-15877224 ] Takanobu Asanuma commented on HDFS-10999: - Thanks for the comment, [~aw]. bq. In this way, it

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-02-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876670#comment-15876670 ] Allen Wittenauer commented on HDFS-10999: - bq. In this way, it would be easy to keep code

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-02-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875384#comment-15875384 ] Takanobu Asanuma commented on HDFS-10999: - Hi all, thanks for the discussion. I would like to

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-01-10 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816787#comment-15816787 ] Yuanbo Liu commented on HDFS-10999: --- I think I've lost the context of this JIRA. Dismiss my ownership,

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606505#comment-15606505 ] Andrew Wang commented on HDFS-10999: Good finds Wei-chiu. Could you file JIRAs to fix these per the

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605080#comment-15605080 ] Wei-Chiu Chuang commented on HDFS-10999: Thanks for the input, Allen. I think it makes sense. As

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602650#comment-15602650 ] Allen Wittenauer commented on HDFS-10999: - I've been out of town and I've had more time to think

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590122#comment-15590122 ] Andrew Wang commented on HDFS-10999: [~jojochuang] thanks for sharing that output. Allen mentioned

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588153#comment-15588153 ] Yuanbo Liu commented on HDFS-10999: --- I guess some monitor scripts are based on "fsck" command. Admins

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-18 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585942#comment-15585942 ] Wei-Chiu Chuang commented on HDFS-10999: Just FYI, the fsck output in Hadoop 3 is of the following

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583691#comment-15583691 ] Andrew Wang commented on HDFS-10999: Turns out we already have JIRAs for some of these, I did file

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583660#comment-15583660 ] Andrew Wang commented on HDFS-10999: bq. Are we exposing how many blocks are EC blocks and how many

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-15 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578574#comment-15578574 ] Allen Wittenauer commented on HDFS-10999: - bq. That's what I was getting at with the

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576938#comment-15576938 ] Andrew Wang commented on HDFS-10999: Thanks for the insight Allen, {quote} M: "How long for

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576844#comment-15576844 ] Allen Wittenauer commented on HDFS-10999: - bq. We tried to draw an equivalence between the

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572797#comment-15572797 ] Andrew Wang commented on HDFS-10999: We tried to draw an equivalence between the durability of EC and

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572514#comment-15572514 ] Zhe Zhang commented on HDFS-10999: -- Thanks for the thoughts [~aw]. EC policies are configured per file

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572492#comment-15572492 ] Allen Wittenauer commented on HDFS-10999: - Given that the fsck output is the *only* way to get

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569421#comment-15569421 ] Andrew Wang commented on HDFS-10999: Yea, thanks for the pointer [~rakesh_r]. One idea is that we

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568227#comment-15568227 ] Rakesh R commented on HDFS-10999: - Thanks [~jojochuang] for bringing this point. I remember there was a

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568050#comment-15568050 ] Wei-Chiu Chuang commented on HDFS-10999: One thing I want to call out is metrics names. There are