[jira] [Comment Edited] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124426#comment-16124426 ] John Zhuge edited comment on HDFS-11303 at 8/12/17 5:39 AM: Committed to

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124474#comment-16124474 ] John Zhuge commented on HDFS-11303: --- Committed to branch-2. > Hedged read might hang infinitely if read

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Fix Version/s: 2.9.0 > Hedged read might hang infinitely if read data from all DN failed >

[jira] [Comment Edited] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124428#comment-16124428 ] John Zhuge edited comment on HDFS-11738 at 8/12/17 3:37 AM: [~vinayrpet]

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124428#comment-16124428 ] John Zhuge commented on HDFS-11738: --- [~vinayrpet] Committed HDFS-11303. > Hedged pread takes more time

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124429#comment-16124429 ] Hudson commented on HDFS-11303: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12174 (See

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11303: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124420#comment-16124420 ] Rushabh S Shah commented on HDFS-12288: --- bq. It does not represent number of active threads in the

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124411#comment-16124411 ] Wei-Chiu Chuang commented on HDFS-11303: +1. Thanks Chen Zhang for reporting the issue and thanks

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124361#comment-16124361 ] Íñigo Goiri commented on HDFS-12288: Currently there is a metric called {{xceiverCount}} which returns

[jira] [Comment Edited] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124333#comment-16124333 ] Lukas Majercak edited comment on HDFS-12288 at 8/12/17 12:19 AM: - It does

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124333#comment-16124333 ] Lukas Majercak commented on HDFS-12288: --- It does not represent number of active threads either. I am

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124324#comment-16124324 ] Rushabh S Shah commented on HDFS-12288: --- {quote} I believe, that for the correctness of the

[jira] [Commented] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124321#comment-16124321 ] Hadoop QA commented on HDFS-12005: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124309#comment-16124309 ] Arpit Agarwal commented on HDFS-12288: -- bq. I believe, that for the correctness of the metrics, we

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124299#comment-16124299 ] Lukas Majercak commented on HDFS-12288: --- I believe, that for the correctness of the metrics, we

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124286#comment-16124286 ] Rushabh S Shah commented on HDFS-12288: --- bq. No, what I would suggest here is to change the default

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124269#comment-16124269 ] Lukas Majercak commented on HDFS-12288: --- No, what I would suggest here is to change the default to

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124268#comment-16124268 ] Rushabh S Shah commented on HDFS-12288: --- {quote} Correct me if I'm wrong, but BlockReceiver and

[jira] [Commented] (HDFS-12289) [READ] HDFS-12091 breaks the tests for provided block reads

2017-08-11 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124220#comment-16124220 ] Ewan Higgs commented on HDFS-12289: --- LGTM > [READ] HDFS-12091 breaks the tests for provided block reads

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124175#comment-16124175 ] Lukas Majercak commented on HDFS-12288: --- My bad, i thought {{xmitsInProgress}} was not sent with

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124169#comment-16124169 ] Hanisha Koneru commented on HDFS-12288: --- bq. but BlockReceiver and PacketResponder are created for

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-11 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124163#comment-16124163 ] Ajay Yadav commented on HDFS-12221: --- Hi [~eddyxu], without that we get tag in first line along with xml

[jira] [Comment Edited] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124039#comment-16124039 ] Lukas Majercak edited comment on HDFS-12288 at 8/11/17 9:45 PM: Correct me

[jira] [Comment Edited] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124121#comment-16124121 ] Lukas Majercak edited comment on HDFS-12288 at 8/11/17 9:34 PM: For

[jira] [Comment Edited] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124121#comment-16124121 ] Lukas Majercak edited comment on HDFS-12288 at 8/11/17 9:34 PM: For

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124121#comment-16124121 ] Lukas Majercak commented on HDFS-12288: --- For {{BlockRecoveryWorker}} I agree, this should be

[jira] [Commented] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124079#comment-16124079 ] Elek, Marton commented on HDFS-12005: - TestSCMMXBean (and a few typo) is fixed. The other tests don't

[jira] [Updated] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12005: Attachment: HDFS-12005-HDFS-7240.002.patch > Ozone: Web interface for SCM >

[jira] [Commented] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-11 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124071#comment-16124071 ] Hanisha Koneru commented on HDFS-12248: --- [~brahmareddy], thanks for the patch. # We should have an

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124039#comment-16124039 ] Lukas Majercak commented on HDFS-12288: --- Correct me if I'm wrong, but {{BlockReceiver}} and

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124024#comment-16124024 ] Lukas Majercak commented on HDFS-11576: --- FindBugs/test failures unrelated to the change, anyone

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124018#comment-16124018 ] Hadoop QA commented on HDFS-11576: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12293) DataNode should log file name on disk error

2017-08-11 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav reassigned HDFS-12293: - Assignee: Ajay Yadav > DataNode should log file name on disk error >

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123924#comment-16123924 ] Hadoop QA commented on HDFS-12288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123912#comment-16123912 ] Xiaoyu Yao commented on HDFS-12159: --- Thanks [~anu] for the update. The latest patch looks good to me.

[jira] [Commented] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123858#comment-16123858 ] Hadoop QA commented on HDFS-12005: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123827#comment-16123827 ] Rushabh S Shah commented on HDFS-12288: --- bq. Do you mind explaining why would we start creating

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123822#comment-16123822 ] Rushabh S Shah commented on HDFS-12288: --- [~hkoneru]: yes, that's correct. bq. DataXceiverServer

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123816#comment-16123816 ] Erik Krogen commented on HDFS-12292: Ah, yes, I see. Sorry about that, thank you for the

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123808#comment-16123808 ] Mikhail Erofeev commented on HDFS-12292: Hi [~xkrogen], the patch in

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123794#comment-16123794 ] Hanisha Koneru commented on HDFS-12288: --- Thanks [~shahrs87] for the review. [~lukmajercak],

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123775#comment-16123775 ] Erik Krogen commented on HDFS-12292: Hey [~erofeev], wasn't this fixed in HDFS-11432 ? Is this

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123752#comment-16123752 ] Hadoop QA commented on HDFS-12292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123747#comment-16123747 ] Lukas Majercak commented on HDFS-12288: --- Thanks for the review [~hanishakoneru], I've removed the

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12288: -- Attachment: HDFS-12288.002.patch > Fix DataNode's xceiver count calculation >

[jira] [Commented] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123740#comment-16123740 ] Lukas Majercak commented on HDFS-11576: --- Patch 010 for fixing checkstyle/unit test failure. > Block

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11576: -- Attachment: HDFS-11576.010.patch > Block recovery will fail indefinitely if recovery time >

[jira] [Updated] (HDFS-12293) DataNode should log file name on disk error

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12293: --- Description: Found the following error message in precommit build

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123717#comment-16123717 ] John Zhuge commented on HDFS-11303: --- TestDirectoryScanner was known to be flaky: {noformat} Tests run:

[jira] [Commented] (HDFS-12289) [READ] HDFS-12091 breaks the tests for provided block reads

2017-08-11 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123700#comment-16123700 ] Virajith Jalaparti commented on HDFS-12289: --- Failed tests are unrelated and pass locally. >

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12281: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: HDFS-7240

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123645#comment-16123645 ] Anu Engineer commented on HDFS-12281: - +1. I will commit this shortly. > Ozone: Ozone-default.xml

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123632#comment-16123632 ] John Zhuge commented on HDFS-11303: --- Saw TestDataNodeVolumeFailureReporting failure in Aug 10 qbt:

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123628#comment-16123628 ] John Zhuge commented on HDFS-11303: --- Saw TestDecommissioningStatus failure in Jul 28 qbt: {noformat} For

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123625#comment-16123625 ] John Zhuge commented on HDFS-11303: --- Saw it in Aug 6 qbt: {noformat} For more details, see

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123589#comment-16123589 ] Lukas Majercak commented on HDFS-12288: --- Thanks for the review [~shahrs87]. # Do you mind

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123585#comment-16123585 ] Anu Engineer commented on HDFS-12281: - [~cheersyang] Thanks for checking. Let us use distributed as

[jira] [Updated] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12005: Status: Patch Available (was: In Progress) > Ozone: Web interface for SCM >

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123561#comment-16123561 ] Anu Engineer commented on HDFS-12028: - Thanks to [~elek] I have reapplied the patch and Marton has

[jira] [Commented] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123557#comment-16123557 ] Wei-Chiu Chuang commented on HDFS-11964: FYI

[jira] [Assigned] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-11964: -- Assignee: Takanobu Asanuma > Fix

[jira] [Commented] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123554#comment-16123554 ] Wei-Chiu Chuang commented on HDFS-11964: Hello [~tasanuma0829], would you still like to work on

[jira] [Created] (HDFS-12293) DataNode should log file name on disk error

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12293: -- Summary: DataNode should log file name on disk error Key: HDFS-12293 URL: https://issues.apache.org/jira/browse/HDFS-12293 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123540#comment-16123540 ] Anu Engineer commented on HDFS-12028: - [~elek] Just told me that I have accidentally broken this patch

[jira] [Commented] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123523#comment-16123523 ] Hadoop QA commented on HDFS-12199: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12286) Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12286: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12275) Ozone: Corona: Support for random validation of writes

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123499#comment-16123499 ] Hadoop QA commented on HDFS-12275: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123483#comment-16123483 ] Rushabh S Shah edited comment on HDFS-12288 at 8/11/17 3:34 PM: Thanks

[jira] [Commented] (HDFS-12286) Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123486#comment-16123486 ] Anu Engineer commented on HDFS-12286: - [~elek] Thanks for the screen shots and explanation. +1, I will

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: HDFS-12292.patch > Federation: Support viewfs:// schema path for DfsAdmin

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: (was: HDFS_12292.patch) > Federation: Support viewfs:// schema path for

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2017-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123483#comment-16123483 ] Rushabh S Shah commented on HDFS-12288: --- {noformat} // the load for writers is 2 because

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Status: Patch Available (was: Open) > Federation: Support viewfs:// schema path for DfsAdmin

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: HDFS_12292.patch > Federation: Support viewfs:// schema path for DfsAdmin

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123481#comment-16123481 ] Wei-Chiu Chuang commented on HDFS-11303: Thanks John!

[jira] [Updated] (HDFS-12275) Ozone: Corona: Support for random validation of writes

2017-08-11 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12275: -- Attachment: HDFS-12275-HDFS-7240.000.patch patch v000 uploaded. > Ozone: Corona: Support for random

[jira] [Updated] (HDFS-12275) Ozone: Corona: Support for random validation of writes

2017-08-11 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12275: -- Status: Patch Available (was: Open) > Ozone: Corona: Support for random validation of writes >

[jira] [Updated] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-08-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12199: - Attachment: HDFS-12199-HDFS-7240.003.patch v3 patch fixes checkstyle issues. > Ozone:

[jira] [Commented] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123353#comment-16123353 ] Elek, Marton commented on HDFS-12005: - First version is uploaded but as It depends on HDFS-12286, I

[jira] [Commented] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123345#comment-16123345 ] Hadoop QA commented on HDFS-12199: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12005) Ozone: Web interface for SCM

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12005: Attachment: HDFS-12005-HDFS-7240.001.patch > Ozone: Web interface for SCM >

[jira] [Resolved] (HDFS-11924) FSPermissionChecker.checkTraverse doesn't pass FsAction access properly

2017-08-11 Thread Zsombor Gegesy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsombor Gegesy resolved HDFS-11924. --- Resolution: Invalid You are right, the problem is that Ranger doesn't implement properly the

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Summary: Federation: Support viewfs:// schema path for DfsAdmin commands (was: Federation:

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123232#comment-16123232 ] Hadoop QA commented on HDFS-12258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAmdin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Description: Motivation: As of now, clients need to specify a nameservice when a cluster is

[jira] [Created] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAmdin commands

2017-08-11 Thread Mikhail Erofeev (JIRA)
Mikhail Erofeev created HDFS-12292: -- Summary: Federation: Support viewfs:// schema path for DfsAmdin commands Key: HDFS-12292 URL: https://issues.apache.org/jira/browse/HDFS-12292 Project: Hadoop

[jira] [Updated] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-08-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12199: - Attachment: HDFS-12199-HDFS-7240.002.patch > Ozone: OzoneFileSystem: OzoneFileystem

[jira] [Comment Edited] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-08-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123213#comment-16123213 ] Mukul Kumar Singh edited comment on HDFS-12199 at 8/11/17 11:27 AM:

[jira] [Commented] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-08-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123213#comment-16123213 ] Mukul Kumar Singh commented on HDFS-12199: -- Thanks for the review [~xyao],

[jira] [Comment Edited] (HDFS-12286) Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123183#comment-16123183 ] Elek, Marton edited comment on HDFS-12286 at 8/11/17 11:07 AM: --- Yes. I

[jira] [Updated] (HDFS-12286) Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans

2017-08-11 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12286: Attachment: jmx2.png jmx1.png Two JMX bean example > Ozone: Extend MBeans utility

[jira] [Commented] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123179#comment-16123179 ] Weiwei Yang commented on HDFS-12281: Looks good to me, the v2 patch. Ping [~anu], I recall you guys

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background

2017-08-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123162#comment-16123162 ] Weiwei Yang commented on HDFS-12196: The UT failures were not related, committing this to the feature

[jira] [Commented] (HDFS-12290) Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123161#comment-16123161 ] Hadoop QA commented on HDFS-12290: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123133#comment-16123133 ] Hadoop QA commented on HDFS-11303: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-11 Thread Rakesh R (JIRA)
Rakesh R created HDFS-12291: --- Summary: [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir Key: HDFS-12291 URL:

[jira] [Assigned] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-08-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12205: Assignee: Lokesh Jain (was: Mukul Kumar Singh) > Ozone: List Key on an empty

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-11 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12258: Attachment: HDFS-12258.01.patch Initial patch for this issue. An {{ErasureCodingPolicyState}} added into

  1   2   >