[jira] [Comment Edited] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-22 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823669#comment-16823669 ] angerszhu edited comment on HDFS-14437 at 4/23/19 5:55 AM: --- [~hexiaoqiao]   

[jira] [Commented] (HDDS-1448) RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation

2019-04-22 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823698#comment-16823698 ] Lokesh Jain commented on HDDS-1448: --- The changes required for this Jira would enable multiple three node

[jira] [Work logged] (HDDS-1453) Fix unit test TestConfigurationFields broken on trunk

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1453?focusedWorklogId=231065=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231065 ] ASF GitHub Bot logged work on HDDS-1453: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-14426) RBF: Add delegation token total count as one of the federation metrics

2019-04-22 Thread Fengnan Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823676#comment-16823676 ] Fengnan Li edited comment on HDFS-14426 at 4/23/19 5:26 AM:   [Deleted some

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread Fengnan Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823677#comment-16823677 ] Fengnan Li commented on HDFS-14374: --- [~hexiaoqiao] I will actually take care of those jmx metrics. For

[jira] [Created] (HDFS-14449) Expose total number of dt in jmx for KMS/Namenode

2019-04-22 Thread Fengnan Li (JIRA)
Fengnan Li created HDFS-14449: - Summary: Expose total number of dt in jmx for KMS/Namenode Key: HDFS-14449 URL: https://issues.apache.org/jira/browse/HDFS-14449 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14426) RBF: Add delegation token total count as one of the federation metrics

2019-04-22 Thread Fengnan Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823676#comment-16823676 ] Fengnan Li commented on HDFS-14426: --- [~crh] I think the commit 

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823673#comment-16823673 ] Hadoop QA commented on HDFS-14353: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-22 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823669#comment-16823669 ] angerszhu commented on HDFS-14437: -- [~hexiaoqiao]  You can see that when other thread is also run

[jira] [Updated] (HDDS-1453) Fix unit test TestConfigurationFields broken on trunk

2019-04-22 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-1453: -- Status: Patch Available (was: Open) > Fix unit test TestConfigurationFields broken on trunk >

[jira] [Work logged] (HDDS-1453) Fix unit test TestConfigurationFields broken on trunk

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1453?focusedWorklogId=231045=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231045 ] ASF GitHub Bot logged work on HDDS-1453: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1453) Fix unit test TestConfigurationFields broken on trunk

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1453: - Labels: pull-request-available (was: ) > Fix unit test TestConfigurationFields broken on trunk >

[jira] [Created] (HDDS-1453) Fix unit test TestConfigurationFields broken on trunk

2019-04-22 Thread Siddharth Wagle (JIRA)
Siddharth Wagle created HDDS-1453: - Summary: Fix unit test TestConfigurationFields broken on trunk Key: HDDS-1453 URL: https://issues.apache.org/jira/browse/HDDS-1453 Project: Hadoop Distributed Data

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2019-04-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823660#comment-16823660 ] He Xiaoqiao commented on HDFS-14437: Thanks [~angerszhuuu] for your more information. {quote}When

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823658#comment-16823658 ] He Xiaoqiao commented on HDFS-14374: Thanks [~crh] and [~elgoiri] working on this, and sorry for

[jira] [Commented] (HDFS-14421) HDFS block two replicas exist in one DataNode

2019-04-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823640#comment-16823640 ] Yuanbo Liu commented on HDFS-14421: --- Sorry, quite busy this week. Will comment as soon as I figure out.

[jira] [Work logged] (HDDS-1065) OM and DN should persist SCM certificate as the trust root.

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1065?focusedWorklogId=231016=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231016 ] ASF GitHub Bot logged work on HDDS-1065: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1065) OM and DN should persist SCM certificate as the trust root.

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1065?focusedWorklogId=230992=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230992 ] ASF GitHub Bot logged work on HDDS-1065: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-04-22 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823615#comment-16823615 ] maobaolong commented on HDFS-14353: --- [~elgoiri] Of curse, thank you for remind me, i upload a new

[jira] [Updated] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-04-22 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-14353: -- Attachment: HDFS-14353.003.patch > Erasure Coding: metrics xmitsInProgress become to negative. >

[jira] [Commented] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823610#comment-16823610 ] Hadoop QA commented on HDDS-999: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-14448) Provide an appropriate Message when Secondary Namenode is not bootstrap initialized

2019-04-22 Thread Sailesh Patel (JIRA)
Sailesh Patel created HDFS-14448: Summary: Provide an appropriate Message when Secondary Namenode is not bootstrap initialized Key: HDFS-14448 URL: https://issues.apache.org/jira/browse/HDFS-14448

[jira] [Work logged] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?focusedWorklogId=230980=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230980 ] ASF GitHub Bot logged work on HDDS-999: --- Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1441) Remove usage of getRetryFailureException

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1441?focusedWorklogId=230966=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230966 ] ASF GitHub Bot logged work on HDDS-1441: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-999: - Status: Patch Available (was: Open) cc: [~arpitagarwal] / [~elek] > Make the DNS resolution in

[jira] [Work logged] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?focusedWorklogId=230965=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230965 ] ASF GitHub Bot logged work on HDDS-999: --- Author: ASF GitHub Bot

[jira] [Updated] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-999: - Attachment: HDDS-999.01.patch > Make the DNS resolution in OzoneManager more resilient >

[jira] [Updated] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-999: Labels: pull-request-available (was: ) > Make the DNS resolution in OzoneManager more resilient >

[jira] [Commented] (HDDS-1301) Optimize recursive ozone filesystem apis

2019-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823567#comment-16823567 ] Anu Engineer commented on HDDS-1301: Thank you, I will sync with you, but I will write and post a

[jira] [Commented] (HDDS-999) Make the DNS resolution in OzoneManager more resilient

2019-04-22 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823562#comment-16823562 ] Siddharth Wagle commented on HDDS-999: -- I am able to easily reproduce this on the latest trunk,

[jira] [Work logged] (HDDS-1450) Fix nightly run failures after HDDS-976

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1450?focusedWorklogId=230928=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230928 ] ASF GitHub Bot logged work on HDDS-1450: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14426) RBF: Add delegation token total count as one of the federation metrics

2019-04-22 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823492#comment-16823492 ] CR Hota commented on HDFS-14426: [~elgoiri]  Strangely I don't see the commit in HDFS-13891 branch yet.

[jira] [Commented] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823484#comment-16823484 ] Hudson commented on HDFS-14435: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16448 (See

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823485#comment-16823485 ] Hudson commented on HDFS-14374: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16448 (See

[jira] [Commented] (HDFS-14426) RBF: Add delegation token total count as one of the federation metrics

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823480#comment-16823480 ] Íñigo Goiri commented on HDFS-14426: It should already be rebased. > RBF: Add delegation token total

[jira] [Commented] (HDFS-14426) RBF: Add delegation token total count as one of the federation metrics

2019-04-22 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823460#comment-16823460 ] CR Hota commented on HDFS-14426: [~elgoiri] Could you please help rebase HDFS-13891?   > RBF: Add

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823456#comment-16823456 ] CR Hota commented on HDFS-14374: [~elgoiri]  Thanks for the review and commit.  > Expose total number of

[jira] [Commented] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823450#comment-16823450 ] Hudson commented on HDFS-14445: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16447 (See

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823439#comment-16823439 ] Íñigo Goiri commented on HDFS-14374: Thanks [~crh] for the patch. Committed to trunk. > Expose total

[jira] [Updated] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14374: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status: Resolved

[jira] [Updated] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14435: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status: Resolved

[jira] [Commented] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823438#comment-16823438 ] Erik Krogen commented on HDFS-14435: Thanks all! Committed to trunk. > ObserverReadProxyProvider is

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823437#comment-16823437 ] Íñigo Goiri commented on HDFS-14374: +1 on [^HDFS-14374.002.patch]. [~hexiaoqiao] we will open a

[jira] [Commented] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823432#comment-16823432 ] Íñigo Goiri commented on HDFS-14435: +1 on [^HDFS-14435.004.patch]. > ObserverReadProxyProvider is

[jira] [Updated] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14445: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status: Resolved

[jira] [Commented] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823430#comment-16823430 ] Íñigo Goiri commented on HDFS-14445: Thanks [~ayushtkn] for the patch. Committed to trunk. >

[jira] [Commented] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823428#comment-16823428 ] Íñigo Goiri commented on HDFS-14445: Yetus reported failed unit tests but the report shows none.

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823407#comment-16823407 ] Anu Engineer commented on HDDS-1452: {quote}Why impose such a requirement? Doing EC of 1 KB files is

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823404#comment-16823404 ] Arpit Agarwal commented on HDDS-1452: - bq. In the ozone world, it should not matter. Especially since

[jira] [Commented] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823381#comment-16823381 ] Chao Sun commented on HDFS-14435: - +1 from me as well! > ObserverReadProxyProvider is unable to properly

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823378#comment-16823378 ] Anu Engineer commented on HDDS-1452: {quote}If a container is full of 1KB files it may not be a good

[jira] [Comment Edited] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823376#comment-16823376 ] Chen Liang edited comment on HDFS-14435 at 4/22/19 7:38 PM: [~xkrogen] sorry

[jira] [Commented] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823376#comment-16823376 ] Chen Liang commented on HDFS-14435: --- [~xkrogen] sorry for the late response... +1 from me. Feel free to

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823375#comment-16823375 ] Arpit Agarwal commented on HDDS-1452: - Yeah we will have to benchmark it. If a container is full of

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823374#comment-16823374 ] Anu Engineer commented on HDDS-1452: Possibly; I don't know what would be a good option; one single

[jira] [Comment Edited] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823373#comment-16823373 ] Erik Krogen edited comment on HDFS-14435 at 4/22/19 7:33 PM: - Hey

[jira] [Commented] (HDFS-14435) ObserverReadProxyProvider is unable to properly fetch HAState from Standby NNs

2019-04-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823373#comment-16823373 ] Erik Krogen commented on HDFS-14435: Hey [~csun], [~elgoiri] -- can I get a binding +1 from either of

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823368#comment-16823368 ] Arpit Agarwal commented on HDDS-1452: - Thanks for filing this [~shashikant]. 1KB files can probably

[jira] [Work logged] (HDDS-1403) KeyOutputStream writes fails after max retries while writing to a closed container

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1403?focusedWorklogId=230851=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230851 ] ASF GitHub Bot logged work on HDDS-1403: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823360#comment-16823360 ] Hadoop QA commented on HDFS-14445: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823359#comment-16823359 ] Anu Engineer commented on HDDS-1452: Just a thought: Would it make sense to write to Data files until

[jira] [Work logged] (HDDS-1065) OM and DN should persist SCM certificate as the trust root.

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1065?focusedWorklogId=230849=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230849 ] ASF GitHub Bot logged work on HDDS-1065: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1403) KeyOutputStream writes fails after max retries while writing to a closed container

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1403?focusedWorklogId=230846=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230846 ] ASF GitHub Bot logged work on HDDS-1403: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1065) OM and DN should persist SCM certificate as the trust root.

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1065?focusedWorklogId=230848=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230848 ] ASF GitHub Bot logged work on HDDS-1065: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1403) KeyOutputStream writes fails after max retries while writing to a closed container

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1403?focusedWorklogId=230847=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230847 ] ASF GitHub Bot logged work on HDDS-1403: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-1449) JVM Exit in datanode while committing a key

2019-04-22 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-1449: - Assignee: Shashikant Banerjee > JVM Exit in datanode while committing a key >

[jira] [Work logged] (HDDS-1368) Cleanup old ReplicationManager code from SCM

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1368?focusedWorklogId=230833=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230833 ] ASF GitHub Bot logged work on HDDS-1368: Author: ASF GitHub Bot

[jira] [Created] (HDDS-1452) All chunks should happen to a single file for a block in datanode

2019-04-22 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDDS-1452: - Summary: All chunks should happen to a single file for a block in datanode Key: HDDS-1452 URL: https://issues.apache.org/jira/browse/HDDS-1452 Project:

[jira] [Commented] (HDDS-1425) Ozone compose files are not compatible with the latest docker-compose

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823343#comment-16823343 ] Arpit Agarwal commented on HDDS-1425: - Thanks [~anu]. Updating the fix version to 0.4.0 since it looks

[jira] [Updated] (HDDS-1425) Ozone compose files are not compatible with the latest docker-compose

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1425: Fix Version/s: (was: 0.4.1) 0.4.0 > Ozone compose files are not compatible

[jira] [Work logged] (HDDS-1450) Fix nightly run failures after HDDS-976

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1450?focusedWorklogId=230822=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230822 ] ASF GitHub Bot logged work on HDDS-1450: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1425) Ozone compose files are not compatible with the latest docker-compose

2019-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823276#comment-16823276 ] Anu Engineer commented on HDDS-1425: we plan to release 0.4.1 and 0.4.2 soon ... So this is helpful.

[jira] [Commented] (HDFS-14374) Expose total number of delegation tokens in AbstractDelegationTokenSecretManager

2019-04-22 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823274#comment-16823274 ] CR Hota commented on HDFS-14374: [~elgoiri]  [~hexiaoqiao] This is a fairly harmless and but important

[jira] [Work logged] (HDDS-1450) Fix nightly run failures after HDDS-976

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1450?focusedWorklogId=230799=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230799 ] ASF GitHub Bot logged work on HDDS-1450: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1450) Fix nightly run failures after HDDS-976

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1450: - Labels: pull-request-available (was: ) > Fix nightly run failures after HDDS-976 >

[jira] [Work logged] (HDDS-1450) Fix nightly run failures after HDDS-976

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1450?focusedWorklogId=230798=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230798 ] ASF GitHub Bot logged work on HDDS-1450: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-1451) SCMBlockManager allocates pipelines in cases when the pipeline has already been allocated

2019-04-22 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-1451: --- Assignee: Aravindan Vijayan > SCMBlockManager allocates pipelines in cases when the

[jira] [Created] (HDDS-1451) SCMBlockManager allocates pipelines in cases when the pipeline has already been allocated

2019-04-22 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1451: --- Summary: SCMBlockManager allocates pipelines in cases when the pipeline has already been allocated Key: HDDS-1451 URL: https://issues.apache.org/jira/browse/HDDS-1451

[jira] [Updated] (HDDS-1451) SCMBlockManager allocates pipelines in cases when the pipeline has already been allocated

2019-04-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-1451: Labels: MiniOzoneChaosCluster (was: ) > SCMBlockManager allocates pipelines in cases when

[jira] [Assigned] (HDDS-1448) RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation

2019-04-22 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-1448: --- Assignee: Aravindan Vijayan > RatisPipelineProvider should only consider open

[jira] [Commented] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823233#comment-16823233 ] Ayush Saxena commented on HDFS-14445: - updated v2 using lambda >

[jira] [Updated] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14445: Attachment: HDFS-14445-02.patch > TestTrySendErrorReportWhenNNThrowsIOException fails in trunk >

[jira] [Commented] (HDFS-14406) Add per user RPC Processing time

2019-04-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823227#comment-16823227 ] Chao Sun commented on HDFS-14406: - [~xuel1]: I'm still in favor of reusing the existing

[jira] [Commented] (HDFS-14440) RBF: Optimize the file write process in case of multiple destinations.

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823223#comment-16823223 ] Íñigo Goiri commented on HDFS-14440: I think we have some metrics in JMX for the number of RPC

[jira] [Updated] (HDDS-1449) JVM Exit in datanode while committing a key

2019-04-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-1449: Attachment: 2019-04-22--20-23-56-IST.MiniOzoneChaosCluster.log > JVM Exit in datanode while

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823205#comment-16823205 ] Íñigo Goiri commented on HDFS-14353: Do you mind fixing the checkstyle warnings? > Erasure Coding:

[jira] [Updated] (HDDS-1449) JVM Exit in datanode while committing a key

2019-04-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-1449: Attachment: hs_err_pid67466.log > JVM Exit in datanode while committing a key >

[jira] [Commented] (HDFS-14445) TestTrySendErrorReportWhenNNThrowsIOException fails in trunk

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823203#comment-16823203 ] Íñigo Goiri commented on HDFS-14445: Removing a sleep() is always good. Can we use a lambda for the

[jira] [Created] (HDDS-1450) Fix nightly run failures after HDDS-976

2019-04-22 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-1450: Summary: Fix nightly run failures after HDDS-976 Key: HDDS-1450 URL: https://issues.apache.org/jira/browse/HDDS-1450 Project: Hadoop Distributed Data Store Issue

[jira] [Commented] (HDFS-14447) RBF: RouterAdminServer should support RefreshUserMappingsProtocol

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823200#comment-16823200 ] Íñigo Goiri commented on HDFS-14447: I moved the JIRA to HDFS-13891. Do you mind rebasing the patch

[jira] [Created] (HDDS-1449) JVM Exit in datanode while committing a key

2019-04-22 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1449: --- Summary: JVM Exit in datanode while committing a key Key: HDDS-1449 URL: https://issues.apache.org/jira/browse/HDDS-1449 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDFS-14447) RBF: RouterAdminServer should support RefreshUserMappingsProtocol

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14447: --- Issue Type: Sub-task (was: Improvement) Parent: HDFS-13891 > RBF: RouterAdminServer should

[jira] [Updated] (HDFS-14447) RBF: RouterAdminServer should support RefreshUserMappingsProtocol

2019-04-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14447: --- Summary: RBF: RouterAdminServer should support RefreshUserMappingsProtocol (was:

[jira] [Resolved] (HDDS-1425) Ozone compose files are not compatible with the latest docker-compose

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-1425. - Resolution: Fixed Fix Version/s: 0.4.1 I've merged this to ozone-0.4. Thanks for the

[jira] [Updated] (HDDS-1425) Ozone compose files are not compatible with the latest docker-compose

2019-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1425: Target Version/s: (was: 0.4.0) > Ozone compose files are not compatible with the latest

[jira] [Work logged] (HDDS-1425) Ozone compose files are not compatible with the latest docker-compose

2019-04-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1425?focusedWorklogId=230733=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230733 ] ASF GitHub Bot logged work on HDDS-1425: Author: ASF GitHub Bot

[jira] [Created] (HDDS-1448) RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation

2019-04-22 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1448: --- Summary: RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation Key: HDDS-1448 URL:

[jira] [Commented] (HDDS-1305) Robot test containers: hadoop client can't access o3fs

2019-04-22 Thread Sandeep Nemuri (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823021#comment-16823021 ] Sandeep Nemuri commented on HDDS-1305: -- [~jnp], it's hadoop 3.1.0 (apache docker image is being used

[jira] [Commented] (HDFS-13236) Standby NN down with error encountered while tailing edits

2019-04-22 Thread Yuriy Malygin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822989#comment-16822989 ] Yuriy Malygin commented on HDFS-13236: -- This problem in other ticket - HDFS-13596. > Standby NN

[jira] [Comment Edited] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2019-04-22 Thread Yuriy Malygin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822981#comment-16822981 ] Yuriy Malygin edited comment on HDFS-13596 at 4/22/19 10:06 AM: The same

  1   2   >