[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320356=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320356 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940660#comment-16940660 ] Xiaoqiao He commented on HDFS-14810: [~jojochuang] gentle reminder again. any update here? > review

[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320353=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320353 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?focusedWorklogId=320350=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320350 ] ASF GitHub Bot logged work on HDDS-2034: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-09-29 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940656#comment-16940656 ] Surendra Singh Lilhore edited comment on HDFS-14794 at 9/30/19 5:32 AM:

[jira] [Commented] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-09-29 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940656#comment-16940656 ] Surendra Singh Lilhore commented on HDFS-14794: --- Root cause of this bad block is 

[jira] [Updated] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2204: - Status: Patch Available (was: Open) > Avoid buffer coping in checksum verification >

[jira] [Assigned] (HDDS-2056) Datanode unable to start command handler thread with security enabled

2019-09-29 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2056: --- Assignee: Xiaoyu Yao > Datanode unable to start command handler thread with security

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940652#comment-16940652 ] Xiaoqiao He commented on HDFS-14305: Thanks [~shv],[~arp] very much for your feedback and works. it

[jira] [Updated] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2204: - Attachment: o2204_20190930.patch > Avoid buffer coping in checksum verification >

[jira] [Commented] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940646#comment-16940646 ] Xiaoqiao He commented on HDFS-14554: Thanks [~lindongdong] for your comments. This ticket is not

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940643#comment-16940643 ] Xiaoqiao He commented on HDFS-14090: Thanks [~crh] for your works and sorry for late response. 1.

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-09-29 Thread CR Hota (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940620#comment-16940620 ] CR Hota commented on HDFS-14090: [~elgoiri] [~xkrogen] Thanks for your patience. Lets try and close this

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940618#comment-16940618 ] Hadoop QA commented on HDFS-14814: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDDS-2204) Avoid buffer coping in checksum verification

2019-09-29 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2204: Summary: Avoid buffer coping in checksum verification Key: HDDS-2204 URL: https://issues.apache.org/jira/browse/HDDS-2204 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940608#comment-16940608 ] Hadoop QA commented on HDFS-14814: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

2019-09-29 Thread lindongdong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940607#comment-16940607 ] lindongdong commented on HDFS-14554: Hi, [~hexiaoqiao], Thanks for your work. I test your patch, a

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.010.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: (was: HDFS-14814.010.patch) > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940593#comment-16940593 ] Jinglun commented on HDFS-14814:   {quote}If you want to return a List of Entry, just create a new Map.

[jira] [Updated] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.

2019-09-29 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14814: --- Attachment: HDFS-14814.010.patch > RBF: RouterQuotaUpdateService supports inherited rule. >

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940561#comment-16940561 ] Hadoop QA commented on HDFS-14305: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-09-29 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940533#comment-16940533 ] Hadoop QA commented on HDFS-13736: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940530#comment-16940530 ] Hudson commented on HDFS-14305: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17414 (See

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-29 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14305: --- Status: Patch Available (was: Reopened) I just reverted this from trunk. Will let

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940521#comment-16940521 ] Konstantin Shvachko commented on HDFS-14509: Hey [~John Smith]. Agreed we should apply to

[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320279=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320279 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2203) Race condition in ByteStringHelper.init()

2019-09-29 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940499#comment-16940499 ] Istvan Fajth commented on HDDS-2203: I have some concerns about the design of this class, and I would

[jira] [Work logged] (HDDS-2203) Race condition in ByteStringHelper.init()

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2203?focusedWorklogId=320245=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320245 ] ASF GitHub Bot logged work on HDDS-2203: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-1615) ManagedChannel references are being leaked in ReplicationSupervisor.java

2019-09-29 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-1615: --- Assignee: Mukul Kumar Singh (was: Hrishikesh Gadre) > ManagedChannel references are

[jira] [Work logged] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?focusedWorklogId=320242=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320242 ] ASF GitHub Bot logged work on HDDS-1569: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940342#comment-16940342 ] Fei Hui edited comment on HDFS-14847 at 9/29/19 10:56 AM: -- The problem of

[jira] [Comment Edited] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940342#comment-16940342 ] Fei Hui edited comment on HDFS-14847 at 9/29/19 10:56 AM: -- The problem of

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940342#comment-16940342 ] Fei Hui commented on HDFS-14847: * The problem of *findLeavingServiceSources* is that the decommissioning

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940329#comment-16940329 ] Fei Hui commented on HDFS-14509: [~John Smith] Part of approach 1 will be good. We only consider the NN

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940327#comment-16940327 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] Oh, It's other approach can do, not my PR. > DN

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940326#comment-16940326 ] Yuxuan Wang commented on HDFS-14509: {quote} As for unit tests I think we need two that verifies the

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940325#comment-16940325 ] Fei Hui commented on HDFS-14509: [~John Smith] {quote} NN 3.x does not include storage types into block

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-09-29 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940294#comment-16940294 ] hu xiaodong commented on HDFS-13736: Hello, [~ayushtkn]    sorry for no responding for a long time.

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-09-29 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13736: --- Attachment: HDFS-13736.002.patch > BlockPlacementPolicyDefault can not choose favored nodes when >

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940277#comment-16940277 ] Yuxuan Wang commented on HDFS-14509: [~John Smith] If we add some fields in the future, we still need

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940272#comment-16940272 ] Fei Hui commented on HDFS-14509: [~John Smith] If it's a general solution, I think target version is 3.x

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940266#comment-16940266 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] If it's just for resolving upgrading from 2.x to 3.x,

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940264#comment-16940264 ] Fei Hui commented on HDFS-14509: Have one question Is target version is 2.x or both 2.x and 3.x? > DN

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940253#comment-16940253 ] Yuxuan Wang commented on HDFS-14509: [~brahmareddy] Yes, existing cluster might need to update this

[jira] [Commented] (HDFS-14752) backport HDFS-13709 to branch-2(Report bad block to NN when transfer block encounter EIO exception)

2019-09-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940251#comment-16940251 ] Fei Hui commented on HDFS-14752: Thanks for fixing HDFS-13709 Maybe it is not necessary for Filing new