[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955814#comment-16955814 ] Shashikant Banerjee commented on HDDS-2331: --- In Ozone, by default the buffer size is equal to

[jira] [Comment Edited] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955814#comment-16955814 ] Shashikant Banerjee edited comment on HDDS-2331 at 10/21/19 7:04 AM: -

[jira] [Created] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Xieming Li (Jira)
Xieming Li created HDFS-14916: - Summary: RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls" Key: HDFS-14916 URL: https://issues.apache.org/jira/browse/HDFS-14916 Project: Hadoop

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955815#comment-16955815 ] Xiaoqiao He commented on HDFS-14915: [~ayushtkn] Thanks for your works. it seems that double check

[jira] [Commented] (HDDS-1574) Ensure same datanodes are not a part of multiple pipelines

2019-10-21 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955811#comment-16955811 ] Li Cheng commented on HDDS-1574: [~swagle] Cloud you elaborate more to help understand this task? Do you

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955802#comment-16955802 ] Ayush Saxena commented on HDFS-14916: - Yes. With -d there is a break line, without it, it isn't there

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955804#comment-16955804 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn] for your comments. {quote}Though things are

[jira] [Assigned] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2331: - Assignee: Shashikant Banerjee > Client OOME due to buffer retention >

[jira] [Assigned] (HDDS-669) Consider removing duplication of StorageType

2019-10-21 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien reassigned HDDS-669: - Assignee: YiSheng Lien > Consider removing duplication of StorageType >

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955911#comment-16955911 ] Xiaoqiao He commented on HDFS-13736: Thanks [~xiaodong.hu] for interesting catching.

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.005.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955918#comment-16955918 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.005.patch] fix checkstyle and try to trigger

[jira] [Assigned] (HDDS-2338) Avoid buffer copy while submitting write chunk request in Ozone Client

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2338: - Assignee: Shashikant Banerjee > Avoid buffer copy while submitting write chunk

[jira] [Assigned] (HDDS-1576) Ensure constraint of one raft log per disk is met unless fast media

2019-10-21 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1576: -- Assignee: Li Cheng > Ensure constraint of one raft log per disk is met unless fast media >

[jira] [Created] (HDDS-2338) Avoid buffer copy while submitting write chunk request in Ozone Client

2019-10-21 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2338: - Summary: Avoid buffer copy while submitting write chunk request in Ozone Client Key: HDDS-2338 URL: https://issues.apache.org/jira/browse/HDDS-2338

[jira] [Updated] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14915: Attachment: HDFS-14915-02.patch > Move Superuser Check Before Taking Lock For Encryption API >

[jira] [Updated] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14916: -- Status: Open (was: Patch Available) > RBF: line breaks are missing from the output of "hdfs

[jira] [Updated] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14916: -- Attachment: HDFS-14916.001.patch Status: Patch Available (was: Open) > RBF: line breaks are

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955834#comment-16955834 ] Xieming Li commented on HDFS-14916: --- [~ayushtkn], [~tasanuma], thank you for your confirmation. I

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955835#comment-16955835 ] Ayush Saxena commented on HDFS-14915: - Thanx [~hexiaoqiao] uploaded v2. removing the redundant

[jira] [Updated] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14918: --- Status: Patch Available (was: Open) > Remove useless getRedundancyThread from BlockManagerTestUtil >

[jira] [Updated] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14918: --- Attachment: HDFS-14918.001.patch > Remove useless getRedundancyThread from BlockManagerTestUtil >

[jira] [Assigned] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui reassigned HDFS-14918: -- Assignee: Fei Hui > Remove useless getRedundancyThread from BlockManagerTestUtil >

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.004.patch > Consider DataNode load when #getBlockLocation >

[jira] [Assigned] (HDDS-529) Some Ozone DataNode logs go to a separate ozone.log file

2019-10-21 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien reassigned HDDS-529: - Assignee: YiSheng Lien > Some Ozone DataNode logs go to a separate ozone.log file >

[jira] [Created] (HDFS-14917) Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html"

2019-10-21 Thread Xieming Li (Jira)
Xieming Li created HDFS-14917: - Summary: Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html" Key: HDFS-14917 URL: https://issues.apache.org/jira/browse/HDFS-14917 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955916#comment-16955916 ] Ayush Saxena edited comment on HDFS-14915 at 10/21/19 9:53 AM: --- Thanx

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955919#comment-16955919 ] Xiaoqiao He commented on HDFS-14915: +1 for [^HDFS-14915-02.patch] from my side. > Move Superuser

[jira] [Commented] (HDFS-14917) Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html"

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955942#comment-16955942 ] Hadoop QA commented on HDFS-14917: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955947#comment-16955947 ] Hadoop QA commented on HDFS-14915: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Deleted] (HDDS-2338) Avoid buffer copy while submitting write chunk request in Ozone Client

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee deleted HDDS-2338: -- > Avoid buffer copy while submitting write chunk request in Ozone Client >

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955824#comment-16955824 ] Takanobu Asanuma commented on HDFS-14916: - [~risyomei] Thanks for catching the issue. IntelliJ

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955837#comment-16955837 ] Takanobu Asanuma commented on HDFS-14916: - +1 on [^HDFS-14916.001.patch], pending Jenkins. >

[jira] [Comment Edited] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955834#comment-16955834 ] Xieming Li edited comment on HDFS-14916 at 10/21/19 7:48 AM: - [~ayushtkn],

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955846#comment-16955846 ] Fei Hui commented on HDFS-14802: [~ste...@apache.org] [~ayushtkn] Thanks. Upload v004 patch. * Mention

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955882#comment-16955882 ] Hadoop QA commented on HDFS-14916: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14917) Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14917: -- Attachment: HDFS-14917.patch Status: Patch Available (was: Open) > Change the ICON of

[jira] [Updated] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14802: --- Attachment: HDFS-14802.004.patch > The feature of protect directories should be used in RenameOp >

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955857#comment-16955857 ] Hadoop QA commented on HDFS-14916: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-21 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-6524: - Resolution: Not A Problem Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955874#comment-16955874 ] Hadoop QA commented on HDFS-14915: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13736: --- Attachment: HDFS-13736.003.patch > BlockPlacementPolicyDefault can not choose favored nodes when >

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955885#comment-16955885 ] hu xiaodong commented on HDFS-13736: Hello, [~ayushtkn],   I  submitted the third patch as you said.

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955887#comment-16955887 ] Xiaoqiao He commented on HDFS-14915: Thanks [~ayushtkn] for your quick update. We need double

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955856#comment-16955856 ] Shashikant Banerjee commented on HDDS-2331: --- One more point to add here is, as per the cmd,

[jira] [Commented] (HDFS-14753) Document HDFS-8432 (Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases)

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955860#comment-16955860 ] Fei Hui commented on HDFS-14753: :( Document is difficult After HDFS-14509, RollingUpgrade from 2.x to

[jira] [Comment Edited] (HDFS-14753) Document HDFS-8432 (Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases)

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955860#comment-16955860 ] Fei Hui edited comment on HDFS-14753 at 10/21/19 8:18 AM: -- :( Document is

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955915#comment-16955915 ] Hadoop QA commented on HDFS-14882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955916#comment-16955916 ] Ayush Saxena commented on HDFS-14915: - Thanx [~hexiaoqiao] for the review, I think we can track the

[jira] [Updated] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2019-10-21 Thread Ewan Higgs (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11639: -- Status: Patch Available (was: Open) > [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

[jira] [Comment Edited] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2019-10-21 Thread Ewan Higgs (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955929#comment-16955929 ] Ewan Higgs edited comment on HDFS-11639 at 10/21/19 10:03 AM: --

[jira] [Updated] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2019-10-21 Thread Ewan Higgs (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11639: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

[jira] [Created] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Fei Hui (Jira)
Fei Hui created HDFS-14918: -- Summary: Remove useless getRedundancyThread from BlockManagerTestUtil Key: HDFS-14918 URL: https://issues.apache.org/jira/browse/HDFS-14918 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of 'hdfs dfsrouteradmin -ls'

2019-10-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956065#comment-16956065 ] Hudson commented on HDFS-14916: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17555 (See

[jira] [Comment Edited] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956085#comment-16956085 ] Xiaoqiao He edited comment on HDFS-14882 at 10/21/19 1:31 PM: -- Check failed

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-21 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956094#comment-16956094 ] guojh commented on HDFS-14768: -- [~surendrasingh] You can run the UT more times, the UT passed is because in

[jira] [Updated] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14918: Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Remove useless

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956002#comment-16956002 ] Hadoop QA commented on HDFS-14802: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956027#comment-16956027 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.004.patch] looks much better otherwise the

[jira] [Commented] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956035#comment-16956035 ] Ayush Saxena commented on HDFS-14916: - Thanx [~risyomei] for the patch. v001 LGTM +1 > RBF: line

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956033#comment-16956033 ] Ayush Saxena commented on HDFS-14882: - Thanx [~hexiaoqiao] for the patch. {code:java} - -

[jira] [Updated] (HDFS-14916) RBF: line breaks are missing from the output of 'hdfs dfsrouteradmin -ls'

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14916: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956098#comment-16956098 ] Hudson commented on HDFS-14913: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17556 (See

[jira] [Assigned] (HDDS-2301) Write path: Reduce read contention in rocksDB

2019-10-21 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2301: --- Assignee: Supratim Deka (was: Nanda kumar) > Write path: Reduce read contention in

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955971#comment-16955971 ] Hadoop QA commented on HDFS-13736: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13736: --- Attachment: HDFS-13736.004.patch > BlockPlacementPolicyDefault can not choose favored nodes when >

[jira] [Updated] (HDFS-14916) RBF: line breaks are missing from the output of 'hdfs dfsrouteradmin -ls'

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14916: Summary: RBF: line breaks are missing from the output of 'hdfs dfsrouteradmin -ls' (was: RBF:

[jira] [Commented] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956100#comment-16956100 ] Hadoop QA commented on HDFS-14918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-21 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955968#comment-16955968 ] Surendra Singh Lilhore commented on HDFS-14768: --- [~gjhkael], Your UT is passing without fix

[jira] [Comment Edited] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-21 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956094#comment-16956094 ] guojh edited comment on HDFS-14768 at 10/21/19 1:44 PM: [~surendrasingh] You can

[jira] [Commented] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956116#comment-16956116 ] Ayush Saxena commented on HDFS-14918: - Thanx [~ferhui] for the patch. Makes sense removing, it isn't

[jira] [Created] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14919: -- Summary: Provide Non DFS Used per disk in DataNode UI Key: HDFS-14919 URL: https://issues.apache.org/jira/browse/HDFS-14919 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14919: --- Attachment: hadoop3.1_datanode_ui.png hadoop2.6_datanode_ui.png > Provide Non DFS

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956020#comment-16956020 ] Attila Doroszlai commented on HDDS-2331: Thanks [~shashikant] for the tip about setting chunk size

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.006.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956078#comment-16956078 ] Ayush Saxena commented on HDFS-14913: - Committed to trunk, 3.2 and 3.1. Thanx [~leosun08] [~elgoiri]

[jira] [Created] (HDDS-2339) Add OzoneManager to MiniOzoneChaosCluster

2019-10-21 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-2339: --- Summary: Add OzoneManager to MiniOzoneChaosCluster Key: HDDS-2339 URL: https://issues.apache.org/jira/browse/HDDS-2339 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14918) Remove useless getRedundancyThread from BlockManagerTestUtil

2019-10-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956113#comment-16956113 ] Fei Hui commented on HDFS-14918: [~ayushtkn] Could you please take a look? Thanks > Remove useless

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955983#comment-16955983 ] Tsz-wo Sze commented on HDDS-2331: -- Chunk size and array size may not be necessarily the same. Chunk

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955994#comment-16955994 ] hu xiaodong commented on HDFS-13736: Hello, [~hexiaoqiao],    Thanks for your advice. I submitted

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956083#comment-16956083 ] Hadoop QA commented on HDFS-14882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956085#comment-16956085 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn], you are right. [^HDFS-14882.006.patch]

[jira] [Updated] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14913: Fix Version/s: 3.2.2 3.1.4 3.3.0 Hadoop Flags: Reviewed

[jira] [Assigned] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-21 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-14884: Assignee: Mukul Kumar Singh > Add sanity check that zone key equals feinfo key

[jira] [Commented] (HDDS-2328) Support large-scale listing

2019-10-21 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956216#comment-16956216 ] Anu Engineer commented on HDDS-2328: Agree. We should probably do what S3AFileSystem has done. >

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956142#comment-16956142 ] Hadoop QA commented on HDFS-13736: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956239#comment-16956239 ] Hadoop QA commented on HDFS-14882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956276#comment-16956276 ] Wei-Chiu Chuang commented on HDFS-14884: LGTM Nit: {code} import static

[jira] [Comment Edited] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956276#comment-16956276 ] Wei-Chiu Chuang edited comment on HDFS-14884 at 10/21/19 4:55 PM: -- Looks

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

2019-10-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956438#comment-16956438 ] Wei-Chiu Chuang commented on HDFS-13901: +1. Thanks [~LiJinglun] you're obviously smarter than I

[jira] [Created] (HDDS-2343) Add immutable entries in to the DoubleBuffer.

2019-10-21 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2343: Summary: Add immutable entries in to the DoubleBuffer. Key: HDDS-2343 URL: https://issues.apache.org/jira/browse/HDDS-2343 Project: Hadoop Distributed Data

[jira] [Updated] (HDFS-14916) RBF: line breaks are missing from the output of "hdfs dfsrouteradmin -ls"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14916: -- Attachment: HDFS-14916.patch Status: Patch Available (was: Open) > RBF: line breaks are

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-21 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955865#comment-16955865 ] Surendra Singh Lilhore commented on HDFS-14913: --- +1 LGTM > Correct the value of available

[jira] [Updated] (HDFS-14917) Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14917: -- Description: This is a really simple UI change proposal: The icon of "Decommissioned & dead"

[jira] [Assigned] (HDFS-14917) Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html"

2019-10-21 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li reassigned HDFS-14917: - Assignee: Xieming Li > Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html"

[jira] [Commented] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2019-10-21 Thread Ewan Higgs (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955929#comment-16955929 ] Ewan Higgs commented on HDFS-11639: --- https://github.com/apache/hadoop/pull/1665 submitted as a rebase

[jira] [Created] (HDDS-2342) ContainerStateMachine$chunkExecutor threads hold onto native memory

2019-10-21 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-2342: - Summary: ContainerStateMachine$chunkExecutor threads hold onto native memory Key: HDDS-2342 URL: https://issues.apache.org/jira/browse/HDDS-2342 Project: Hadoop

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956429#comment-16956429 ] Hadoop QA commented on HDFS-14884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDDS-2341) Validate tar entry path during extraction

2019-10-21 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2341: -- Summary: Validate tar entry path during extraction Key: HDDS-2341 URL: https://issues.apache.org/jira/browse/HDDS-2341 Project: Hadoop Distributed Data Store

[jira] [Work logged] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-10-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?focusedWorklogId=331606=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-331606 ] ASF GitHub Bot logged work on HDDS-1868: Author: ASF GitHub Bot

  1   2   >