[jira] [Commented] (HDFS-14284) RBF: Log Router identifier when reporting exceptions

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960790#comment-16960790 ] Ayush Saxena commented on HDFS-14284: - Thanx [~hemanthboyina] for the patch. Couple of comments :

[jira] [Comment Edited] (HDFS-14284) RBF: Log Router identifier when reporting exceptions

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960790#comment-16960790 ] Ayush Saxena edited comment on HDFS-14284 at 10/28/19 6:30 AM: --- Thanx

[jira] [Commented] (HDDS-2322) DoubleBuffer flush termination and OM shutdown's after that.

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960802#comment-16960802 ] Li Cheng commented on HDDS-2322: https://issues.apache.org/jira/browse/HDDS-2356 is still having issues.

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960803#comment-16960803 ] Fei Hui commented on HDFS-14920: [~gjhkael] Thanks for review. We should consider this issue overall and

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960817#comment-16960817 ] guojh commented on HDFS-14920: -- Thanks  [~ferhui] I am clear now. You just want to correct the

[jira] [Comment Edited] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960795#comment-16960795 ] Fei Hui edited comment on HDFS-14920 at 10/28/19 7:23 AM: -- [~ayushtkn] Thanks

[jira] [Assigned] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-14907: --- Assignee: Takanobu Asanuma > [Dynamometer] DataNode can't find junit jar when using

[jira] [Commented] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-28 Thread luhuachao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960844#comment-16960844 ] luhuachao commented on HDDS-2370: - [~adoroszlai]  thanks for reply , I would like to work on this.    

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960866#comment-16960866 ] Li Cheng commented on HDDS-2356: MISMATCH_MULTIPART_LIST seems to be a recurring error. Never be able to

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960799#comment-16960799 ] Li Cheng commented on HDDS-2356: [~bharat] In term of reproduction, I have a dataset which includes small

[jira] [Updated] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14907: Status: Patch Available (was: Open) > [Dynamometer] DataNode can't find junit jar when

[jira] [Commented] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960845#comment-16960845 ] Takanobu Asanuma commented on HDFS-14907: - Thanks for your advice, [~xkrogen].

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960786#comment-16960786 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960795#comment-16960795 ] Fei Hui edited comment on HDFS-14920 at 10/28/19 6:39 AM: -- [~ayushtkn] Thanks

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960795#comment-16960795 ] Fei Hui commented on HDFS-14920: [~ayushtkn] Thanks for your review {code} // Sub decommissioning

[jira] [Updated] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14936: --- Attachment: HDFS-14936.001.patch Status: Patch Available (was: Open) > Add

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960879#comment-16960879 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960772#comment-16960772 ] guojh commented on HDFS-14920: -- [~ferhui] If the block group not has all internal blocks,  the 

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960813#comment-16960813 ] Ayush Saxena commented on HDFS-14920: - Where are you using this

[jira] [Commented] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960809#comment-16960809 ] Attila Doroszlai commented on HDDS-2370: Thanks for reporting this problem [~Huachao]. I think

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960829#comment-16960829 ] Fei Hui commented on HDFS-14920: {quote} other storages contains this internal block should be

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960836#comment-16960836 ] Fei Hui commented on HDFS-14920: [~gjhkael] Yes. You got it! > Erasure Coding: Decommission may hang If

[jira] [Comment Edited] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960829#comment-16960829 ] Fei Hui edited comment on HDFS-14920 at 10/28/19 7:58 AM: -- {quote} other

[jira] [Created] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14936: -- Summary: Add getNumOfChildren() for interface InnerNode Key: HDFS-14936 URL: https://issues.apache.org/jira/browse/HDFS-14936 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960783#comment-16960783 ] Ayush Saxena commented on HDFS-14920: - Thanx [~ferhui] for the patch. Couple of comments :

[jira] [Updated] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-28 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.010.patch > EC : Busy DN replica should be consider in live replica check. >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960796#comment-16960796 ] Li Cheng commented on HDDS-2356: Also it's print the same pipeline id in s3g logs like crazy. Wonder if

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960798#comment-16960798 ] Ayush Saxena commented on HDFS-13736: - Thanx [~xiaodong.hu] for the patch. Seems fair enough. There

[jira] [Comment Edited] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960845#comment-16960845 ] Takanobu Asanuma edited comment on HDFS-14907 at 10/28/19 8:07 AM: ---

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-28 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960850#comment-16960850 ] guojh commented on HDFS-14768: -- [~surendrasingh] Thanks for you UT, I update the code and fixed the

[jira] [Reopened] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reopened HDDS-2356: Assignee: (was: Bharat Viswanadham) > Multipart upload report errors while writing to ozone Ratis

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960870#comment-16960870 ] Li Cheng commented on HDDS-2356: I take this Jira to track issues that seem to be related with Multipart

[jira] [Created] (HDDS-2371) Print out the ozone version during the startup instead of hadoop version

2019-10-28 Thread Marton Elek (Jira)
Marton Elek created HDDS-2371: - Summary: Print out the ozone version during the startup instead of hadoop version Key: HDDS-2371 URL: https://issues.apache.org/jira/browse/HDDS-2371 Project: Hadoop

[jira] [Created] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-28 Thread Marton Elek (Jira)
Marton Elek created HDDS-2372: - Summary: Datanode pipeline is failing with NoSuchFileException Key: HDDS-2372 URL: https://issues.apache.org/jira/browse/HDDS-2372 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2255) Improve Acl Handler Messages

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2255: - Labels: newbie pull-request-available (was: newbie) > Improve Acl Handler Messages >

[jira] [Work logged] (HDDS-2255) Improve Acl Handler Messages

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2255?focusedWorklogId=334892=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-334892 ] ASF GitHub Bot logged work on HDDS-2255: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960962#comment-16960962 ] Ayush Saxena commented on HDFS-14920: - {code:java} if (!liveBitSet.get(blockIndex)) {

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960979#comment-16960979 ] Lisheng Sun commented on HDFS-14936: [~ayushtkn] all of subclasses of InnerNode as follow:

[jira] [Created] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14938: -- Summary: Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType() Key: HDFS-14938 URL: https://issues.apache.org/jira/browse/HDFS-14938

[jira] [Commented] (HDFS-8631) WebHDFS : Support setQuota

2019-10-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961004#comment-16961004 ] Steve Loughran commented on HDFS-8631: -- Hi, just noticed this. Can can I remind people that I that

[jira] [Assigned] (HDDS-2371) Print out the ozone version during the startup instead of hadoop version

2019-10-28 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien reassigned HDDS-2371: -- Assignee: YiSheng Lien > Print out the ozone version during the startup instead of hadoop

[jira] [Updated] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread xuzq (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuzq updated HDFS-14937: Attachment: HDFS-14937-trunk-001.patch Status: Patch Available (was: Open) > [SBN read]

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960940#comment-16960940 ] Ayush Saxena commented on HDFS-14936: - But InnerNode is extended not only by {{InnerNodeImpl}} and

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960967#comment-16960967 ] Hadoop QA commented on HDFS-14937: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960969#comment-16960969 ] Hadoop QA commented on HDFS-14936: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread xuzq (Jira)
xuzq created HDFS-14937: --- Summary: [SBN read] ObserverReadProxyProvider should throw InterruptException Key: HDFS-14937 URL: https://issues.apache.org/jira/browse/HDFS-14937 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14938: --- Attachment: HDFS-14938.001.patch Status: Patch Available (was: Open) > Add check if

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960994#comment-16960994 ] Ayush Saxena commented on HDFS-14936: - Seems OK. +1 Will commit by tomorrow, if no comments. > Add

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961042#comment-16961042 ] Fei Hui commented on HDFS-14920: [~ayushtkn] Upload v003 patch. Added a new UT testCountNodes. Please

[jira] [Updated] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14920: --- Attachment: HDFS-14920.003.patch > Erasure Coding: Decommission may hang If one or more datanodes are out of

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961123#comment-16961123 ] Xiaoqiao He commented on HDFS-14882: Thanks [~pifta] for your suggestions, [^HDFS-14882.suggestion]

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-14882: Attachment: HDFS-14882.suggestion > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961023#comment-16961023 ] Istvan Fajth commented on HDFS-14882: - Hello [~hexiaoqiao], I was checking into the patch, and into

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961096#comment-16961096 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.006.patch] LGTM, check the failed unit tests, it is

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961146#comment-16961146 ] Hadoop QA commented on HDFS-14938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961178#comment-16961178 ] Lisheng Sun commented on HDFS-14935: [~ayushtkn] Could you have time to take a reivew for the 003

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961223#comment-16961223 ] Bharat Viswanadham commented on HDDS-2356: -- {quote}Also it's print the same pipeline id in s3g

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14938: --- Attachment: HDFS-14938.002.patch > Add check if excludedNodes contain scope in >

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961199#comment-16961199 ] Hadoop QA commented on HDFS-14920: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961223#comment-16961223 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/28/19 4:26 PM:

[jira] [Commented] (HDFS-14931) hdfs crypto commands limit column width

2019-10-28 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961244#comment-16961244 ] Hudson commented on HDFS-14931: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17578 (See

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961151#comment-16961151 ] Erik Krogen commented on HDFS-14937: FYI [~shv] [~vagarychen] [~csun] > [SBN read]

[jira] [Assigned] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14936: -- Assignee: Lisheng Sun > Add getNumOfChildren() for interface InnerNode >

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961248#comment-16961248 ] Chen Liang commented on HDFS-14937: --- Thanks for reporting this [~xuzq_zander]. v001 patch makes sense

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961271#comment-16961271 ] Hadoop QA commented on HDFS-14882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961275#comment-16961275 ] Íñigo Goiri commented on HDFS-14936: How is the test coverage for this? This is indirectly tested by

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14938: --- Description: Add check if excludedNodes contain scope in

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961280#comment-16961280 ] Íñigo Goiri commented on HDFS-14882: In the past, we have had many issues with the sorting for blocks

[jira] [Work logged] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2373?focusedWorklogId=335081=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335081 ] ASF GitHub Bot logged work on HDDS-2373: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2373: - Labels: pull-request-available (was: ) > Move isUseRatis getFactor and getType from

[jira] [Resolved] (HDDS-2285) GetBlock and ReadChunk commands should be sent to the same datanode

2019-10-28 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-2285. -- Fix Version/s: 0.5.0 Resolution: Fixed > GetBlock and ReadChunk commands should be sent

[jira] [Work logged] (HDDS-2285) GetBlock and ReadChunk commands should be sent to the same datanode

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2285?focusedWorklogId=335080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335080 ] ASF GitHub Bot logged work on HDDS-2285: Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-14938: -- Assignee: Lisheng Sun > Add check if excludedNodes contain scope in >

[jira] [Commented] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961293#comment-16961293 ] Ayush Saxena commented on HDFS-14935: - Is this just replacing {{"/"}} with

[jira] [Assigned] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDDS-2373: -- Assignee: Istvan Fajth > Move isUseRatis getFactor and getType from XCeiverClientManager >

[jira] [Created] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2373: -- Summary: Move isUseRatis getFactor and getType from XCeiverClientManager Key: HDDS-2373 URL: https://issues.apache.org/jira/browse/HDDS-2373 Project: Hadoop Distributed

[jira] [Updated] (HDDS-2285) GetBlock and ReadChunk commands should be sent to the same datanode

2019-10-28 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-2285: - Summary: GetBlock and ReadChunk commands should be sent to the same datanode (was: GetBlock and

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Fix Version/s: 2.10.0 > Cost-Based RPC FairCallQueue > > >

[jira] [Created] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-28 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2375: Summary: Refactor BlockOutputStream to allow flexible buffering Key: HDDS-2375 URL: https://issues.apache.org/jira/browse/HDDS-2375 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961476#comment-16961476 ] Leon Gao commented on HDFS-14927: - Fix checkstyle ^ [~elgoiri] I think the failure is unrelated (the

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961582#comment-16961582 ] Íñigo Goiri commented on HDFS-14927: A couple style comments: * In TestRouterClientRejectOverload#373

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13736: --- Attachment: HDFS-13736.007.patch > BlockPlacementPolicyDefault can not choose favored nodes when >

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961568#comment-16961568 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/29/19 12:10 AM: -

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961568#comment-16961568 ] Bharat Viswanadham commented on HDDS-2356: -- [~bharat] In term of reproduction, I have a dataset

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-10-28 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Release Note: This feature allows HDFS to selectively enforce encryption for both RPC (NameNode) and

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961459#comment-16961459 ] Hadoop QA commented on HDFS-14927: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-10-28 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-14730: - Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available) I just

[jira] [Work logged] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?focusedWorklogId=335302=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335302 ] ASF GitHub Bot logged work on HDDS-2374: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-2374. Fix Version/s: 0.5.0 Resolution: Fixed merged to the master > Make Ozone Readme.txt point

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon Gao updated HDFS-14927: Attachment: HDFS-14927.003.patch > RBF: Add metrics for async callers thread pool >

[jira] [Commented] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-10-28 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961555#comment-16961555 ] Hudson commented on HDFS-14730: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17579 (See

[jira] [Assigned] (HDDS-2041) Don't depend on DFSUtil to check HTTP policy

2019-10-28 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDDS-2041: -- Assignee: Xiaoyu Yao (was: Vivek Ratnavel Subramanian) > Don't depend on

[jira] [Updated] (HDDS-2041) Don't depend on DFSUtil to check HTTP policy

2019-10-28 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-2041: --- Priority: Blocker (was: Major) > Don't depend on DFSUtil to check HTTP policy >

[jira] [Work logged] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?focusedWorklogId=335244=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335244 ] ASF GitHub Bot logged work on HDDS-2374: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2374: - Labels: pull-request-available (was: ) > Make Ozone Readme.txt point to the Ozone websites

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961585#comment-16961585 ] hu xiaodong commented on HDFS-13736: Hello, [~hexiaoqiao],    I have submitted 

[jira] [Work logged] (HDDS-2345) Add a UT for newly added clone() in OmBucketInfo

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2345?focusedWorklogId=335248=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335248 ] ASF GitHub Bot logged work on HDDS-2345: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2345) Add a UT for newly added clone() in OmBucketInfo

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2345. -- Fix Version/s: 0.5.0 Resolution: Fixed > Add a UT for newly added clone() in

[jira] [Commented] (HDDS-2322) DoubleBuffer flush termination and OM shutdown's after that.

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961566#comment-16961566 ] Bharat Viswanadham commented on HDDS-2322: -- [~timmylicheng] The new issue is which is showing up

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2019-10-28 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961507#comment-16961507 ] Tsz-wo Sze commented on HDFS-13671: --- There may be some ways to improve the performance of

  1   2   >