[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961700#comment-16961700 ] Hadoop QA commented on HDFS-14936: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-28 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961692#comment-16961692 ] Surendra Singh Lilhore commented on HDFS-14768: --- Changes LGTM.  [~ayushtkn] , [~weichiu]

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961689#comment-16961689 ] Surendra Singh Lilhore commented on HDFS-14920: --- [~ferhui], Thanks for jira. Nice catch.

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961683#comment-16961683 ] Hadoop QA commented on HDFS-14927: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-28 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961682#comment-16961682 ] Surendra Singh Lilhore commented on HDFS-14768: --- [~ferhui], This issue is different from

[jira] [Commented] (HDFS-14922) On StartUp , Snapshot modification time got changed

2019-10-28 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961680#comment-16961680 ] hemanthboyina commented on HDFS-14922: -- can you review the patch [~elgoiri] [~tasanuma] > On

[jira] [Updated] (HDDS-2355) Om double buffer flush termination with rocksdb error

2019-10-28 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2355: Issue Type: Bug (was: Task) > Om double buffer flush termination with rocksdb error >

[jira] [Commented] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961676#comment-16961676 ] Takanobu Asanuma commented on HDFS-14824: - Hi [~xkrogen], seems the feature is important. Does

[jira] [Updated] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-10-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1569: - Fix Version/s: HDDS-1564 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Work logged] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?focusedWorklogId=335380=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335380 ] ASF GitHub Bot logged work on HDDS-1569: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961664#comment-16961664 ] Hadoop QA commented on HDFS-13736: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8631) WebHDFS : Support setQuota

2019-10-28 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961660#comment-16961660 ] Surendra Singh Lilhore commented on HDFS-8631: -- Thanks [~ste...@apache.org] . Created new

[jira] [Updated] (HDDS-2363) Fail to create Ratis container

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Fail to create Ratis container (was: Fail to create Ratis pipeline ) > Fail to create Ratis

[jira] [Created] (HDFS-14939) Update documnet and UT tests for Quota API.

2019-10-28 Thread Surendra Singh Lilhore (Jira)
Surendra Singh Lilhore created HDFS-14939: - Summary: Update documnet and UT tests for Quota API. Key: HDFS-14939 URL: https://issues.apache.org/jira/browse/HDFS-14939 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon Gao updated HDFS-14927: Attachment: HDFS-14927.004.patch > RBF: Add metrics for async callers thread pool >

[jira] [Commented] (HDFS-9913) DistCp to add -useTrash to move deleted files to Trash

2019-10-28 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961639#comment-16961639 ] Jinglun commented on HDFS-9913: --- Great work ! To be safe I don't want to delete anything directly so the

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Description: Error logs; 2019-10-29 10:24:59,553 [pool-7-thread-1] ERROR -

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Priority: Critical (was: Major) > Fail to create Ratis pipeline > -- > >

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Fail to create Ratis pipeline (was: Improve datanode write failure log) > Fail to create

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Issue Type: Bug (was: Improvement) > Fail to create Ratis pipeline > -- > >

[jira] [Commented] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-10-28 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961616#comment-16961616 ] Chen Zhang commented on HDFS-14730: --- Thanks [~eyang] > Remove unused configuration

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-28 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961613#comment-16961613 ] Tsz-wo Sze commented on HDDS-2331: -- Created HDDS-2375 to refactor the code. Will implement chunk buffer

[jira] [Commented] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961610#comment-16961610 ] Lisheng Sun commented on HDFS-14935: yeah, i think it is necessary to replace "/" with the constant

[jira] [Assigned] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-2356: -- Assignee: Bharat Viswanadham > Multipart upload report errors while writing to ozone Ratis pipeline >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961607#comment-16961607 ] Li Cheng commented on HDDS-2356: [~bharat] The long printing logs happen only in your branch tho. The full

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961604#comment-16961604 ] Li Cheng edited comment on HDDS-2356 at 10/29/19 2:29 AM: -- [~bharat] I'm using

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961606#comment-16961606 ] Lisheng Sun commented on HDFS-14936: Thanks[~elgoiri] for your suggestion. i add UT for this patch.

[jira] [Work logged] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?focusedWorklogId=335349=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335349 ] ASF GitHub Bot logged work on HDDS-2375: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2375: - Labels: pull-request-available (was: ) > Refactor BlockOutputStream to allow flexible buffering

[jira] [Updated] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14936: --- Attachment: HDFS-14936.002.patch > Add getNumOfChildren() for interface InnerNode >

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961604#comment-16961604 ] Li Cheng edited comment on HDDS-2356 at 10/29/19 2:25 AM: -- [~bharat] I'm using

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961604#comment-16961604 ] Li Cheng edited comment on HDDS-2356 at 10/29/19 2:24 AM: -- [~bharat] I'm using

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961604#comment-16961604 ] Li Cheng commented on HDDS-2356: [~bharat] I'm using python to write to a OS path. sth like: for sub_file

[jira] [Created] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-28 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2375: Summary: Refactor BlockOutputStream to allow flexible buffering Key: HDDS-2375 URL: https://issues.apache.org/jira/browse/HDDS-2375 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961585#comment-16961585 ] hu xiaodong commented on HDFS-13736: Hello, [~hexiaoqiao],    I have submitted 

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread hu xiaodong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13736: --- Attachment: HDFS-13736.007.patch > BlockPlacementPolicyDefault can not choose favored nodes when >

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961582#comment-16961582 ] Íñigo Goiri commented on HDFS-14927: A couple style comments: * In TestRouterClientRejectOverload#373

[jira] [Resolved] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-2374. Fix Version/s: 0.5.0 Resolution: Fixed merged to the master > Make Ozone Readme.txt point

[jira] [Work logged] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?focusedWorklogId=335302=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335302 ] ASF GitHub Bot logged work on HDDS-2374: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961568#comment-16961568 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/29/19 12:10 AM: -

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961568#comment-16961568 ] Bharat Viswanadham commented on HDDS-2356: -- [~bharat] In term of reproduction, I have a dataset

[jira] [Commented] (HDDS-2322) DoubleBuffer flush termination and OM shutdown's after that.

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961566#comment-16961566 ] Bharat Viswanadham commented on HDDS-2322: -- [~timmylicheng] The new issue is which is showing up

[jira] [Commented] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-10-28 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961555#comment-16961555 ] Hudson commented on HDFS-14730: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17579 (See

[jira] [Updated] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-10-28 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-14730: - Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available) I just

[jira] [Resolved] (HDDS-2345) Add a UT for newly added clone() in OmBucketInfo

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2345. -- Fix Version/s: 0.5.0 Resolution: Fixed > Add a UT for newly added clone() in

[jira] [Work logged] (HDDS-2345) Add a UT for newly added clone() in OmBucketInfo

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2345?focusedWorklogId=335248=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335248 ] ASF GitHub Bot logged work on HDDS-2345: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2374: - Labels: pull-request-available (was: ) > Make Ozone Readme.txt point to the Ozone websites

[jira] [Work logged] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2374?focusedWorklogId=335244=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335244 ] ASF GitHub Bot logged work on HDDS-2374: Author: ASF GitHub Bot

[jira] [Created] (HDDS-2374) Make Ozone Readme.txt point to the Ozone websites instead of Hadoop.

2019-10-28 Thread Anu Engineer (Jira)
Anu Engineer created HDDS-2374: -- Summary: Make Ozone Readme.txt point to the Ozone websites instead of Hadoop. Key: HDDS-2374 URL: https://issues.apache.org/jira/browse/HDDS-2374 Project: Hadoop

[jira] [Updated] (HDDS-2041) Don't depend on DFSUtil to check HTTP policy

2019-10-28 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-2041: --- Priority: Blocker (was: Major) > Don't depend on DFSUtil to check HTTP policy >

[jira] [Assigned] (HDDS-2041) Don't depend on DFSUtil to check HTTP policy

2019-10-28 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDDS-2041: -- Assignee: Xiaoyu Yao (was: Vivek Ratnavel Subramanian) > Don't depend on

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2019-10-28 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961507#comment-16961507 ] Tsz-wo Sze commented on HDFS-13671: --- There may be some ways to improve the performance of

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961476#comment-16961476 ] Leon Gao commented on HDFS-14927: - Fix checkstyle ^ [~elgoiri] I think the failure is unrelated (the

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961459#comment-16961459 ] Hadoop QA commented on HDFS-14927: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-28 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon Gao updated HDFS-14927: Attachment: HDFS-14927.003.patch > RBF: Add metrics for async callers thread pool >

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-10-28 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Release Note: This feature allows HDFS to selectively enforce encryption for both RPC (NameNode) and

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Release Note: This adds an extension to the IPC FairCallQueue which allows for the consideration of

[jira] [Updated] (HDFS-14931) hdfs crypto commands limit column width

2019-10-28 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-14931: --- Resolution: Fixed Status: Resolved (was: Patch Available) > hdfs crypto commands limit

[jira] [Updated] (HDFS-14931) hdfs crypto commands limit column width

2019-10-28 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-14931: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 3.0.4

[jira] [Updated] (HDFS-14912) Set dfs.image.string-tables.expanded default to false in branch-2.7

2019-10-28 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14912: --- Fix Version/s: 2.7.8 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14730) Remove unused configuration dfs.web.authentication.filter

2019-10-28 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961343#comment-16961343 ] Eric Yang commented on HDFS-14730: -- +1 for patch 002. Will commit to trunk if no objections.

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Fix Version/s: 2.10.0 > Cost-Based RPC FairCallQueue > > >

[jira] [Work logged] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2373?focusedWorklogId=335081=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335081 ] ASF GitHub Bot logged work on HDDS-2373: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2373: - Labels: pull-request-available (was: ) > Move isUseRatis getFactor and getType from

[jira] [Work logged] (HDDS-2285) GetBlock and ReadChunk commands should be sent to the same datanode

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2285?focusedWorklogId=335080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335080 ] ASF GitHub Bot logged work on HDDS-2285: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2285) GetBlock and ReadChunk commands should be sent to the same datanode

2019-10-28 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-2285. -- Fix Version/s: 0.5.0 Resolution: Fixed > GetBlock and ReadChunk commands should be sent

[jira] [Updated] (HDDS-2285) GetBlock and ReadChunk commands should be sent to the same datanode

2019-10-28 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-2285: - Summary: GetBlock and ReadChunk commands should be sent to the same datanode (was: GetBlock and

[jira] [Created] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2373: -- Summary: Move isUseRatis getFactor and getType from XCeiverClientManager Key: HDDS-2373 URL: https://issues.apache.org/jira/browse/HDDS-2373 Project: Hadoop Distributed

[jira] [Assigned] (HDDS-2373) Move isUseRatis getFactor and getType from XCeiverClientManager

2019-10-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDDS-2373: -- Assignee: Istvan Fajth > Move isUseRatis getFactor and getType from XCeiverClientManager >

[jira] [Commented] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961293#comment-16961293 ] Ayush Saxena commented on HDFS-14935: - Is this just replacing {{"/"}} with

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961280#comment-16961280 ] Íñigo Goiri commented on HDFS-14882: In the past, we have had many issues with the sorting for blocks

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14938: --- Description: Add check if excludedNodes contain scope in

[jira] [Assigned] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-14938: -- Assignee: Lisheng Sun > Add check if excludedNodes contain scope in >

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961275#comment-16961275 ] Íñigo Goiri commented on HDFS-14936: How is the test coverage for this? This is indirectly tested by

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961271#comment-16961271 ] Hadoop QA commented on HDFS-14882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961248#comment-16961248 ] Chen Liang commented on HDFS-14937: --- Thanks for reporting this [~xuzq_zander]. v001 patch makes sense

[jira] [Commented] (HDFS-14931) hdfs crypto commands limit column width

2019-10-28 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961244#comment-16961244 ] Hudson commented on HDFS-14931: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17578 (See

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961223#comment-16961223 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/28/19 4:26 PM:

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961223#comment-16961223 ] Bharat Viswanadham commented on HDDS-2356: -- {quote}Also it's print the same pipeline id in s3g

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961199#comment-16961199 ] Hadoop QA commented on HDFS-14920: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961178#comment-16961178 ] Lisheng Sun commented on HDFS-14935: [~ayushtkn] Could you have time to take a reivew for the 003

[jira] [Assigned] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14936: -- Assignee: Lisheng Sun > Add getNumOfChildren() for interface InnerNode >

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14938: --- Attachment: HDFS-14938.002.patch > Add check if excludedNodes contain scope in >

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961151#comment-16961151 ] Erik Krogen commented on HDFS-14937: FYI [~shv] [~vagarychen] [~csun] > [SBN read]

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961146#comment-16961146 ] Hadoop QA commented on HDFS-14938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961123#comment-16961123 ] Xiaoqiao He commented on HDFS-14882: Thanks [~pifta] for your suggestions, [^HDFS-14882.suggestion]

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961096#comment-16961096 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.006.patch] LGTM, check the failed unit tests, it is

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961042#comment-16961042 ] Fei Hui commented on HDFS-14920: [~ayushtkn] Upload v003 patch. Added a new UT testCountNodes. Please

[jira] [Updated] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14920: --- Attachment: HDFS-14920.003.patch > Erasure Coding: Decommission may hang If one or more datanodes are out of

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-14882: Attachment: HDFS-14882.suggestion > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961023#comment-16961023 ] Istvan Fajth commented on HDFS-14882: - Hello [~hexiaoqiao], I was checking into the patch, and into

[jira] [Commented] (HDFS-8631) WebHDFS : Support setQuota

2019-10-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961004#comment-16961004 ] Steve Loughran commented on HDFS-8631: -- Hi, just noticed this. Can can I remind people that I that

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960994#comment-16960994 ] Ayush Saxena commented on HDFS-14936: - Seems OK. +1 Will commit by tomorrow, if no comments. > Add

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14938: --- Attachment: HDFS-14938.001.patch Status: Patch Available (was: Open) > Add check if

[jira] [Created] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14938: -- Summary: Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType() Key: HDFS-14938 URL: https://issues.apache.org/jira/browse/HDFS-14938

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960979#comment-16960979 ] Lisheng Sun commented on HDFS-14936: [~ayushtkn] all of subclasses of InnerNode as follow:

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960969#comment-16960969 ] Hadoop QA commented on HDFS-14936: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960967#comment-16960967 ] Hadoop QA commented on HDFS-14937: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960962#comment-16960962 ] Ayush Saxena commented on HDFS-14920: - {code:java} if (!liveBitSet.get(blockIndex)) {

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960940#comment-16960940 ] Ayush Saxena commented on HDFS-14936: - But InnerNode is extended not only by {{InnerNodeImpl}} and

  1   2   >