[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501405=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501405 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15633: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501404=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501404 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215177#comment-17215177 ] Hadoop QA commented on HDFS-15630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215153#comment-17215153 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215137#comment-17215137 ] Hui Fei commented on HDFS-15630: [~smarthan] Thanks for you patch. Some comments {code:java} +if

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215132#comment-17215132 ] Chengwei Wang commented on HDFS-15630: -- Submit patch v003 to fix the java doc and UT. [~elgoiri]

[jira] [Assigned] (HDFS-14383) Compute datanode load based on StoragePolicy

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-14383: --- Assignee: Ayush Saxena > Compute datanode load based on StoragePolicy >

[jira] [Updated] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HDFS-15630: - Attachment: HDFS-15630.003.patch > RBF: Fix wrong client IP info in CallerContext when requests

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501366=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501366 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15634?focusedWorklogId=501363=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501363 ] ASF GitHub Bot logged work on HDFS-15634: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501360=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501360 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501359=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501359 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501358=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501358 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618.003.patch > Improve datanode shutdown latency >

[jira] [Work logged] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15634?focusedWorklogId=501332=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501332 ] ASF GitHub Bot logged work on HDFS-15634: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215060#comment-17215060 ] Fengnan Li commented on HDFS-15634: --- [~elgoiri] Thanks for the quick feedback. I have included a WIP

[jira] [Updated] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15634: -- Labels: pull-request-available (was: ) > Invalidate block on decommissioning DataNode after

[jira] [Work logged] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15634?focusedWorklogId=501325=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501325 ] ASF GitHub Bot logged work on HDFS-15634: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214965#comment-17214965 ] Íñigo Goiri commented on HDFS-15634: The proposal makes sense. The only issue is that at the scale

[jira] [Commented] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214923#comment-17214923 ] Fengnan Li commented on HDFS-15634: --- [~ayushtkn] [~inigoiri] [~weichiu] Can you share your thoughts? >

[jira] [Created] (HDFS-15634) Invalidate block on decommissioning DataNode after replication

2020-10-15 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15634: - Summary: Invalidate block on decommissioning DataNode after replication Key: HDFS-15634 URL: https://issues.apache.org/jira/browse/HDFS-15634 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214816#comment-17214816 ] Íñigo Goiri commented on HDFS-15630: [~smarthan], something like that. Before the caller context was

[jira] [Commented] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214798#comment-17214798 ] Íñigo Goiri commented on HDFS-15459: I'm just slightly familiar with EC so I cannot tell if this is

[jira] [Commented] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-10-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214789#comment-17214789 ] Ahmed Hussein commented on HDFS-15459: -- [~weichiu], [~inigoiri] Can you please take a look that

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501117=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501117 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2020-10-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214754#comment-17214754 ] Ahmed Hussein commented on HDFS-15618: -- I will try to set it is a smaller value. Last thing I tried

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=501093=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501093 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

2020-10-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214683#comment-17214683 ] Hadoop QA commented on HDFS-15631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501088=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501088 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

2020-10-15 Thread Shen Yinjie (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie updated HDFS-15631: --- Status: Patch Available (was: Open) > RBF: dfsadmin -report multiple capacity and used info >

[jira] [Updated] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

2020-10-15 Thread Shen Yinjie (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie updated HDFS-15631: --- Attachment: HDFS-15631_1.patch > RBF: dfsadmin -report multiple capacity and used info >

[jira] [Comment Edited] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-10-15 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214628#comment-17214628 ] Junfan Zhang edited comment on HDFS-15289 at 10/15/20, 11:50 AM: - Hi

[jira] [Comment Edited] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-10-15 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214628#comment-17214628 ] Junfan Zhang edited comment on HDFS-15289 at 10/15/20, 11:47 AM: - Hi

[jira] [Commented] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-10-15 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214628#comment-17214628 ] Junfan Zhang commented on HDFS-15289: - Hi [~umamaheswararao] Thanks your post. We have also

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501073=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501073 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14383) Compute datanode load based on StoragePolicy

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214617#comment-17214617 ] Ayush Saxena commented on HDFS-14383: - Thanx [~elgoiri] for the review. Have handled the comments i

[jira] [Commented] (HDFS-14383) Compute datanode load based on StoragePolicy

2020-10-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214612#comment-17214612 ] Hadoop QA commented on HDFS-14383: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214577#comment-17214577 ] Chengwei Wang commented on HDFS-15630: -- [~elgoiri]  Thanks for the review.  {quote}To avoid churn,

[jira] [Work logged] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?focusedWorklogId=501040=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-501040 ] ASF GitHub Bot logged work on HDFS-15633: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

2020-10-15 Thread Pierre Villard (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Villard updated HDFS-15191: -- Fix Version/s: (was: 3.3.1) 3.3.0 > EOF when reading legacy buffer in

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

2020-10-15 Thread Pierre Villard (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214526#comment-17214526 ] Pierre Villard commented on HDFS-15191: --- Updated the fix versions as this is in 3.3.0:

[jira] [Updated] (HDFS-14383) Compute datanode load based on StoragePolicy

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14383: Attachment: HDFS-14383-02.patch > Compute datanode load based on StoragePolicy >

[jira] [Updated] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15633: Status: Patch Available (was: Open) > Avoid redundant RPC calls for getDiskStatus >

[jira] [Commented] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214478#comment-17214478 ] Ayush Saxena commented on HDFS-15631: - Go ahead, feel free to shoot a patch, do include a test as

[jira] [Updated] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

2020-10-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15631: Summary: RBF: dfsadmin -report multiple capacity and used info (was: dfsadmin -report with RBF

[jira] [Commented] (HDFS-14383) Compute datanode load based on StoragePolicy

2020-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214464#comment-17214464 ] Íñigo Goiri commented on HDFS-14383: Minor comments: * When initializing the

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2020-10-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214462#comment-17214462 ] Íñigo Goiri commented on HDFS-15630: To avoid churn, let's keep the all method signature at the