[jira] [Work logged] (HDFS-16089) EC: Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16089?focusedWorklogId=615493=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615493 ] ASF GitHub Bot logged work on HDFS-16089: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=615500=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615500 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?focusedWorklogId=615603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615603 ] ASF GitHub Bot logged work on HDFS-16092: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=615504=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615504 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=615505=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615505 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16089) EC: Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16089?focusedWorklogId=615487=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615487 ] ASF GitHub Bot logged work on HDFS-16089: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=615503=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615503 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=615627=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615627 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?focusedWorklogId=615637=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615637 ] ASF GitHub Bot logged work on HDFS-16092: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-14839: -- Labels: pull-request-available (was: ) > Use Java Concurrent BlockingQueue instead of

[jira] [Commented] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2021-06-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370730#comment-17370730 ] Hadoop QA commented on HDFS-14839: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14839?focusedWorklogId=615686=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615686 ] ASF GitHub Bot logged work on HDFS-14839: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370995#comment-17370995 ] Daniel Ma commented on HDFS-15796: -- [~weichiu]  No idea what kind of condition can reproduce this

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370995#comment-17370995 ] Daniel Ma edited comment on HDFS-15796 at 6/29/21, 2:35 AM: [~weichiu]  No

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=615967=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615967 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=615968=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615968 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=615969=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615969 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16094) HDFS start failed owing to daemon pid file is not cleared in some exception senario

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-16094: - Summary: HDFS start failed owing to daemon pid file is not cleared in some exception senario (was:

[jira] [Created] (HDFS-16094) NameNode start failed owing to daemon pid file is not cleared in some exception senario

2021-06-28 Thread Daniel Ma (Jira)
Daniel Ma created HDFS-16094: Summary: NameNode start failed owing to daemon pid file is not cleared in some exception senario Key: HDFS-16094 URL: https://issues.apache.org/jira/browse/HDFS-16094

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370995#comment-17370995 ] Daniel Ma edited comment on HDFS-15796 at 6/29/21, 2:36 AM: [~weichiu]  No

[jira] [Created] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause badly

2021-06-28 Thread Daniel Ma (Jira)
Daniel Ma created HDFS-16093: Summary: DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause badly competation on disk IO.

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

2021-06-28 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371008#comment-17371008 ] tomscut commented on HDFS-16093: Hi [~Daniel Ma], may I ask if 

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371015#comment-17371015 ] Daniel Ma commented on HDFS-16093: -- Hi [~tomscut], thanks for your quick reply. The Jira you mentioned

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=615970=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615970 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16094) HDFS balancer process start failed owing to daemon pid file is not cleared in some exception senario

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-16094: - Description: HDFS balancer process start failed owing to daemon pid file is not cleared in some

[jira] [Updated] (HDFS-16094) HDFS balancer process start failed owing to daemon pid file is not cleared in some exception senario

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-16094: - Summary: HDFS balancer process start failed owing to daemon pid file is not cleared in some exception

[jira] [Created] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

2021-06-28 Thread Xiangyi Zhu (Jira)
Xiangyi Zhu created HDFS-16095: -- Summary: Add lsQuotaList command and getQuotaListing api for hdfs quota Key: HDFS-16095 URL: https://issues.apache.org/jira/browse/HDFS-16095 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16095: -- Labels: pull-request-available (was: ) > Add lsQuotaList command and getQuotaListing api for

[jira] [Work logged] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16095?focusedWorklogId=615994=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615994 ] ASF GitHub Bot logged work on HDFS-16095: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370997#comment-17370997 ] Daniel Ma commented on HDFS-15796: -- [~sodonnell] We have made some modifications based on OS version,

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370995#comment-17370995 ] Daniel Ma edited comment on HDFS-15796 at 6/29/21, 2:33 AM: [~weichiu]  No

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370995#comment-17370995 ] Daniel Ma edited comment on HDFS-15796 at 6/29/21, 2:34 AM: [~weichiu]  No

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=615975=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615975 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

2021-06-28 Thread Daniel Ma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370995#comment-17370995 ] Daniel Ma edited comment on HDFS-15796 at 6/29/21, 2:32 AM: [~weichiu]  No

[jira] [Commented] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

2021-06-28 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370482#comment-17370482 ] tomscut commented on HDFS-16088: Hi [~hexiaoqiao] [~tasanuma], could you please take a look at this small

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=615498=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615498 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15936) Solve BlockSender#sendPacket() does not record SocketTimeout exception

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15936?focusedWorklogId=615873=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615873 ] ASF GitHub Bot logged work on HDFS-15936: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?focusedWorklogId=615917=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615917 ] ASF GitHub Bot logged work on HDFS-16092: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15650) Make the socket timeout for computing checksum of striped blocks configurable

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15650?focusedWorklogId=615736=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615736 ] ASF GitHub Bot logged work on HDFS-15650: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15329?focusedWorklogId=615754=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615754 ] ASF GitHub Bot logged work on HDFS-15329: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16028) Add a configuration item for special trash dir

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16028?focusedWorklogId=615779=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615779 ] ASF GitHub Bot logged work on HDFS-16028: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?focusedWorklogId=615792=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615792 ] ASF GitHub Bot logged work on HDFS-16092: - Author: ASF GitHub Bot

[jira] [Work started] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16092 started by Viraj Jasani. --- > Avoid creating LayoutFlags redundant objects >

[jira] [Updated] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16090: Status: Patch Available (was: In Progress) > Fine grained locking for datanodeNetworkCounts >

[jira] [Work started] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16090 started by Viraj Jasani. --- > Fine grained locking for datanodeNetworkCounts >

[jira] [Updated] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16092: Target Version/s: 3.4.0, 3.2.3, 3.3.2 > Avoid creating LayoutFlags redundant objects >

[jira] [Updated] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

2021-06-28 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16090: Target Version/s: 3.4.0, 3.2.3, 3.3.2 (was: 3.4.0, 3.3.2) > Fine grained locking for

[jira] [Updated] (HDFS-16092) Avoid creating LayoutFlags redundant objects

2021-06-28 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16092: Status: Patch Available (was: In Progress) > Avoid creating LayoutFlags redundant objects >