[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-15796: - Attachment: 0002-HDFS-15796.patch > ConcurrentModificationException error happens on NameNode

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-15796: - Attachment: (was: 0001-HDFS-15796.patch) > ConcurrentModificationException error happens on NameNode

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-15796: - Attachment: (was: 0002-HDFS-15796.patch) > ConcurrentModificationException error happens on NameNode

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-15796: - Attachment: (was: 0003-HDFS-15796.patch) > ConcurrentModificationException error happens on NameNode

[jira] [Commented] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376571#comment-17376571 ] Daniel Ma commented on HDFS-16115: -- hello [~hexiaoqiao]. Thanks for review,  1-For non-fatal error, I

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376667#comment-17376667 ] Stephen O'Donnell commented on HDFS-15796: -- Thanks [~Daniel Ma] - the latest patch looks better.

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-15796: - Attachment: HDFS-15796-0001.patch > ConcurrentModificationException error happens on NameNode

[jira] [Work logged] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?focusedWorklogId=619936=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619936 ] ASF GitHub Bot logged work on HDFS-16087: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376586#comment-17376586 ] Daniel Ma edited comment on HDFS-15796 at 7/7/21, 1:52 PM: --- [~sodonnell] Yes,

[jira] [Updated] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-16083: --- Attachment: (was: HDFS-16083.005.1.patch) > Forbid Observer NameNode trigger active namenode log roll >

[jira] [Updated] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-16083: --- Attachment: HDFS-16083.005.1.patch > Forbid Observer NameNode trigger active namenode log roll >

[jira] [Work logged] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?focusedWorklogId=619941=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619941 ] ASF GitHub Bot logged work on HDFS-16087: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376586#comment-17376586 ] Daniel Ma commented on HDFS-15796: -- [~sodonnell] Yes, it is more elegant. >

[jira] [Comment Edited] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376429#comment-17376429 ] Daniel Ma edited comment on HDFS-15796 at 7/7/21, 11:57 AM: [~sodonnell]

[jira] [Work logged] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?focusedWorklogId=620039=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620039 ] ASF GitHub Bot logged work on HDFS-16119: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?focusedWorklogId=619935=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619935 ] ASF GitHub Bot logged work on HDFS-16087: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-15796: - Attachment: 0003-HDFS-15796.patch > ConcurrentModificationException error happens on NameNode

[jira] [Commented] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376556#comment-17376556 ] Xiaoqiao He commented on HDFS-16115: I agree with you that HDFS-15651 is rough solution for this

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376568#comment-17376568 ] Stephen O'Donnell commented on HDFS-15796: -- For the latest patch, why not just use `return new

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15796: - Target Version/s: 3.4.0 (was: 3.3.1) Status: Patch Available (was: Open)

[jira] [Assigned] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15796: Assignee: Daniel Ma > ConcurrentModificationException error happens on NameNode

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376824#comment-17376824 ] Íñigo Goiri commented on HDFS-16100: This is a pretty sensitive part of the code. We need to make

[jira] [Work logged] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?focusedWorklogId=620213=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620213 ] ASF GitHub Bot logged work on HDFS-16118: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376702#comment-17376702 ] Ahmed Hussein commented on HDFS-13092: -- Hi [~msingh], thanks for providing the patch. We observed

[jira] [Work logged] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-16088?focusedWorklogId=620301=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620301 ] ASF GitHub Bot logged work on HDFS-16088: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16117) Add file count info in audit log to record the file count for delete and getListing RPC request to assist user trouble shooting when RPC cost is increasing

[ https://issues.apache.org/jira/browse/HDFS-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma reassigned HDFS-16117: Assignee: Daniel Ma > Add file count info in audit log to record the file count for delete and >

[jira] [Assigned] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause badl

[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma reassigned HDFS-16093: Assignee: Daniel Ma > DataNodes under decommission will still be returned to the client via >

[jira] [Work logged] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?focusedWorklogId=620303=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620303 ] ASF GitHub Bot logged work on HDFS-16087: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma reassigned HDFS-16115: Assignee: Daniel Ma > Asynchronously handle BPServiceActor command mechanism may result in >

[jira] [Created] (HDFS-16120) NNThroughputBenchmark does not filter generic hadoop args

xuefeng zhao created HDFS-16120: --- Summary: NNThroughputBenchmark does not filter generic hadoop args Key: HDFS-16120 URL: https://issues.apache.org/jira/browse/HDFS-16120 Project: Hadoop HDFS

[jira] [Work logged] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?focusedWorklogId=620347=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620347 ] ASF GitHub Bot logged work on HDFS-16087: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16117) Add file count info in audit log to record the file count for delete and getListing RPC request to assist user trouble shooting when RPC cost is increasing

[ https://issues.apache.org/jira/browse/HDFS-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376938#comment-17376938 ] Daniel Ma commented on HDFS-16117: -- Hello ，[~sodonnell] Could you pls help to review this patch? > Add

[jira] [Commented] (HDFS-16120) NNThroughputBenchmark does not filter generic hadoop args

[ https://issues.apache.org/jira/browse/HDFS-16120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377051#comment-17377051 ] xuefeng zhao commented on HDFS-16120: - when debug into   

[jira] [Updated] (HDFS-16120) NNThroughputBenchmark does not filter generic hadoop args

[ https://issues.apache.org/jira/browse/HDFS-16120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuefeng zhao updated HDFS-16120: Affects Version/s: 3.3.1 > NNThroughputBenchmark does not filter generic hadoop args >

[jira] [Work logged] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?focusedWorklogId=620302=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620302 ] ASF GitHub Bot logged work on HDFS-16087: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?focusedWorklogId=620306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620306 ] ASF GitHub Bot logged work on HDFS-16118: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16121) Iterative snapshot diff report can generate duplicate records for creates and deletes

Shashikant Banerjee created HDFS-16121: -- Summary: Iterative snapshot diff report can generate duplicate records for creates and deletes Key: HDFS-16121 URL: https://issues.apache.org/jira/browse/HDFS-16121

[jira] [Updated] (HDFS-16117) Add file count info in audit log to record the file count count in delete and getListing RPC request to assist user trouble shooting when RPC cost is increasing

[ https://issues.apache.org/jira/browse/HDFS-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-16117: - Attachment: 0001-HDFS-16117.patch > Add file count info in audit log to record the file count count in

[jira] [Created] (HDFS-16117) Add file count info in audit log to record the file count count in delete and getListing RPC request to assist user trouble shooting when RPC cost is increasing

Daniel Ma created HDFS-16117: Summary: Add file count info in audit log to record the file count count in delete and getListing RPC request to assist user trouble shooting when RPC cost is increasing Key: HDFS-16117

[jira] [Work logged] (HDFS-16116) Fix Hadoop FedBalance shell and federationBanance markdown bug.

[ https://issues.apache.org/jira/browse/HDFS-16116?focusedWorklogId=619821=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619821 ] ASF GitHub Bot logged work on HDFS-16116: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16114) the balancer parameters print error

[ https://issues.apache.org/jira/browse/HDFS-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina reassigned HDFS-16114: - Assignee: jiaguodong > the balancer parameters print error >

[jira] [Assigned] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16118: --- Assignee: JiangHua Zhu > Improve the number of handlers that initialize >

[jira] [Created] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

JiangHua Zhu created HDFS-16118: --- Summary: Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer Key: HDFS-16118 URL: https://issues.apache.org/jira/browse/HDFS-16118

[jira] [Commented] (HDFS-16114) the balancer parameters print error

[ https://issues.apache.org/jira/browse/HDFS-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376407#comment-17376407 ] Hemanth Boyina commented on HDFS-16114: --- committed to trunk thanks [~jiaguodong] for the

[jira] [Work logged] (HDFS-16114) the balancer parameters print error

[ https://issues.apache.org/jira/browse/HDFS-16114?focusedWorklogId=619849=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619849 ] ASF GitHub Bot logged work on HDFS-16114: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376421#comment-17376421 ] Stephen O'Donnell commented on HDFS-15796: -- [~Hemanth Boyina] Would you have time to have a

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376429#comment-17376429 ] Daniel Ma commented on HDFS-15796: -- [~sodonnell] yes, I totally agree with the solution you raised. I

[jira] [Resolved] (HDFS-16114) the balancer parameters print error

[ https://issues.apache.org/jira/browse/HDFS-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina resolved HDFS-16114. --- Fix Version/s: 3.4.0 Resolution: Fixed > the balancer parameters print error >

[jira] [Work logged] (HDFS-16114) the balancer parameters print error

[ https://issues.apache.org/jira/browse/HDFS-16114?focusedWorklogId=619848=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619848 ] ASF GitHub Bot logged work on HDFS-16114: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16117) Add file count info in audit log to record the file count for delete and getListing RPC request to assist user trouble shooting when RPC cost is increasing

[ https://issues.apache.org/jira/browse/HDFS-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Ma updated HDFS-16117: - Summary: Add file count info in audit log to record the file count for delete and getListing RPC request

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376419#comment-17376419 ] Stephen O'Donnell commented on HDFS-15796: -- Looking at the changes in this area, I think the

[jira] [Updated] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaguodong updated HDFS-16119: -- Summary: start balancer with parameters -hotBlockTimeInterval xxx is invalid (was: start balancer

[jira] [Created] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval is invalid

jiaguodong created HDFS-16119: - Summary: start balancer with parameters -hotBlockTimeInterval is invalid Key: HDFS-16119 URL: https://issues.apache.org/jira/browse/HDFS-16119 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaguodong updated HDFS-16119: -- Description:   when start balancer with parameters -hotBlockTimeInterval xxx,  it is not valid. but

[jira] [Updated] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaguodong updated HDFS-16119: -- Description: the parameter  hotBlockTimeInterval only set in hdfs-site.xml is valid,  start balancer

[jira] [Work logged] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?focusedWorklogId=619875=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619875 ] ASF GitHub Bot logged work on HDFS-16119: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16119: -- Labels: pull-request-available (was: ) > start balancer with parameters -hotBlockTimeInterval

[jira] [Updated] (HDFS-16119) start balancer with parameters -hotBlockTimeInterval xxx is invalid

[ https://issues.apache.org/jira/browse/HDFS-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaguodong updated HDFS-16119: -- Description:   when start balancer with parameters -hotBlockTimeInterval xxx,  it is invalid. but

[jira] [Updated] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16118: -- Labels: pull-request-available (was: ) > Improve the number of handlers that initialize >

[jira] [Work started] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16118 started by JiangHua Zhu. --- > Improve the number of handlers that initialize >

[jira] [Work logged] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?focusedWorklogId=619884=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619884 ] ASF GitHub Bot logged work on HDFS-16118: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16097: - Description: Datanode receives ipc requests will throw NPE when datanode quickly restart. This is because when