[jira] [Updated] (HDFS-17228) Add documentation related to BlockManager

2023-10-17 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-17228: Component/s: documentation > Add documentation related to BlockManager >

[jira] [Created] (HDFS-17228) Add documentation related to BlockManager

2023-10-17 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-17228: --- Summary: Add documentation related to BlockManager Key: HDFS-17228 URL: https://issues.apache.org/jira/browse/HDFS-17228 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-17228) Add documentation related to BlockManager

2023-10-17 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-17228: --- Assignee: JiangHua Zhu > Add documentation related to BlockManager >

[jira] [Updated] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT

2023-05-15 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-17012: Attachment: screenshot-1.png > Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT >

[jira] [Updated] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT

2023-05-15 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-17012: Description: In DFSConfigKeys, DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT doesn't seem to have been

[jira] [Created] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT

2023-05-15 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-17012: --- Summary: Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT Key: HDFS-17012 URL: https://issues.apache.org/jira/browse/HDFS-17012 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT

2023-05-15 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-17012: --- Assignee: JiangHua Zhu > Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT >

[jira] [Commented] (HDFS-16863) Optimize frequency of regular block reports

2023-01-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655400#comment-17655400 ] JiangHua Zhu commented on HDFS-16863: - [~yuyanlei], if FBR is reduced, will it have any new impact:

[jira] [Updated] (HDFS-16807) Improve legacy ClientProtocol#rename2() interface

2022-10-20 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16807: Affects Version/s: 2.9.2 > Improve legacy ClientProtocol#rename2() interface >

[jira] [Commented] (HDFS-16807) Improve legacy ClientProtocol#rename2() interface

2022-10-19 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620206#comment-17620206 ] JiangHua Zhu commented on HDFS-16807: - Can you guys post some suggestions? [~weichiu] [~aajisaka]

[jira] [Created] (HDFS-16807) Improve legacy ClientProtocol#rename2() interface

2022-10-19 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16807: --- Summary: Improve legacy ClientProtocol#rename2() interface Key: HDFS-16807 URL: https://issues.apache.org/jira/browse/HDFS-16807 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14750) RBF: Improved isolation for downstream name nodes. {Dynamic}

2022-10-18 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619276#comment-17619276 ] JiangHua Zhu commented on HDFS-14750: - Thanks [~xuzq_zander] for the work. I have read your design

[jira] [Updated] (HDFS-16803) Improve some annotations in hdfs module

2022-10-16 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16803: Description: In hdfs module, some annotations are out of date. E.g: {code:java} FSDirRenameOp:

[jira] [Commented] (HDFS-16805) Support set the number of RPC Readers according to different RPC Servers in NameNode

2022-10-16 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618653#comment-17618653 ] JiangHua Zhu commented on HDFS-16805: - [~haiyang Hu], here is a similar jira: HDFS-16107 > Support

[jira] [Updated] (HDFS-16803) Improve some annotations in hdfs module

2022-10-14 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16803: Summary: Improve some annotations in hdfs module (was: Improve some annotations in FSDirRenameOp)

[jira] [Created] (HDFS-16803) Improve some annotations in FSDirRenameOp

2022-10-14 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16803: --- Summary: Improve some annotations in FSDirRenameOp Key: HDFS-16803 URL: https://issues.apache.org/jira/browse/HDFS-16803 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-16803) Improve some annotations in FSDirRenameOp

2022-10-14 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16803: --- Assignee: JiangHua Zhu > Improve some annotations in FSDirRenameOp >

[jira] [Commented] (HDFS-16802) Print options when accessing ClientProtocol#rename2()

2022-10-13 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616873#comment-17616873 ] JiangHua Zhu commented on HDFS-16802: - New log format: {code:java} 2022-10-13 12:11:38,813 [Listener

[jira] [Assigned] (HDFS-16802) Print options when accessing ClientProtocol#rename2()

2022-10-13 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16802: --- Assignee: JiangHua Zhu > Print options when accessing ClientProtocol#rename2() >

[jira] [Created] (HDFS-16802) Print options when accessing ClientProtocol#rename2()

2022-10-13 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16802: --- Summary: Print options when accessing ClientProtocol#rename2() Key: HDFS-16802 URL: https://issues.apache.org/jira/browse/HDFS-16802 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16733) Improve INode#isRoot()

2022-08-18 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16733: Description: When constructing an INodeFile or INodeDirectory, it is usually necessary to give a

[jira] [Assigned] (HDFS-16733) Improve INode#isRoot()

2022-08-18 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16733: --- Assignee: JiangHua Zhu > Improve INode#isRoot() > -- > >

[jira] [Created] (HDFS-16733) Improve INode#isRoot()

2022-08-18 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16733: --- Summary: Improve INode#isRoot() Key: HDFS-16733 URL: https://issues.apache.org/jira/browse/HDFS-16733 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-16729) RBF: fix some unreasonably annotated docs

2022-08-16 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16729: Component/s: documentation > RBF: fix some unreasonably annotated docs >

[jira] [Assigned] (HDFS-16729) RBF: fix some unreasonably annotated docs

2022-08-16 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16729: --- Assignee: JiangHua Zhu > RBF: fix some unreasonably annotated docs >

[jira] [Created] (HDFS-16729) RBF: fix some unreasonably annotated docs

2022-08-16 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16729: --- Summary: RBF: fix some unreasonably annotated docs Key: HDFS-16729 URL: https://issues.apache.org/jira/browse/HDFS-16729 Project: Hadoop HDFS Issue Type:

[jira] [Work started] (HDFS-16700) Record the real client ip carried by the Router in the NameNode log

2022-07-29 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16700 started by JiangHua Zhu. --- > Record the real client ip carried by the Router in the NameNode log >

[jira] [Updated] (HDFS-16700) Record the real client ip carried by the Router in the NameNode log

2022-07-29 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16700: Affects Version/s: (was: 3.3.0) > Record the real client ip carried by the Router in the

[jira] [Updated] (HDFS-16700) Record the real client ip carried by the Router in the NameNode log

2022-07-29 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16700: Affects Version/s: 3.3.0 > Record the real client ip carried by the Router in the NameNode log >

[jira] [Created] (HDFS-16700) Record the real client ip carried by the Router in the NameNode log

2022-07-29 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16700: --- Summary: Record the real client ip carried by the Router in the NameNode log Key: HDFS-16700 URL: https://issues.apache.org/jira/browse/HDFS-16700 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-16700) Record the real client ip carried by the Router in the NameNode log

2022-07-29 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16700: --- Assignee: JiangHua Zhu > Record the real client ip carried by the Router in the NameNode

[jira] [Commented] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-07-18 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568284#comment-17568284 ] JiangHua Zhu commented on HDFS-16565: - Thanks to [~weichiu] for the suggestion. I think I will use

[jira] [Updated] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16650: Fix Version/s: (was: 2.9.2) Affects Version/s: 2.9.2 > Optimize the cost of obtaining

[jira] [Updated] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16650: Description: Getting timestamps in Centralized cache management is done in the following ways:

[jira] [Updated] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16650: Description: Getting timestamps in Centralized cache management is done in the following ways:

[jira] [Updated] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16650: Description: Getting timestamps in Centralized cache management is done in the following ways:

[jira] [Updated] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16650: Priority: Minor (was: Major) > Optimize the cost of obtaining timestamps in Centralized cache

[jira] [Work started] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16650 started by JiangHua Zhu. --- > Optimize the cost of obtaining timestamps in Centralized cache management >

[jira] [Created] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16650: --- Summary: Optimize the cost of obtaining timestamps in Centralized cache management Key: HDFS-16650 URL: https://issues.apache.org/jira/browse/HDFS-16650 Project:

[jira] [Assigned] (HDFS-16650) Optimize the cost of obtaining timestamps in Centralized cache management

2022-07-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16650: --- Assignee: JiangHua Zhu > Optimize the cost of obtaining timestamps in Centralized cache

[jira] [Work started] (HDFS-16647) Delete unused NameNode#FS_HDFS_IMPL_KEY

2022-07-01 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16647 started by JiangHua Zhu. --- > Delete unused NameNode#FS_HDFS_IMPL_KEY >

[jira] [Created] (HDFS-16647) Delete unused NameNode#FS_HDFS_IMPL_KEY

2022-07-01 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16647: --- Summary: Delete unused NameNode#FS_HDFS_IMPL_KEY Key: HDFS-16647 URL: https://issues.apache.org/jira/browse/HDFS-16647 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-16647) Delete unused NameNode#FS_HDFS_IMPL_KEY

2022-07-01 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16647: --- Assignee: JiangHua Zhu > Delete unused NameNode#FS_HDFS_IMPL_KEY >

[jira] [Commented] (HDFS-15533) Provide DFS API compatible class(ViewDistributedFileSystem), but use ViewFileSystemOverloadScheme inside

2022-06-30 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561289#comment-17561289 ] JiangHua Zhu commented on HDFS-15533: - Nice to talk to you, [~umamaheswararao]. It seems that the

[jira] [Commented] (HDFS-16637) TestHDFSCLI#testAll consistently failing

2022-06-20 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556601#comment-17556601 ] JiangHua Zhu commented on HDFS-16637: - Thank you for your trust, [~vjasani]. I will be very careful

[jira] [Commented] (HDFS-16637) TestHDFSCLI#testAll consistently failing

2022-06-19 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556183#comment-17556183 ] JiangHua Zhu commented on HDFS-16637: - Thanks to [~vjasani] for finding this question. I think it was

[jira] [Comment Edited] (HDFS-11448) JN log segment syncing should support HA upgrade

2022-06-10 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545848#comment-17545848 ] JiangHua Zhu edited comment on HDFS-11448 at 6/10/22 7:15 AM: -- Hi

[jira] [Updated] (HDFS-16621) Remove unused JNStorage#getCurrentDir()

2022-06-07 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16621: Description: There is no use of getCurrentDir() anywhere in JNStorage, we should remove it. (was:

[jira] [Updated] (HDFS-16621) Remove unused JNStorage#getCurrentDir()

2022-06-07 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16621: Summary: Remove unused JNStorage#getCurrentDir() (was: Replace sd.getCurrentDir() with

[jira] [Work started] (HDFS-16621) Replace sd.getCurrentDir() with JNStorage#getCurrentDir()

2022-06-05 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16621 started by JiangHua Zhu. --- > Replace sd.getCurrentDir() with JNStorage#getCurrentDir() >

[jira] [Assigned] (HDFS-16621) Replace sd.getCurrentDir() with JNStorage#getCurrentDir()

2022-06-05 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16621: --- Assignee: JiangHua Zhu > Replace sd.getCurrentDir() with JNStorage#getCurrentDir() >

[jira] [Created] (HDFS-16621) Replace sd.getCurrentDir() with JNStorage#getCurrentDir()

2022-06-05 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16621: --- Summary: Replace sd.getCurrentDir() with JNStorage#getCurrentDir() Key: HDFS-16621 URL: https://issues.apache.org/jira/browse/HDFS-16621 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11448) JN log segment syncing should support HA upgrade

2022-06-03 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545848#comment-17545848 ] JiangHua Zhu commented on HDFS-11448: - Hi [~hanishakoneru], nice to communicate with you. I found the

[jira] [Updated] (HDFS-16614) Improve balancer operation strategy and performance

2022-06-01 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16614: Description: When the Balancer program is run, it does some work in the following order: 1. Obtain

[jira] [Updated] (HDFS-16614) Improve balancer operation strategy and performance

2022-06-01 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16614: Affects Version/s: 2.9.2 (was: 3.3.0) > Improve balancer operation

[jira] [Created] (HDFS-16614) Improve balancer operation strategy and performance

2022-06-01 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16614: --- Summary: Improve balancer operation strategy and performance Key: HDFS-16614 URL: https://issues.apache.org/jira/browse/HDFS-16614 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-16614) Improve balancer operation strategy and performance

2022-06-01 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16614: --- Assignee: JiangHua Zhu > Improve balancer operation strategy and performance >

[jira] [Commented] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542370#comment-17542370 ] JiangHua Zhu commented on HDFS-16594: - Thanks [~sodonnell] and [~weichiu] for your comments and

[jira] [Resolved] (HDFS-16592) Fix typo for BalancingPolicy

2022-05-25 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu resolved HDFS-16592. - Resolution: Not A Problem > Fix typo for BalancingPolicy > > >

[jira] [Updated] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16594: Description: When there are some DataNodes that need to go offline, Decommission starts to work,

[jira] [Commented] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17542190#comment-17542190 ] JiangHua Zhu commented on HDFS-16594: - In my opinion, the priority of RpcCall being processed on time

[jira] [Assigned] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16594: --- Assignee: JiangHua Zhu > Many RpcCalls are blocked for a while while Decommission works >

[jira] [Created] (HDFS-16594) Many RpcCalls are blocked for a while while Decommission works

2022-05-25 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16594: --- Summary: Many RpcCalls are blocked for a while while Decommission works Key: HDFS-16594 URL: https://issues.apache.org/jira/browse/HDFS-16594 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16592) Fix typo for BalancingPolicy

2022-05-24 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16592: Component/s: documentation > Fix typo for BalancingPolicy > > >

[jira] [Work started] (HDFS-16592) Fix typo for BalancingPolicy

2022-05-23 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16592 started by JiangHua Zhu. --- > Fix typo for BalancingPolicy > > >

[jira] [Assigned] (HDFS-16592) Fix typo for BalancingPolicy

2022-05-23 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16592: --- Assignee: JiangHua Zhu > Fix typo for BalancingPolicy > > >

[jira] [Created] (HDFS-16592) Fix typo for BalancingPolicy

2022-05-23 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16592: --- Summary: Fix typo for BalancingPolicy Key: HDFS-16592 URL: https://issues.apache.org/jira/browse/HDFS-16592 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-16581) Print node status when executing printTopology

2022-05-23 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16581: Summary: Print node status when executing printTopology (was: Print DataNode node status) >

[jira] [Work started] (HDFS-16588) Backport HDFS-16584 to branch-3.3 and other active old branches

2022-05-23 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16588 started by JiangHua Zhu. --- > Backport HDFS-16584 to branch-3.3 and other active old branches >

[jira] [Assigned] (HDFS-16588) Backport HDFS-16584 to branch-3.3 and other active old branches

2022-05-22 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16588: --- Assignee: JiangHua Zhu > Backport HDFS-16584 to branch-3.3 and other active old branches >

[jira] [Created] (HDFS-16588) Backport HDFS-16584 to branch-3.3 and other active old branches

2022-05-22 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16588: --- Summary: Backport HDFS-16584 to branch-3.3 and other active old branches Key: HDFS-16588 URL: https://issues.apache.org/jira/browse/HDFS-16588 Project: Hadoop HDFS

[jira] [Work started] (HDFS-16584) Record StandbyNameNode information when Balancer is running

2022-05-19 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16584 started by JiangHua Zhu. --- > Record StandbyNameNode information when Balancer is running >

[jira] [Assigned] (HDFS-16584) Record StandbyNameNode information when Balancer is running

2022-05-19 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16584: --- Assignee: JiangHua Zhu > Record StandbyNameNode information when Balancer is running >

[jira] [Created] (HDFS-16584) Record StandbyNameNode information when Balancer is running

2022-05-19 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16584: --- Summary: Record StandbyNameNode information when Balancer is running Key: HDFS-16584 URL: https://issues.apache.org/jira/browse/HDFS-16584 Project: Hadoop HDFS

[jira] [Work started] (HDFS-16581) Print DataNode node status

2022-05-17 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16581 started by JiangHua Zhu. --- > Print DataNode node status > -- > >

[jira] [Resolved] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-17 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu resolved HDFS-16565. - Resolution: Duplicate > DataNode holds a large number of CLOSE_WAIT connections that are not

[jira] [Assigned] (HDFS-16581) Print DataNode node status

2022-05-17 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16581: --- Assignee: JiangHua Zhu > Print DataNode node status > -- > >

[jira] [Created] (HDFS-16581) Print DataNode node status

2022-05-17 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16581: --- Summary: Print DataNode node status Key: HDFS-16581 URL: https://issues.apache.org/jira/browse/HDFS-16581 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-16576) Remove unused Imports in Hadoop HDFS project

2022-05-11 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17535817#comment-17535817 ] JiangHua Zhu commented on HDFS-16576: - It looks like what is described here is somewhat simple. >

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-08 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Component/s: ec > DataNode holds a large number of CLOSE_WAIT connections that are not released >

[jira] [Commented] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-08 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533457#comment-17533457 ] JiangHua Zhu commented on HDFS-16565: - A problem with socket leaks caused by

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-08 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Attachment: screenshot-2.png > DataNode holds a large number of CLOSE_WAIT connections that are

[jira] [Comment Edited] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532808#comment-17532808 ] JiangHua Zhu edited comment on HDFS-16565 at 5/6/22 11:46 AM: -- Thanks

[jira] [Commented] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532808#comment-17532808 ] JiangHua Zhu commented on HDFS-16565: - Thanks [~hexiaoqiao] for the comment. This phenomenon occurs

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Issue Type: Bug (was: Improvement) > DataNode holds a large number of CLOSE_WAIT connections that

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Description: There is a strange phenomenon here, DataNode holds a large number of connections in

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Environment: CentOS Linux release 7.5.1804 (Core) > DataNode holds a large number of CLOSE_WAIT

[jira] [Assigned] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16565: --- Assignee: (was: JiangHua Zhu) > DataNode holds a large number of CLOSE_WAIT connections

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Attachment: screenshot-1.png > DataNode holds a large number of CLOSE_WAIT connections that are

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Description: There is a strange phenomenon here, DataNode holds a large number of connections in

[jira] [Updated] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

2022-05-06 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Summary: DataNode holds a large number of CLOSE_WAIT connections that are not released (was:

[jira] [Updated] (HDFS-16565) Optimize DataNode#DataTransfer, when encountering NoRouteToHostException

2022-04-30 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16565: Description: When DataTransfer runs, the local node needs to connect to another DataNode, which

[jira] [Assigned] (HDFS-16565) Optimize DataNode#DataTransfer, when encountering NoRouteToHostException

2022-04-29 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16565: --- Assignee: JiangHua Zhu > Optimize DataNode#DataTransfer, when encountering

[jira] [Created] (HDFS-16565) Optimize DataNode#DataTransfer, when encountering NoRouteToHostException

2022-04-29 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16565: --- Summary: Optimize DataNode#DataTransfer, when encountering NoRouteToHostException Key: HDFS-16565 URL: https://issues.apache.org/jira/browse/HDFS-16565 Project: Hadoop

[jira] [Commented] (HDFS-16498) Fix NPE for checkBlockReportLease

2022-03-09 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503966#comment-17503966 ] JiangHua Zhu commented on HDFS-16498: - This seems to be a robustness issue with the NameNode. A

[jira] [Updated] (HDFS-16498) Fix NPE for checkBlockReportLease

2022-03-09 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16498: Attachment: screenshot-1.png > Fix NPE for checkBlockReportLease >

[jira] [Work started] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

2022-03-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16494 started by JiangHua Zhu. --- > Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks() >

[jira] [Created] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

2022-03-04 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16494: --- Summary: Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks() Key: HDFS-16494 URL: https://issues.apache.org/jira/browse/HDFS-16494 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

2022-03-04 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16494: --- Assignee: JiangHua Zhu > Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks() >

[jira] [Work started] (HDFS-16476) Increase the number of metrics used to record PendingRecoveryBlocks

2022-02-22 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16476 started by JiangHua Zhu. --- > Increase the number of metrics used to record PendingRecoveryBlocks >

  1   2   3   4   5   6   7   >