[jira] [Updated] (HDFS-17599) EC: Fix the mismatch between locations and indices for mover

2024-08-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17599: -- Fix Version/s: 3.5.0 > EC: Fix the mismatch between locations and indices for mover > -

[jira] [Resolved] (HDFS-17599) EC: Fix the mismatch between locations and indices for mover

2024-08-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu resolved HDFS-17599. --- Resolution: Fixed > EC: Fix the mismatch between locations and indices for mover > --

[jira] [Updated] (HDFS-17599) EC: Fix the mismatch between locations and indices for mover

2024-08-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17599: -- Component/s: balancer & mover > EC: Fix the mismatch between locations and indices for mover >

[jira] [Updated] (HDFS-17564) Erasure Coding: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-06-30 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17564: -- Description: If DataNode is marked as busy and contains many EC blocks, when running decommission Data

[jira] [Updated] (HDFS-17564) Erasure Coding: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-06-30 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17564: -- Description: If DataNode is marked as busy and contains many EC blocks, when running decommission Data

[jira] [Created] (HDFS-17564) Erasure Coding: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-06-30 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17564: - Summary: Erasure Coding: Fix the issue of inaccurate metrics when decommission mark busy DN Key: HDFS-17564 URL: https://issues.apache.org/jira/browse/HDFS-17564 Project: H

[jira] [Updated] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-06-27 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17559: -- Description: If there is datanode info in includes, but the datanode service is not currently started,

[jira] [Created] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-06-27 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17559: - Summary: Fix the uuid as null in NameNodeMXBean Key: HDFS-17559 URL: https://issues.apache.org/jira/browse/HDFS-17559 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-06-22 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17557: - Summary: Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop Key: HDFS-17557 URL: https://issues.apache.org/jira/browse/HDFS-17557 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-06-22 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17557: -- Description: Due to the modification in HDFS-16456, the current UT has not been able to run successfull

[jira] [Updated] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-05-20 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17464: -- Target Version/s: 3.5.0 > Improve some logs output in class FsDatasetImpl > ---

[jira] [Updated] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-05-20 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17464: -- Affects Version/s: 3.5.0 (was: 3.4.0) > Improve some logs output in class Fs

[jira] [Resolved] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-05-20 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu resolved HDFS-17464. --- Fix Version/s: 3.5.0 Resolution: Resolved > Improve some logs output in class FsDatasetImpl >

[jira] [Updated] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17451: -- Component/s: rbf > RBF: fix spotbugs for redundant nullcheck of dns. >

[jira] [Resolved] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu resolved HDFS-17451. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: fix spotbugs for red

[jira] [Updated] (HDFS-17461) Fix spotbugs in PeerCache#getInternal

2024-04-11 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17461: -- Description: Fix spotbugs in PeerCache#getInternal Spotbugs warnings: https://ci-hadoop.apache.org/jo

[jira] [Created] (HDFS-17461) Fix spotbugs in PeerCache#getInternal

2024-04-11 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17461: - Summary: Fix spotbugs in PeerCache#getInternal Key: HDFS-17461 URL: https://issues.apache.org/jira/browse/HDFS-17461 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-17455) Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt

2024-04-05 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17455: -- Description: When the client read data, connect to the datanode, because at this time the datanode acc

[jira] [Updated] (HDFS-17455) Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt

2024-04-05 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17455: -- Description: When the client read data, connect to the datanode, because at this time the datanode acc

[jira] [Created] (HDFS-17455) Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt

2024-04-05 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17455: - Summary: Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt Key: HDFS-17455 URL: https://issues.apache.org/jira/browse/HDFS-17455 Project: Hadoop HDF

[jira] [Commented] (HDFS-17448) Enhance the stability of the unit test TestDiskBalancerCommand

2024-03-30 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17832519#comment-17832519 ] Haiyang Hu commented on HDFS-17448: --- Thanks [~ayushtkn] for your review and merge~ >

[jira] [Commented] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-03-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17832116#comment-17832116 ] Haiyang Hu commented on HDFS-17361: --- {quote} Hi Haiyang Hu The introduced test seems

[jira] [Updated] (HDFS-17448) Enhance the stability of the unit test TestDiskBalancerCommand

2024-03-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17448: -- Description: TestDiskBalancerCommand#testDiskBalancerQueryWithoutSubmitAndMultipleNodes frequently fa

[jira] [Updated] (HDFS-17448) Enhance the stability of the unit test TestDiskBalancerCommand

2024-03-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17448: -- Description: TestDiskBalancerCommand#testDiskBalancerQueryWithoutSubmitAndMultipleNodes frequently fa

[jira] [Created] (HDFS-17448) Enhance the stability of the unit test TestDiskBalancerCommand

2024-03-29 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17448: - Summary: Enhance the stability of the unit test TestDiskBalancerCommand Key: HDFS-17448 URL: https://issues.apache.org/jira/browse/HDFS-17448 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-03-27 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831640#comment-17831640 ] Haiyang Hu commented on HDFS-17361: --- Hi [~ayushtkn] let me look it, thanks~ > DiskBala

[jira] [Commented] (HDFS-17437) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed

2024-03-22 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17829817#comment-17829817 ] Haiyang Hu commented on HDFS-17437: --- https://issues.apache.org/jira/browse/HADOOP-19090

[jira] [Created] (HDFS-17431) Fix log format for BlockRecoveryWorker#recoverBlocks

2024-03-18 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17431: - Summary: Fix log format for BlockRecoveryWorker#recoverBlocks Key: HDFS-17431 URL: https://issues.apache.org/jira/browse/HDFS-17431 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17430: -- Description: RecoveringBlock maybe skip no live replicas when get block recovery command. *Issue:* Cur

[jira] [Updated] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17430: -- Description: RecoveringBlock maybe skip no live replicas when get block recovery command. *Issue:* Cur

[jira] [Updated] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17430: -- Description: RecoveringBlock maybe skip no live replicas when get block recovery command. *Issue:* Cur

[jira] [Created] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-18 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17430: - Summary: RecoveringBlock will skip no live replicas when get block recovery command. Key: HDFS-17430 URL: https://issues.apache.org/jira/browse/HDFS-17430 Project: Hadoop H

[jira] [Updated] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-14 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17426: -- Description: When read the replication file, the following logic will be called when _readingWithStrat

[jira] [Updated] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-14 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17426: -- Description: When read the replication file, the following logic will be called when readingWithStrate

[jira] [Updated] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-13 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17426: -- Description: When currently reading the replication file, the following logic will be called when read

[jira] [Created] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-13 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17426: - Summary: Remove Invalid FileSystemECReadStats logic in DFSInputStream Key: HDFS-17426 URL: https://issues.apache.org/jira/browse/HDFS-17426 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-03-01 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17406: -- Component/s: rbf > Suppress UnresolvedPathException in hdfs router log > --

[jira] [Updated] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-02-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17406: -- Description: UnresolvedPathException as a normal process of resolving symlinks, the router server does

[jira] [Updated] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-02-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17406: -- Description: UnresolvedPathException as a normal process of resolving symlinks, the router server does

[jira] [Updated] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-02-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17406: -- Description: UnresolvedPathException as a normal process of resolving symlinks, the router server does

[jira] [Updated] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-02-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17406: -- Description: UnresolvedPathException as a normal process of resolving symlinks, the router server does

[jira] [Updated] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-02-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17406: -- Description: UnresolvedPathException as a normal process of resolving symlinks, the router server does

[jira] [Created] (HDFS-17406) Suppress UnresolvedPathException in hdfs router log

2024-02-29 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17406: - Summary: Suppress UnresolvedPathException in hdfs router log Key: HDFS-17406 URL: https://issues.apache.org/jira/browse/HDFS-17406 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-17369) Add uuid into datanode info for NameNodeMXBean

2024-02-02 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17369: - Summary: Add uuid into datanode info for NameNodeMXBean Key: HDFS-17369 URL: https://issues.apache.org/jira/browse/HDFS-17369 Project: Hadoop HDFS Issue Type: Impr

[jira] [Updated] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-28 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17361: -- Component/s: datanode > DiskBalancer: Query command support with multiple nodes > -

[jira] [Updated] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-28 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17361: -- Component/s: diskbalancer > DiskBalancer: Query command support with multiple nodes > -

[jira] [Updated] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-28 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17361: -- Description: For: https://issues.apache.org/jira/browse/HDFS-10821 mentioned, Query command will suppo

[jira] [Created] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-28 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17361: - Summary: DiskBalancer: Query command support with multiple nodes Key: HDFS-17361 URL: https://issues.apache.org/jira/browse/HDFS-17361 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-01-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17352: -- Description: As discussed at https://github.com/apache/hadoop/pull/6464#issuecomment-1903528336 we sho

[jira] [Updated] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-01-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17352: -- Description: As discussed at https://github.com/apache/hadoop/pull/6464 we should add configuration to

[jira] [Updated] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-01-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17352: -- Description: As discussed at https://github.com/apache/hadoop/pull/6464#issuecomment-1902959898 we sho

[jira] [Updated] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-01-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17352: -- Description: As discussed at https://github.com/apache/hadoop/pull/6464. we should add configuration to

[jira] [Created] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-01-22 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17352: - Summary: Add configuration to control whether DN delete this replica from disk when client requests a missing block Key: HDFS-17352 URL: https://issues.apache.org/jira/browse/HDFS-1735

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809227#comment-17809227 ] Haiyang Hu commented on HDFS-17346: --- Get it, thanks [~hexiaoqiao] for your comment. >

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Fix Version/s: 3.5.0 > Fix DirectoryScanner check mark the normal blocks as corrupt. >

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Component/s: datanode > Fix DirectoryScanner check mark the normal blocks as corrupt. > ---

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it maybe

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it maybe

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it maybe

[jira] [Created] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17346: - Summary: Fix DirectoryScanner check mark the normal blocks as corrupt. Key: HDFS-17346 URL: https://issues.apache.org/jira/browse/HDFS-17346 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17342: -- Component/s: datanode > Fix DataNode may invalidates normal block causing missing block > -

[jira] [Updated] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17342: -- Fix Version/s: 3.5.0 > Fix DataNode may invalidates normal block causing missing block > --

[jira] [Updated] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-17 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17342: -- Description: When users read an append file, occasional exceptions may occur, such as org.apache.hadoo

[jira] [Created] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-17 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17342: - Summary: Fix DataNode may invalidates normal block causing missing block Key: HDFS-17342 URL: https://issues.apache.org/jira/browse/HDFS-17342 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9550) DiskBalancer: Add Run Command

2024-01-11 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805867#comment-17805867 ] Haiyang Hu commented on HDFS-9550: -- This PR is still very practical, In the actual use of

[jira] [Updated] (HDFS-17310) DiskBalancer: Enhance the log message for submitPlan

2023-12-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17310: -- Description: In order to convenient troubleshoot problems, enhance the log message for submitPlan. >

[jira] [Updated] (HDFS-17310) DiskBalancer: Enhance the log message for submitPlan

2023-12-29 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17310: -- Summary: DiskBalancer: Enhance the log message for submitPlan (was: DiskBalancer: Enhance the log mess

[jira] [Created] (HDFS-17310) DiskBalancer: Enhance the log message

2023-12-29 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17310: - Summary: DiskBalancer: Enhance the log message Key: HDFS-17310 URL: https://issues.apache.org/jira/browse/HDFS-17310 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-24 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17298: -- Component/s: datanode > Fix NPE in DataNode.handleBadBlock and BlockSender > --

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-24 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17297: -- Component/s: namanode > The NameNode should remove block from the BlocksMap if the block is marked as

[jira] [Updated] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-20 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17298: -- Description: There are some NPE issues on the DataNode side of our online environment. The detailed ex

[jira] [Created] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-20 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17298: - Summary: Fix NPE in DataNode.handleBadBlock and BlockSender Key: HDFS-17298 URL: https://issues.apache.org/jira/browse/HDFS-17298 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17297: - Summary: The NameNode should remove block from the BlocksMap if the block is marked as deleted. Key: HDFS-17297 URL: https://issues.apache.org/jira/browse/HDFS-17297 Projec

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17297: -- Description: When call internalReleaseLease method: {code:java} boolean internalReleaseLease( ... int

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17297: -- Description: When call internalReleaseLease method: {code:java} boolean internalReleaseLease( ... int

[jira] [Commented] (HDFS-17279) RBF: Fix link to Fedbalance document

2023-12-10 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795143#comment-17795143 ] Haiyang Hu commented on HDFS-17279: --- Thanks [~ayushtkn] [~elgoiri] for your help review

[jira] [Updated] (HDFS-17279) RBF: Fix link to Fedbalance document

2023-12-07 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17279: -- Attachment: screenshot-1.png > RBF: Fix link to Fedbalance document >

[jira] [Updated] (HDFS-17279) RBF: Fix link to Fedbalance document

2023-12-07 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17279: -- Description: !screenshot-1.png! Fix link to Fedbalance document cannot be displayed > RBF: Fix link

[jira] [Updated] (HDFS-17279) RBF: Fix link to Fedbalance document

2023-12-07 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17279: -- Description: !screenshot-1.png! Fix link to Fedbalance document cannot be displayed. was: !scree

[jira] [Created] (HDFS-17279) RBF: Fix link to Fedbalance document

2023-12-07 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17279: - Summary: RBF: Fix link to Fedbalance document Key: HDFS-17279 URL: https://issues.apache.org/jira/browse/HDFS-17279 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2023-11-12 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17250: -- Description: *Issue:* When the NameNode attempts to trigger a log roll and the cachedActiveProxy is a

[jira] [Updated] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2023-11-09 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17250: -- Description: *Issue:* When the NameNode attempts to trigger a log roll and the cachedActiveProxy is a

[jira] [Updated] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2023-11-09 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17250: -- Description: *Issue:* When the NameNode attempts to trigger a log roll and the cachedActiveProxy is a

[jira] [Updated] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2023-11-09 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17250: -- Description: *Issue:* When the NameNode attempts to trigger a log roll and the cachedActiveProxy is a

[jira] [Created] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2023-11-09 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17250: - Summary: EditLogTailer#triggerActiveLogRoll should handle thread Interrupted Key: HDFS-17250 URL: https://issues.apache.org/jira/browse/HDFS-17250 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-04 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: * The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578 c

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-04 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: * The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578 c

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-04 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578 can

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-02 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578,HDF

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-01 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578,HDF

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-01 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578,HDF

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-01 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578,HDF

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-01 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578,HDF

[jira] [Created] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-01 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17247: - Summary: Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic Key: HDFS-17247 URL: https://issues.apache.org/jira/browse/HDFS-17247 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic

2023-11-01 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17247: -- Description: The AvailableSpaceBlockPlacementPolicy has made some optimizations such as HDFS-14578,HDF

[jira] [Created] (HDFS-17243) Add the parameter storage type for getBlocks method

2023-10-29 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17243: - Summary: Add the parameter storage type for getBlocks method Key: HDFS-17243 URL: https://issues.apache.org/jira/browse/HDFS-17243 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-17235) Fix javadoc errors in BlockManager

2023-10-22 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17235: -- Description: There are 2 errors in BlockManager.java https://ci-hadoop.apache.org/job/hadoop-multibranc

[jira] [Created] (HDFS-17235) Fix javadoc errors in BlockManager

2023-10-22 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17235: - Summary: Fix javadoc errors in BlockManager Key: HDFS-17235 URL: https://issues.apache.org/jira/browse/HDFS-17235 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Comment Edited] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

2023-10-12 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774805#comment-17774805 ] Haiyang Hu edited comment on HDFS-17218 at 10/13/23 6:14 AM: -

[jira] [Commented] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

2023-10-12 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774492#comment-17774492 ] Haiyang Hu commented on HDFS-17218: --- Thanks [~zhangshuyan] for you comment. {quote} I t

  1   2   3   4   >