[jira] [Updated] (HDFS-17068) Datanode should record last directory scan time.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17068: -- Affects Version/s: 3.4.0 > Datanode should record last directory scan time. >

[jira] [Updated] (HDFS-17070) Remove unused import in DataNodeMetricHelper.java.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17070: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Remove unused import in

[jira] [Updated] (HDFS-17073) Enhance the warning message output for BlockGroupNonStripedChecksumComputer#compute

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17073: -- Component/s: hdfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Enhance the

[jira] [Updated] (HDFS-17070) Remove unused import in DataNodeMetricHelper.java.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17070: -- Component/s: datanode > Remove unused import in DataNodeMetricHelper.java. >

[jira] [Updated] (HDFS-17076) Remove the unused method isSlownodeByNameserviceId in DataNode

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17076: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Remove the

[jira] [Updated] (HDFS-17075) Reconfig disk balancer parameters for datanode

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17075: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Reconfig disk

[jira] [Updated] (HDFS-17081) EC: Add logic for striped blocks in isSufficientlyReplicated

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17081: -- Component/s: erasure-coding Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > EC: Add

[jira] [Updated] (HDFS-17083) Support getErasureCodeCodecs API in WebHDFS

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17083: -- Target Version/s: 3.4.0 > Support getErasureCodeCodecs API in WebHDFS >

[jira] [Updated] (HDFS-17082) Add documentation for provisionSnapshotTrash command to HDFSCommands.md and HdfsSnapshots.md

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17082: -- Component/s: documentation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add

[jira] [Updated] (HDFS-17086) Fix the parameter settings in TestDiskspaceQuotaUpdate#updateCountForQuota.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17086: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix the parameter

[jira] [Updated] (HDFS-17087) Add Throttler for datanode reading block

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17087: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-17088) Improve the debug verifyEC and dfsrouteradmin commands in HDFSCommands.md

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17088: -- Component/s: dfsadmin Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve the

[jira] [Updated] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17094: -- Component/s: erasure-coding Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (HDFS-17105) mistakenly purge editLogs even after it is empty in NNStorageRetentionManager

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17105: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > mistakenly

[jira] [Updated] (HDFS-17093) Fix block report lease issue to avoid missing some storages report.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17093: -- Target Version/s: 3.4.0 > Fix block report lease issue to avoid missing some storages report. >

[jira] [Updated] (HDFS-17115) HttpFS Add Support getErasureCodeCodecs API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17115: -- Target Version/s: 3.4.0 > HttpFS Add Support getErasureCodeCodecs API >

[jira] [Updated] (HDFS-17112) Show decommission duration in JMX and HTML

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17112: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Show decommission duration in JMX and HTML >

[jira] [Updated] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17111: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Optimize msync

[jira] [Updated] (HDFS-17116) RBF: Update invoke millisecond time as monotonicNow() in RouterSafemodeService.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17116: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Update invoke

[jira] [Updated] (HDFS-17117) Print reconstructionQueuesInitProgress periodically when BlockManager processMisReplicatesAsync.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17117: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Print reconstructionQueuesInitProgress

[jira] [Updated] (HDFS-17119) RBF: Logger fix for StateStoreMySQLImpl

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17119: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Logger fix for

[jira] [Updated] (HDFS-17122) Rectify the table length discrepancy in the DataNode UI.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17122: -- Component/s: ui Target Version/s: 3.4.0 > Rectify the table length discrepancy in the

[jira] [Updated] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17134: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Fix duplicate results of getListing

[jira] [Updated] (HDFS-17135) Update fsck -blockId to display excess state info of blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17135: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Update fsck

[jira] [Updated] (HDFS-17133) TestFsDatasetImpl missing null check when cleaning up

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17133: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > TestFsDatasetImpl

[jira] [Updated] (HDFS-17135) Update fsck -blockId to display excess state info of blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17135: -- Component/s: namnode > Update fsck -blockId to display excess state info of blocks >

[jira] [Updated] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17136: -- Target Version/s: 3.4.0 > Fix annotation description and typo in BlockPlacementPolicyDefault Class >

[jira] [Updated] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17136: -- Component/s: block placement > Fix annotation description and typo in BlockPlacementPolicyDefault

[jira] [Updated] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17136: -- Hadoop Flags: Reviewed > Fix annotation description and typo in BlockPlacementPolicyDefault Class >

[jira] [Updated] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17136: -- Affects Version/s: 3.4.0 > Fix annotation description and typo in BlockPlacementPolicyDefault Class >

[jira] [Updated] (HDFS-17138) RBF: We changed the hadoop.security.auth_to_local configuration of one router, the other routers stopped working

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17138: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: We changed the

[jira] [Updated] (HDFS-17137) Standby/Observer NameNode skip to handle redundant replica block logic when set decrease replication.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17137: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Standby/Observer NameNode skip to handle

[jira] [Updated] (HDFS-17139) RBF: For the doc of the class RouterAdminProtocolTranslatorPB, it describes the function of the class ClientNamenodeProtocolTranslatorPB

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17139: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: For the doc of the class

[jira] [Updated] (HDFS-17144) Remove incorrect comment in method storeAllocatedBlock

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17144: -- Hadoop Flags: Reviewed > Remove incorrect comment in method storeAllocatedBlock >

[jira] [Updated] (HDFS-17145) Fix description of property dfs.namenode.file.close.num-committed-allowed.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17145: -- Hadoop Flags: Reviewed > Fix description of property dfs.namenode.file.close.num-committed-allowed. >

[jira] [Updated] (HDFS-17148) RBF: SQLDelegationTokenSecretManager must cleanup expired tokens in SQL

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17148: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: SQLDelegationTokenSecretManager must

[jira] [Updated] (HDFS-17140) Revisit the BPOfferService.reportBadBlocks() method.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17140: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Revisit the BPOfferService.reportBadBlocks()

[jira] [Updated] (HDFS-17150) EC: Fix the bug of failed lease recovery.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17150: -- Component/s: erasure-coding Target Version/s: 3.4.0, 3.3.9 Affects Version/s: 3.4.0

[jira] [Updated] (HDFS-17151) EC: Fix wrong metadata in BlockInfoStriped after recovery

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17151: -- Component/s: erasure-coding Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > EC: Fix

[jira] [Updated] (HDFS-17154) EC: Fix bug in updateBlockForPipeline after failover

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17154: -- Component/s: erasure-coding Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > EC: Fix

[jira] [Updated] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17156: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0, 3.3.9 Affects Version/s: 3.4.0

[jira] [Updated] (HDFS-17162) RBF: Add missing comments in StateStoreService

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17162: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Add missing comments in StateStoreService

[jira] [Updated] (HDFS-17166) RBF: Throwing NoNamenodesAvailableException for a long time, when failover

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17166: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Throwing

[jira] [Updated] (HDFS-17171) CONGESTION_RATIO should be configurable

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17171: -- Hadoop Flags: Reviewed > CONGESTION_RATIO should be configurable >

[jira] [Updated] (HDFS-17167) Observer NameNode -observer startup option conflicts with -rollingUpgrade startup option

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17167: -- Labels: pull-requests-available (was: ) > Observer NameNode -observer startup option conflicts with

[jira] [Updated] (HDFS-17168) Support getTrashRoots API in WebHDFS

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17168: -- Target Version/s: 3.4.0 > Support getTrashRoots API in WebHDFS >

[jira] [Updated] (HDFS-17172) Support FSNamesystemLock Parameters reconfigurable

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17172: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Support

[jira] [Updated] (HDFS-17177) ErasureCodingWork reconstruct ignore the block length is Long.MAX_VALUE.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17177: -- Component/s: erasure-coding Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (HDFS-17177) ErasureCodingWork reconstruct ignore the block length is Long.MAX_VALUE.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17177: -- Hadoop Flags: Reviewed > ErasureCodingWork reconstruct ignore the block length is Long.MAX_VALUE. >

[jira] [Updated] (HDFS-17180) HttpFS Add Support getTrashRoots API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17180: -- Target Version/s: 3.4.0 > HttpFS Add Support getTrashRoots API >

[jira] [Updated] (HDFS-17182) DataSetLockManager.lockLeakCheck() is not thread-safe.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17182: -- Target Version/s: 3.4.0 > DataSetLockManager.lockLeakCheck() is not thread-safe. >

[jira] [Updated] (HDFS-17182) DataSetLockManager.lockLeakCheck() is not thread-safe.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17182: -- Affects Version/s: 3.4.0 > DataSetLockManager.lockLeakCheck() is not thread-safe. >

[jira] [Updated] (HDFS-17182) DataSetLockManager.lockLeakCheck() is not thread-safe.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17182: -- Component/s: datanode > DataSetLockManager.lockLeakCheck() is not thread-safe. >

[jira] [Updated] (HDFS-17184) Improve BlockReceiver to throws DiskOutOfSpaceException when initialize

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17184: -- Target Version/s: 3.4.0 > Improve BlockReceiver to throws DiskOutOfSpaceException when initialize >

[jira] [Updated] (HDFS-17184) Improve BlockReceiver to throws DiskOutOfSpaceException when initialize

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17184: -- Affects Version/s: 3.4.0 > Improve BlockReceiver to throws DiskOutOfSpaceException when initialize >

[jira] [Updated] (HDFS-17184) Improve BlockReceiver to throws DiskOutOfSpaceException when initialize

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17184: -- Component/s: datanode > Improve BlockReceiver to throws DiskOutOfSpaceException when initialize >

[jira] [Updated] (HDFS-17190) EC: Fix bug of OIV processing XAttr.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17190: -- Component/s: erasure-coding > EC: Fix bug of OIV processing XAttr. >

[jira] [Updated] (HDFS-17197) Show file replication when listing corrupt files.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17197: -- Affects Version/s: 3.4.0 > Show file replication when listing corrupt files. >

[jira] [Updated] (HDFS-17197) Show file replication when listing corrupt files.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17197: -- Component/s: fs namanode > Show file replication when listing corrupt files. >

[jira] [Updated] (HDFS-17194) Enhance the log message for striped block recovery

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17194: -- Component/s: logging Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Enhance the log

[jira] [Updated] (HDFS-17190) EC: Fix bug of OIV processing XAttr.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17190: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > EC: Fix bug of OIV processing XAttr. >

[jira] [Updated] (HDFS-17197) Show file replication when listing corrupt files.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17197: -- Target Version/s: 3.4.0 > Show file replication when listing corrupt files. >

[jira] [Updated] (HDFS-17200) Add some datanode related metrics to Metrics.md

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17200: -- Component/s: datanode metrics Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17204: -- Target Version/s: 3.4.0 > EC: Reduce unnecessary log when processing excess redundancy. >

[jira] [Updated] (HDFS-17198) RBF: fix bug of getRepresentativeQuorum when records have same dateModified

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17198: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: fix bug of

[jira] [Updated] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17204: -- Affects Version/s: 3.4.0 > EC: Reduce unnecessary log when processing excess redundancy. >

[jira] [Updated] (HDFS-17205) HdfsServerConstants.MIN_BLOCKS_FOR_WRITE should be configurable

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17205: -- Component/s: hdfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (HDFS-17209) Correct comments to align with the code

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17209: -- Component/s: datanode > Correct comments to align with the code >

[jira] [Updated] (HDFS-17208) Add the metrics PendingAsyncDiskOperations in datanode

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17208: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add the metrics PendingAsyncDiskOperations in

[jira] [Updated] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17204: -- Component/s: erasure-coding (was: ec) > EC: Reduce unnecessary log when

[jira] [Updated] (HDFS-17209) Correct comments to align with the code

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17209: -- Target Version/s: 3.4.0 > Correct comments to align with the code >

[jira] [Updated] (HDFS-17211) Fix comments in the RemoteParam class

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17211: -- Target Version/s: 3.4.0 > Fix comments in the RemoteParam class >

[jira] [Assigned] (HDFS-17209) Correct comments to align with the code

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-17209: - Assignee: Yu Wang > Correct comments to align with the code >

[jira] [Updated] (HDFS-17215) RBF: Fix some method annotations about @throws

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17215: -- Target Version/s: 3.4.0 > RBF: Fix some method annotations about @throws >

[jira] [Updated] (HDFS-17220) fix same available space policy in AvailableSpaceVolumeChoosingPolicy

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17220: -- Hadoop Flags: Reviewed > fix same available space policy in AvailableSpaceVolumeChoosingPolicy >

[jira] [Updated] (HDFS-17217) Add lifeline RPC start up log when NameNode#startCommonServices

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17217: -- Component/s: namenode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add lifeline

[jira] [Commented] (HDFS-17220) fix same available space policy in AvailableSpaceVolumeChoosingPolicy

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811620#comment-17811620 ] Shilun Fan commented on HDFS-17220: --- [~guophilipse]  Thanks for the contribution! added to hdfs

[jira] [Updated] (HDFS-17218) NameNode should process time out excess redundancy blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17218: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > NameNode should process time out excess

[jira] [Assigned] (HDFS-17220) fix same available space policy in AvailableSpaceVolumeChoosingPolicy

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-17220: - Assignee: Fei Guo > fix same available space policy in AvailableSpaceVolumeChoosingPolicy >

[jira] [Updated] (HDFS-17220) fix same available space policy in AvailableSpaceVolumeChoosingPolicy

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17220: -- Target Version/s: 3.4.0 > fix same available space policy in AvailableSpaceVolumeChoosingPolicy >

[jira] [Updated] (HDFS-17231) HA: Safemode should exit when resources are from low to available

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17231: -- Target Version/s: 3.4.0 > HA: Safemode should exit when resources are from low to available >

[jira] [Updated] (HDFS-17232) RBF: Fix NoNamenodesAvailableException for a long time, when use observer

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17232: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Fix NoNamenodesAvailableException for a

[jira] [Updated] (HDFS-17228) Improve documentation related to BlockManager

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17228: -- Target Version/s: 3.4.0 > Improve documentation related to BlockManager >

[jira] [Updated] (HDFS-17232) RBF: Fix NoNamenodesAvailableException for a long time, when use observer

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17232: -- Component/s: rbf > RBF: Fix NoNamenodesAvailableException for a long time, when use observer >

[jira] [Updated] (HDFS-17233) The conf dfs.datanode.lifeline.interval.seconds is not considering time unit seconds

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17233: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > The conf

[jira] [Updated] (HDFS-17237) Remove IPCLoggerChannel Metrics when the logger is closed

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17237: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0, 3.3.7 Affects Version/s: 3.4.0

[jira] [Updated] (HDFS-17235) Fix javadoc errors in BlockManager

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17235: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix javadoc errors in BlockManager >

[jira] [Updated] (HDFS-17240) Fix a typo in DataStorage.java

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17240: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix a typo in DataStorage.java >

[jira] [Commented] (HDFS-17240) Fix a typo in DataStorage.java

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811618#comment-17811618 ] Shilun Fan commented on HDFS-17240: --- [~yu.wang] Thanks for the contribution! added to hdfs contributor

[jira] [Assigned] (HDFS-17240) Fix a typo in DataStorage.java

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-17240: - Assignee: Yu Wang (was: Yu Wang) > Fix a typo in DataStorage.java >

[jira] [Assigned] (HDFS-17240) Fix a typo in DataStorage.java

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-17240: - Assignee: Yu Wang > Fix a typo in DataStorage.java > -- > >

[jira] [Updated] (HDFS-17246) Fix shaded client for building Hadoop on Windows

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17246: -- Target Version/s: 3.4.0 > Fix shaded client for building Hadoop on Windows >

[jira] [Updated] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17250: -- Component/s: hdfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (HDFS-17249) Fix TestDFSUtil.testIsValidName() unit test failure

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17249: -- Target Version/s: 3.4.0 > Fix TestDFSUtil.testIsValidName() unit test failure >

[jira] [Updated] (HDFS-17249) Fix TestDFSUtil.testIsValidName() unit test failure

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17249: -- Component/s: test > Fix TestDFSUtil.testIsValidName() unit test failure >

[jira] [Updated] (HDFS-17243) Add the parameter storage type for getBlocks method

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17243: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add the parameter storage type for getBlocks

[jira] [Updated] (HDFS-17249) Fix TestDFSUtil.testIsValidName() unit test failure

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17249: -- Affects Version/s: 3.4.0 > Fix TestDFSUtil.testIsValidName() unit test failure >

[jira] [Updated] (HDFS-17260) Fix the logic for reconfigure slow peer enable for Namenode.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17260: -- Affects Version/s: 3.4.0 > Fix the logic for reconfigure slow peer enable for Namenode. >

[jira] [Updated] (HDFS-17260) Fix the logic for reconfigure slow peer enable for Namenode.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17260: -- Target Version/s: 3.4.0 > Fix the logic for reconfigure slow peer enable for Namenode. >

[jira] [Updated] (HDFS-17259) Fix typo in TestFsDatasetImpl Class.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17259: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix typo in

<    2   3   4   5   6   7   8   9   10   11   >