[jira] [Commented] (HDFS-14528) Failover from Active to Standby Failed

[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802433#comment-17802433 ] Shilun Fan commented on HDFS-14528: --- updated the target version for preparing 3.4.0 release. >

[jira] [Updated] (HDFS-14312) KMS-o-meter: Scale test KMS using kms audit log

[ https://issues.apache.org/jira/browse/HDFS-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14312: -- Target Version/s: 3.4.1 (was: 3.4.0) > KMS-o-meter: Scale test KMS using kms audit log >

[jira] [Commented] (HDFS-14312) KMS-o-meter: Scale test KMS using kms audit log

[ https://issues.apache.org/jira/browse/HDFS-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802434#comment-17802434 ] Shilun Fan commented on HDFS-14312: --- updated the target version for preparing 3.4.0 release. >

[jira] [Updated] (HDFS-14528) Failover from Active to Standby Failed

[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14528: -- Target Version/s: 3.4.1 (was: 3.4.0) > Failover from Active to Standby Failed >

[jira] [Updated] (HDFS-14606) Support OpenTracing in HDFS

[ https://issues.apache.org/jira/browse/HDFS-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14606: -- Target Version/s: 3.4.1 (was: 3.4.0) > Support OpenTracing in HDFS > --- > >

[jira] [Commented] (HDFS-14626) Decommission all nodes hosting last block of open file succeeds unexpectedly

[ https://issues.apache.org/jira/browse/HDFS-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802430#comment-17802430 ] Shilun Fan commented on HDFS-14626: --- updated the target version for preparing 3.4.0 release. >

[jira] [Updated] (HDFS-14607) Support OpenTracing in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14607: -- Target Version/s: 3.4.1 (was: 3.4.0) > Support OpenTracing in WebHDFS >

[jira] [Updated] (HDFS-14626) Decommission all nodes hosting last block of open file succeeds unexpectedly

[ https://issues.apache.org/jira/browse/HDFS-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14626: -- Target Version/s: 3.4.1 (was: 3.4.0) > Decommission all nodes hosting last block of open file

[jira] [Updated] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14663: -- Target Version/s: 3.4.1 (was: 3.4.0) > HttpFS: LISTSTATUS_BATCH does not return batches >

[jira] [Updated] (HDFS-14718) HttpFS: Sort response by key names as WebHDFS does

[ https://issues.apache.org/jira/browse/HDFS-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14718: -- Target Version/s: 3.4.1 (was: 3.4.0) > HttpFS: Sort response by key names as WebHDFS does >

[jira] [Commented] (HDFS-14718) HttpFS: Sort response by key names as WebHDFS does

[ https://issues.apache.org/jira/browse/HDFS-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802428#comment-17802428 ] Shilun Fan commented on HDFS-14718: --- updated the target version for preparing 3.4.0 release. >

[jira] [Commented] (HDFS-14786) A new block placement policy tolerating availability zone failure

[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802427#comment-17802427 ] Shilun Fan commented on HDFS-14786: --- updated the target version for preparing 3.4.0 release. > A new

[jira] [Updated] (HDFS-14786) A new block placement policy tolerating availability zone failure

[ https://issues.apache.org/jira/browse/HDFS-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14786: -- Target Version/s: 3.4.1 (was: 3.4.0) > A new block placement policy tolerating availability zone

[jira] [Updated] (HDFS-14894) Add balancer parameter to balance top used nodes

[ https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14894: -- Target Version/s: (was: 3.4.0) Resolution: Done Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14897) [hadoop-hdfs] Fix order of actual and expected expression in assert statements

[ https://issues.apache.org/jira/browse/HDFS-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802425#comment-17802425 ] Shilun Fan commented on HDFS-14897: --- updated the target version for preparing 3.4.0 release. >

[jira] [Updated] (HDFS-14897) [hadoop-hdfs] Fix order of actual and expected expression in assert statements

[ https://issues.apache.org/jira/browse/HDFS-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14897: -- Target Version/s: 3.4.1 (was: 3.4.0) > [hadoop-hdfs] Fix order of actual and expected expression in

[jira] [Updated] (HDFS-14978) In-place Erasure Coding Conversion

[ https://issues.apache.org/jira/browse/HDFS-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14978: -- Target Version/s: 3.4.1 (was: 3.4.0) > In-place Erasure Coding Conversion >

[jira] [Commented] (HDFS-14903) Update access time in toCompleteFile

[ https://issues.apache.org/jira/browse/HDFS-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802424#comment-17802424 ] Shilun Fan commented on HDFS-14903: --- updated the target version for preparing 3.4.0 release. > Update

[jira] [Updated] (HDFS-14903) Update access time in toCompleteFile

[ https://issues.apache.org/jira/browse/HDFS-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14903: -- Target Version/s: 3.4.1 (was: 3.4.0) > Update access time in toCompleteFile >

[jira] [Commented] (HDFS-14978) In-place Erasure Coding Conversion

[ https://issues.apache.org/jira/browse/HDFS-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802423#comment-17802423 ] Shilun Fan commented on HDFS-14978: --- updated the target version for preparing 3.4.0 release. >

[jira] [Commented] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802422#comment-17802422 ] Shilun Fan commented on HDFS-15042: --- updated the target version for preparing 3.4.0 release. > Add

[jira] [Updated] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15042: -- Target Version/s: 3.4.1 (was: 3.4.0) > Add more tests for ByteBufferPositionedReadable >

[jira] [Commented] (HDFS-15271) Remove obsolete SPNEGO configuration of NN, SNN and JN.

[ https://issues.apache.org/jira/browse/HDFS-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802421#comment-17802421 ] Shilun Fan commented on HDFS-15271: --- updated the target version for preparing 3.4.0 release. > Remove

[jira] [Commented] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802420#comment-17802420 ] Shilun Fan commented on HDFS-15274: --- updated the target version for preparing 3.4.0 release. > NN

[jira] [Updated] (HDFS-15271) Remove obsolete SPNEGO configuration of NN, SNN and JN.

[ https://issues.apache.org/jira/browse/HDFS-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15271: -- Target Version/s: 3.4.1 (was: 3.4.0) > Remove obsolete SPNEGO configuration of NN, SNN and JN. >

[jira] [Updated] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15274: -- Target Version/s: 3.4.1 (was: 3.4.0) > NN doesn't remove the blocks from the failed

[jira] [Updated] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

[ https://issues.apache.org/jira/browse/HDFS-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15329: -- Target Version/s: 3.4.1 (was: 3.4.0) > Provide FileContext based ViewFSOverloadScheme implementation

[jira] [Commented] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

[ https://issues.apache.org/jira/browse/HDFS-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802419#comment-17802419 ] Shilun Fan commented on HDFS-15329: --- updated the target version for preparing 3.4.0 release. > Provide

[jira] [Updated] (HDFS-15354) clearCorruptLazyPersistFiles incrementalBlock removal should be out side write lock

[ https://issues.apache.org/jira/browse/HDFS-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15354: -- Target Version/s: 3.4.1 (was: 3.4.0) > clearCorruptLazyPersistFiles incrementalBlock removal should

[jira] [Commented] (HDFS-15354) clearCorruptLazyPersistFiles incrementalBlock removal should be out side write lock

[ https://issues.apache.org/jira/browse/HDFS-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802417#comment-17802417 ] Shilun Fan commented on HDFS-15354: --- updated the target version for preparing 3.4.0 release. >

[jira] [Updated] (HDFS-15337) Support available space choosing policy in HDFS Persistent Memory Cache

[ https://issues.apache.org/jira/browse/HDFS-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15337: -- Target Version/s: 3.4.1 (was: 3.4.0) > Support available space choosing policy in HDFS Persistent

[jira] [Commented] (HDFS-15357) Do not trust bad block reports from clients

[ https://issues.apache.org/jira/browse/HDFS-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802416#comment-17802416 ] Shilun Fan commented on HDFS-15357: --- updated the target version for preparing 3.4.0 release. > Do not

[jira] [Updated] (HDFS-15357) Do not trust bad block reports from clients

[ https://issues.apache.org/jira/browse/HDFS-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15357: -- Target Version/s: 2.10.3, 3.4.1 (was: 3.4.0, 2.10.3) > Do not trust bad block reports from clients >

[jira] [Updated] (HDFS-15509) Set safemode should not fail if one of the namenode is down.

[ https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15509: -- Target Version/s: 3.4.1 (was: 3.4.0) > Set safemode should not fail if one of the namenode is down. >

[jira] [Updated] (HDFS-15388) DFS cacheadmin, ECAdmin, StoragePolicyAdmin commands should handle ViewFSOverloadScheme

[ https://issues.apache.org/jira/browse/HDFS-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15388: -- Target Version/s: 3.4.1 (was: 3.4.0) > DFS cacheadmin, ECAdmin, StoragePolicyAdmin commands should

[jira] [Updated] (HDFS-15513) Allow client to query snapshot status on one directory

[ https://issues.apache.org/jira/browse/HDFS-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15513: -- Target Version/s: 3.4.1 (was: 3.4.0) > Allow client to query snapshot status on one directory >

[jira] [Updated] (HDFS-15686) Provide documentation for ViewHDFS

[ https://issues.apache.org/jira/browse/HDFS-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15686: -- Target Version/s: 3.4.1 (was: 3.4.0) > Provide documentation for ViewHDFS >

[jira] [Updated] (HDFS-15552) Let DeadNode Detector also work for EC cases

[ https://issues.apache.org/jira/browse/HDFS-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15552: -- Target Version/s: 3.4.1 (was: 3.4.0) > Let DeadNode Detector also work for EC cases >

[jira] [Updated] (HDFS-15609) Implement hdfs getconf -serverDefaults

[ https://issues.apache.org/jira/browse/HDFS-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15609: -- Target Version/s: 3.4.1 (was: 3.4.0) > Implement hdfs getconf -serverDefaults >

[jira] [Updated] (HDFS-15714) HDFS Provided Storage Read/Write Mount Support On-the-fly

[ https://issues.apache.org/jira/browse/HDFS-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15714: -- Target Version/s: 3.4.1 (was: 3.4.0) > HDFS Provided Storage Read/Write Mount Support On-the-fly >

[jira] [Updated] (HDFS-15701) Add resolveMountPath API in FileSystem

[ https://issues.apache.org/jira/browse/HDFS-15701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15701: -- Target Version/s: 3.4.1 (was: 3.4.0) > Add resolveMountPath API in FileSystem >

[jira] [Commented] (HDFS-15807) RefreshVolume fails when replacing DISK/ARCHIVE vol on same mount

[ https://issues.apache.org/jira/browse/HDFS-15807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802411#comment-17802411 ] Shilun Fan commented on HDFS-15807: --- We are preparing to release hadoop 3.4.0 version, and I am doing

[jira] [Resolved] (HDFS-15807) RefreshVolume fails when replacing DISK/ARCHIVE vol on same mount

[ https://issues.apache.org/jira/browse/HDFS-15807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-15807. --- Target Version/s: (was: 3.4.0) Resolution: Done > RefreshVolume fails when replacing

[jira] [Commented] (HDFS-15874) Extend TopMetrics to support callerContext aggregation.

[ https://issues.apache.org/jira/browse/HDFS-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802409#comment-17802409 ] Shilun Fan commented on HDFS-15874: --- [~zhuqi] We are preparing for the 3.4.0 version release, and I am

[jira] [Updated] (HDFS-15857) Space is missed in the print result of ECAdmin.RemoveECPolicyCommand

[ https://issues.apache.org/jira/browse/HDFS-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15857: -- Target Version/s: 3.4.1 (was: 3.4.0) > Space is missed in the print result of

[jira] [Commented] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY

[ https://issues.apache.org/jira/browse/HDFS-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802407#comment-17802407 ] ASF GitHub Bot commented on HDFS-17322: --- hadoop-yetus commented on PR #6405: URL:

[jira] [Updated] (HDFS-15874) Extend TopMetrics to support callerContext aggregation.

[ https://issues.apache.org/jira/browse/HDFS-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15874: -- Target Version/s: (was: 3.4.1) Resolution: Done Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15874) Extend TopMetrics to support callerContext aggregation.

[ https://issues.apache.org/jira/browse/HDFS-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15874: -- Target Version/s: 3.4.1 (was: 3.4.0) > Extend TopMetrics to support callerContext aggregation. >

[jira] [Updated] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause badly

[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16093: -- Target Version/s: 3.4.1 (was: 3.4.0) > DataNodes under decommission will still be returned to the

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16000: -- Target Version/s: 3.4.1 (was: 3.4.0) > HDFS : Rename performance optimization >

[jira] [Updated] (HDFS-16762) Make the default value of dfs.federation.router.client.allow-partial-listing as false.

[ https://issues.apache.org/jira/browse/HDFS-16762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16762: -- Target Version/s: 3.4.1 (was: 3.4.0) > Make the default value of

[jira] [Updated] (HDFS-16380) Result in unnecessary requeue on Observer NameNode when access by RBF in some scenes

[ https://issues.apache.org/jira/browse/HDFS-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16380: -- Target Version/s: 3.4.1 (was: 3.4.0) > Result in unnecessary requeue on Observer NameNode when access

[jira] [Updated] (HDFS-16133) Support refresh of IP addresses behind DNS for clients

[ https://issues.apache.org/jira/browse/HDFS-16133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16133: -- Target Version/s: 3.4.1 (was: 3.4.0) > Support refresh of IP addresses behind DNS for clients >

[jira] [Updated] (HDFS-16431) Truncate CallerContext in client side

[ https://issues.apache.org/jira/browse/HDFS-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16431: -- Target Version/s: 3.3.1, 3.4.1 (was: 3.3.1, 3.4.0) > Truncate CallerContext in client side >

[jira] [Updated] (HDFS-16818) RBF TestRouterRPCMultipleDestinationMountTableResolver non-deterministic unit tests failures

[ https://issues.apache.org/jira/browse/HDFS-16818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16818: -- Target Version/s: 3.4.1 (was: 3.4.0) > RBF TestRouterRPCMultipleDestinationMountTableResolver

[jira] [Updated] (HDFS-16790) rbf wrong path when destination dir is not created

[ https://issues.apache.org/jira/browse/HDFS-16790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16790: -- Target Version/s: 3.4.1 (was: 3.4.0) > rbf wrong path when destination dir is not created >

[jira] [Updated] (HDFS-16797) Remove WhiteBox in hdfs module.

[ https://issues.apache.org/jira/browse/HDFS-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16797: -- Target Version/s: 3.4.1 (was: 3.4.0) > Remove WhiteBox in hdfs module. >

[jira] [Updated] (HDFS-16874) Improve DataNode decommission for Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16874: -- Target Version/s: 3.4.1 (was: 3.4.0) > Improve DataNode decommission for Erasure Coding >

[jira] [Updated] (HDFS-16993) Datanode supports configure TopN DatanodeNetworkCounts

[ https://issues.apache.org/jira/browse/HDFS-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16993: -- Target Version/s: 3.4.1 (was: 3.4.0) > Datanode supports configure TopN DatanodeNetworkCounts >

[jira] [Updated] (HDFS-16940) Provide HTTP API health endpoints to simplify monitoring

[ https://issues.apache.org/jira/browse/HDFS-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16940: -- Target Version/s: 3.3.9, 3.4.1 (was: 3.4.0, 3.3.9) > Provide HTTP API health endpoints to simplify

[jira] [Resolved] (HDFS-17023) RBF: Record proxy time when call invokeConcurrent method.

[ https://issues.apache.org/jira/browse/HDFS-17023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17023. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Record proxy time

[jira] [Updated] (HDFS-17023) RBF: Record proxy time when call invokeConcurrent method.

[ https://issues.apache.org/jira/browse/HDFS-17023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17023: -- Target Version/s: 3.4.1 (was: 3.4.0) > RBF: Record proxy time when call invokeConcurrent method. >

[jira] [Updated] (HDFS-17123) Sort datanodeStorages when generating StorageBlockReport[] in method BPServiceActor#blockReport for future convenience

[ https://issues.apache.org/jira/browse/HDFS-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17123: -- Target Version/s: 3.4.1 (was: 3.4.0) > Sort datanodeStorages when generating StorageBlockReport[] in

[jira] [Updated] (HDFS-17072) DFSAdmin: add a triggerDirectoryScanner command

[ https://issues.apache.org/jira/browse/HDFS-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17072: -- Target Version/s: 3.4.1 (was: 3.4.0) > DFSAdmin: add a triggerDirectoryScanner command >

[jira] [Updated] (HDFS-17023) RBF: Record proxy time when call invokeConcurrent method.

[ https://issues.apache.org/jira/browse/HDFS-17023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17023: -- Target Version/s: 3.4.0 (was: 3.4.1) > RBF: Record proxy time when call invokeConcurrent method. >

[jira] [Updated] (HDFS-17061) EC: Let data blocks and parity blocks on DNs more balanced

[ https://issues.apache.org/jira/browse/HDFS-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17061: -- Target Version/s: 3.4.1 (was: 3.4.0) > EC: Let data blocks and parity blocks on DNs more balanced >

[jira] [Updated] (HDFS-17158) Show the rate of metrics in EC recovery task.

[ https://issues.apache.org/jira/browse/HDFS-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17158: -- Target Version/s: 3.4.1 (was: 3.4.0) > Show the rate of metrics in EC recovery task. >

[jira] [Updated] (HDFS-17126) FsDataSetImpl#checkAndUpdate should delete duplicated block meta file.

[ https://issues.apache.org/jira/browse/HDFS-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17126: -- Target Version/s: 3.4.1 (was: 3.4.0) > FsDataSetImpl#checkAndUpdate should delete duplicated block

[jira] [Updated] (HDFS-17125) Method checkAndUpdate should also resolve duplicate replicas when memBlockInfo.metadataExists() return false

[ https://issues.apache.org/jira/browse/HDFS-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17125: -- Target Version/s: 3.4.1 (was: 3.4.0) > Method checkAndUpdate should also resolve duplicate replicas

[jira] [Updated] (HDFS-17142) Refactor method BlockManager#chooseExcessRedundancies

[ https://issues.apache.org/jira/browse/HDFS-17142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17142: -- Target Version/s: 3.4.1 (was: 3.4.0) > Refactor method BlockManager#chooseExcessRedundancies >

[jira] [Updated] (HDFS-17149) getBlockLocations RPC should use actual client ip to compute network distance when using RBF.

[ https://issues.apache.org/jira/browse/HDFS-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17149: -- Target Version/s: 3.4.1 (was: 3.4.0) > getBlockLocations RPC should use actual client ip to compute

[jira] [Updated] (HDFS-17173) Whether the read lock in method moveBlockAcrossVolumes can be removed or not?

[ https://issues.apache.org/jira/browse/HDFS-17173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17173: -- Target Version/s: 3.4.1 (was: 3.4.0) > Whether the read lock in method moveBlockAcrossVolumes can be

[jira] [Updated] (HDFS-17160) Metrics fsyncCount should be computed correctly in flushOrSync

[ https://issues.apache.org/jira/browse/HDFS-17160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17160: -- Target Version/s: 3.4.1 (was: 3.4.0) > Metrics fsyncCount should be computed correctly in flushOrSync

[jira] [Updated] (HDFS-17185) Add acquire lock time for DataSetLockManager

[ https://issues.apache.org/jira/browse/HDFS-17185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17185: -- Target Version/s: 3.4.1 (was: 3.4.0) > Add acquire lock time for DataSetLockManager >

[jira] [Updated] (HDFS-17199) LightWeightResizableGSet#values() seems not thread-safe.

[ https://issues.apache.org/jira/browse/HDFS-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17199: -- Target Version/s: 3.4.1 (was: 3.4.0) > LightWeightResizableGSet#values() seems not thread-safe. >

[jira] [Updated] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

[ https://issues.apache.org/jira/browse/HDFS-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17188: -- Target Version/s: 3.4.1 (was: 3.4.0) > Data loss in our production clusters due to missing HDFS-16540

[jira] [Updated] (HDFS-17201) some methods in FsDatasetImpl should acquire readLock with LockLevel.VOLUME

[ https://issues.apache.org/jira/browse/HDFS-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17201: -- Target Version/s: 3.4.1 (was: 3.4.0) > some methods in FsDatasetImpl should acquire readLock with

[jira] [Commented] (HDFS-17245) Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol.

[ https://issues.apache.org/jira/browse/HDFS-17245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802402#comment-17802402 ] Shilun Fan commented on HDFS-17245: --- We do not need to fill in the fix version. This field needs to be

[jira] [Updated] (HDFS-17226) Building native libraries fails on Fedora 38

[ https://issues.apache.org/jira/browse/HDFS-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17226: -- Target Version/s: 3.3.9, 3.3.7, 3.4.1 (was: 3.4.0, 3.3.9, 3.3.7) > Building native libraries fails on

[jira] [Updated] (HDFS-17239) Remove logging of method removeReplicaFromMem which is in BLOCK_POOl write lock.

[ https://issues.apache.org/jira/browse/HDFS-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17239: -- Target Version/s: 3.4.1 (was: 3.4.0) > Remove logging of method removeReplicaFromMem which is in

[jira] [Updated] (HDFS-17245) Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol.

[ https://issues.apache.org/jira/browse/HDFS-17245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17245: -- Target Version/s: 3.4.1 (was: 3.4.0) > Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol. >

[jira] [Updated] (HDFS-17245) Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol.

[ https://issues.apache.org/jira/browse/HDFS-17245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17245: -- Affects Version/s: 3.4.0 > Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol. >

[jira] [Updated] (HDFS-17251) RBF: Optimize MountTableResolver#TRASH_PATTERN

[ https://issues.apache.org/jira/browse/HDFS-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17251: -- Target Version/s: 3.4.1 (was: 3.4.0) > RBF: Optimize MountTableResolver#TRASH_PATTERN >

[jira] [Updated] (HDFS-17245) Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol.

[ https://issues.apache.org/jira/browse/HDFS-17245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17245: -- Fix Version/s: (was: 3.4.0) > Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol. >

[jira] [Updated] (HDFS-17252) RBF: getListing results is incorrect.

[ https://issues.apache.org/jira/browse/HDFS-17252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17252: -- Target Version/s: 3.4.1 (was: 3.4.0) > RBF: getListing results is incorrect. >

[jira] [Updated] (HDFS-17267) Client send the smae packet multiple times when method markSlowNode throws IOException.

[ https://issues.apache.org/jira/browse/HDFS-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17267: -- Target Version/s: 3.4.1 (was: 3.4.0) > Client send the smae packet multiple times when method

[jira] [Updated] (HDFS-17280) Pipeline recovery should better end block in advance when bytes acked greater than half of blocksize.

[ https://issues.apache.org/jira/browse/HDFS-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17280: -- Target Version/s: 3.4.1 (was: 3.4.0) > Pipeline recovery should better end block in advance when

[jira] [Updated] (HDFS-17281) Added support of reporting RPC round-trip time at NN.

[ https://issues.apache.org/jira/browse/HDFS-17281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17281: -- Target Version/s: 3.3.7, 3.4.1 (was: 3.4.0, 3.3.7) > Added support of reporting RPC round-trip time

[jira] [Updated] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17283: -- Target Version/s: 3.4.1 (was: 3.4.0) > Change the name of variable SECOND in HdfsClientConfigKeys >

[jira] [Updated] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17289: -- Target Version/s: 3.4.1 (was: 3.4.0) > Considering the size of non-lastBlocks equals to complete

[jira] [Updated] (HDFS-17286) Add UDP as a transfer protocol for HDFS

[ https://issues.apache.org/jira/browse/HDFS-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17286: -- Target Version/s: 3.4.1 (was: 3.4.0) > Add UDP as a transfer protocol for HDFS >

[jira] [Updated] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17291: -- Target Version/s: 3.4.1 > DataNode metric bytesWritten is not totally accurate in some situations. >

[jira] [Updated] (HDFS-17318) RBF: MountTableResolver#locationCache supports multi policies

[ https://issues.apache.org/jira/browse/HDFS-17318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17318: -- Target Version/s: 3.4.1 > RBF: MountTableResolver#locationCache supports multi policies >

[jira] [Updated] (HDFS-17314) Add a metrics to record congestion backoff counts.

[ https://issues.apache.org/jira/browse/HDFS-17314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17314: -- Target Version/s: 3.4.1 > Add a metrics to record congestion backoff counts. >

[jira] [Updated] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17293: -- Target Version/s: 3.4.1 > First packet data + checksum size will be set to 516 bytes when writing to a

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17312: -- Target Version/s: 3.4.1 > packetsReceived metric should ignore heartbeat packet >

[jira] [Updated] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY

[ https://issues.apache.org/jira/browse/HDFS-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17322: -- Target Version/s: 3.4.1 > RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY >

[jira] [Updated] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17293: -- Target Version/s: (was: 3.4.0) > First packet data + checksum size will be set to 516 bytes when

[jira] [Updated] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17291: -- Target Version/s: (was: 3.4.0) > DataNode metric bytesWritten is not totally accurate in some

[jira] [Updated] (HDFS-17318) RBF: MountTableResolver#locationCache supports multi policies

[ https://issues.apache.org/jira/browse/HDFS-17318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17318: -- Target Version/s: (was: 3.4.0) > RBF: MountTableResolver#locationCache supports multi policies >

<    1   2   3   4   >