[jira] [Updated] (HDFS-16813) Remove parameter validation logic such as dfs.namenode.decommission.blocks.per.interval in DatanodeAdminManager#activate

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16813: -- Component/s: datanode > Remove parameter validation logic such as >

[jira] [Updated] (HDFS-16813) Remove parameter validation logic such as dfs.namenode.decommission.blocks.per.interval in DatanodeAdminManager#activate

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16813: -- Target Version/s: 3.4.0 > Remove parameter validation logic such as >

[jira] [Updated] (HDFS-16811) Support DecommissionBackoffMonitor parameters reconfigurable

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16811: -- Component/s: datanode namanode > Support DecommissionBackoffMonitor parameters

[jira] [Updated] (HDFS-16813) Remove parameter validation logic such as dfs.namenode.decommission.blocks.per.interval in DatanodeAdminManager#activate

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16813: -- Affects Version/s: 3.4.0 > Remove parameter validation logic such as >

[jira] [Updated] (HDFS-16817) Remove useless DataNode lock related configuration

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16817: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Remove useless

[jira] [Updated] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16822: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > HostRestrictingAuthorizationFilter

[jira] [Updated] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16822: -- Component/s: webhdfs > HostRestrictingAuthorizationFilter should pass through requests if they don't

[jira] [Updated] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16822: -- Affects Version/s: 3.3.6 3.4.0 > HostRestrictingAuthorizationFilter should pass

[jira] [Updated] (HDFS-16831) [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16831: -- Component/s: namanode rbf > [RBF SBN] GetNamenodesForNameserviceId should shuffle

[jira] [Updated] (HDFS-16826) [RBF SBN] ConnectionManager should advance the client stateId for every request

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16826: -- Component/s: namanode rbf Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16831) [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16831: -- Target Version/s: 3.4.0 > [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes >

[jira] [Updated] (HDFS-16831) [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16831: -- Affects Version/s: 3.4.0 > [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes >

[jira] [Updated] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16833: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > NameNode

[jira] [Updated] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16832: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0

[jira] [Updated] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16833: -- Component/s: erasure-coding > NameNode should log internal EC blocks instead of the EC block group

[jira] [Updated] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16837: -- Target Version/s: 3.4.0 > [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max

[jira] [Updated] (HDFS-16836) StandbyCheckpointer can still trigger rollback fs image after RU is finalized

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16836: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16834) PoolAlignmentContext should not max poolLocalStateId with sharedGlobalStateId when sending requests to the namenode.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16834: -- Component/s: namnode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16837: -- Affects Version/s: 3.4.0 > [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the

[jira] [Updated] (HDFS-16837) [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespace

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16837: -- Component/s: rbf > [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max >

[jira] [Updated] (HDFS-16838) Fix NPE in testAddRplicaProcessorForAddingReplicaInMap

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16838: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix NPE in

[jira] [Updated] (HDFS-16838) Fix NPE in testAddRplicaProcessorForAddingReplicaInMap

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16838: -- Component/s: test > Fix NPE in testAddRplicaProcessorForAddingReplicaInMap >

[jira] [Updated] (HDFS-16839) It should consider EC reconstruction work when we determine if a node is busy

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16839: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16840) Enhance the usage description about oiv in HDFSCommands.md and OfflineImageViewerPB

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16840: -- Component/s: hdfs Hadoop Flags: Reviewed Target Version/s: 3.4.0 > Enhance the usage

[jira] [Updated] (HDFS-16841) Enhance the function of DebugAdmin#VerifyECCommand

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16841: -- Affects Version/s: 3.4.0 > Enhance the function of DebugAdmin#VerifyECCommand >

[jira] [Updated] (HDFS-16841) Enhance the function of DebugAdmin#VerifyECCommand

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16841: -- Component/s: erasure-coding Target Version/s: 3.4.0 > Enhance the function of

[jira] [Updated] (HDFS-16840) Enhance the usage description about oiv in HDFSCommands.md and OfflineImageViewerPB

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16840: -- Affects Version/s: 3.4.0 > Enhance the usage description about oiv in HDFSCommands.md and >

[jira] [Updated] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16845: -- Component/s: configuration Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (HDFS-16844) [RBF] The routers should be resiliant against exceptions from StateStore

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16844: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 > [RBF] The routers should be resiliant

[jira] [Updated] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16846: -- Component/s: erasure-coding (was: ec) Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-16847) RBF: StateStore writer should not commit tmp fail if there was an error in writing the file.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16847: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16848) RBF: Improve StateStoreZookeeperImpl

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16848: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Improve StateStoreZookeeperImpl >

[jira] [Updated] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16852: -- Hadoop Flags: Reviewed Affects Version/s: 3.3.6 3.4.0

[jira] [Updated] (HDFS-16851) RBF: Add a utility to dump the StateStore

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16851: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Assigned] (HDFS-16858) Dynamically adjust max slow disks to exclude

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16858: - Assignee: dingshun > Dynamically adjust max slow disks to exclude >

[jira] [Updated] (HDFS-16860) Upgrade moment.min.js to 2.29.4

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16860: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 > Upgrade moment.min.js to 2.29.4 >

[jira] [Updated] (HDFS-16858) Dynamically adjust max slow disks to exclude

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16858: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Dynamically

[jira] [Updated] (HDFS-16865) RBF: The source path is always / after RBF proxied the complete, addBlock and getAdditionalDatanode RPC.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16865: -- Affects Version/s: 3.4.0 > RBF: The source path is always / after RBF proxied the complete, addBlock

[jira] [Updated] (HDFS-16861) RBF. Truncate API always fails when dirs use AllResolver oder on Router

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16861: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 > RBF. Truncate API always fails when dirs use

[jira] [Updated] (HDFS-16866) Fix a typo in Dispatcher.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16866: -- Component/s: balancer > Fix a typo in Dispatcher. > - > > Key:

[jira] [Updated] (HDFS-16868) Fix audit log duplicate issue when an ACE occurs in FSNamesystem.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16868: -- Component/s: fs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix audit log

[jira] [Updated] (HDFS-16866) Fix a typo in Dispatcher.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16866: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix a typo in

[jira] [Updated] (HDFS-16871) DiskBalancer process may throws IllegalArgumentException when the target DataNode has capital letter in hostname

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16871: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16872: -- Component/s: namanode > Fix log throttling by declaring LogThrottlingHelper as static members >

[jira] [Updated] (HDFS-16873) FileStatus compareTo does not specify ordering

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16873: -- Hadoop Flags: Reviewed > FileStatus compareTo does not specify ordering >

[jira] [Updated] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16872: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > Fix log throttling by declaring

[jira] [Assigned] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16872: - Assignee: Chengbing Liu > Fix log throttling by declaring LogThrottlingHelper as static members

[jira] [Updated] (HDFS-16873) FileStatus compareTo does not specify ordering

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16873: -- Component/s: documentation > FileStatus compareTo does not specify ordering >

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16876: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Garbage

[jira] [Updated] (HDFS-16873) FileStatus compareTo does not specify ordering

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16873: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > FileStatus compareTo does not specify ordering

[jira] [Updated] (HDFS-16877) Namenode doesn't use alignment context in TestObserverWithRouter

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16877: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Namenode

[jira] [Updated] (HDFS-16879) EC : Fsck -blockId shows number of redundant internal block replicas for EC Blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16879: -- Component/s: erasure-coding > EC : Fsck -blockId shows number of redundant internal block replicas for

[jira] [Updated] (HDFS-16879) EC : Fsck -blockId shows number of redundant internal block replicas for EC Blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16879: -- Affects Version/s: 3.4.0 > EC : Fsck -blockId shows number of redundant internal block replicas for EC

[jira] [Updated] (HDFS-16879) EC : Fsck -blockId shows number of redundant internal block replicas for EC Blocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16879: -- Target Version/s: 3.4.0 > EC : Fsck -blockId shows number of redundant internal block replicas for EC

[jira] [Updated] (HDFS-16882) RBF: Add cache hit rate metric in MountTableResolver#getDestinationForPath

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16882: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > RBF: Add cache hit rate metric in

[jira] [Updated] (HDFS-16881) Warn if AccessControlEnforcer runs for a long time to check permission

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16881: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Warn if AccessControlEnforcer runs for a long

[jira] [Updated] (HDFS-16886) Fix documentation for StateStoreRecordOperations#get(Class ..., Query ...)

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16886: -- Component/s: documentation Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0

[jira] [Updated] (HDFS-16884) Fix TestFsDatasetImpl#testConcurrentWriteAndDeleteBlock failed

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16884: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16883) Duplicate field name in hdfs-default.xml

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16883: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Duplicate field name in hdfs-default.xml >

[jira] [Updated] (HDFS-16885) Fix TestHdfsConfigFields#testCompareConfigurationClassAgainstXml failed

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16885: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix

[jira] [Updated] (HDFS-16887) Log start and end of phase/step in startup progress

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16887: -- Hadoop Flags: Reviewed > Log start and end of phase/step in startup progress >

[jira] [Updated] (HDFS-16893) Standardize the usage of DFSClient debug log

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16893: -- Hadoop Flags: Reviewed > Standardize the usage of DFSClient debug log >

[jira] [Updated] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16888: -- Component/s: block placement > BlockManager#maxReplicationStreams, replicationStreamsHardLimit, >

[jira] [Updated] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16888: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16890) RBF: Add period state refresh to keep router state near active namenode's

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16890: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16895) NamenodeHeartbeatService should use credentials of logged in user

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16895: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 > NamenodeHeartbeatService should use

[jira] [Updated] (HDFS-16895) NamenodeHeartbeatService should use credentials of logged in user

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16895: -- Affects Version/s: 3.3.5 3.4.0 > NamenodeHeartbeatService should use

[jira] [Updated] (HDFS-16896) HDFS Client hedged read has increased failure rate than without hedged read

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16896: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16897) Fix abundant Broken pipe exception in BlockSender

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16897: -- Target Version/s: 3.3.6, 3.4.0 > Fix abundant Broken pipe exception in BlockSender >

[jira] [Updated] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16901: -- Affects Version/s: 3.3.6 3.4.0 > RBF: Routers should propagate the real user in

[jira] [Updated] (HDFS-16898) Remove write lock for processCommandFromActor of DataNode to reduce impact on heartbeat

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16898: -- Target Version/s: 3.4.0, 3.3.7 > Remove write lock for processCommandFromActor of DataNode to reduce

[jira] [Updated] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16901: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > RBF: Routers should propagate the real

[jira] [Updated] (HDFS-16898) Remove write lock for processCommandFromActor of DataNode to reduce impact on heartbeat

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16898: -- Component/s: datanode > Remove write lock for processCommandFromActor of DataNode to reduce impact on

[jira] [Updated] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16901: -- Component/s: rbf > RBF: Routers should propagate the real user in the UGI via the caller context >

[jira] [Updated] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16903: -- Target Version/s: 3.4.0 > Fix javadoc of Class LightWeightResizableGSet >

[jira] [Updated] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16902: -- Component/s: namanode > Add Namenode status to BPServiceActor metrics and improve logging in >

[jira] [Updated] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16902: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Assigned] (HDFS-16904) Close webhdfs during the teardown

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16904: - Assignee: Steve Vaughan > Close webhdfs during the teardown > -

[jira] [Updated] (HDFS-16904) Close webhdfs during the teardown

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16904: -- Target Version/s: 3.4.0, 3.3.9 > Close webhdfs during the teardown > -

[jira] [Updated] (HDFS-16907) Add LastHeartbeatResponseTime for BP service actor

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16907: -- Hadoop Flags: Reviewed > Add LastHeartbeatResponseTime for BP service actor >

[jira] [Updated] (HDFS-16908) Fix javadoc of field IncrementalBlockReportManager#readyToSend.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16908: -- Target Version/s: 3.4.0 > Fix javadoc of field IncrementalBlockReportManager#readyToSend. >

[jira] [Updated] (HDFS-16910) Fix incorrectly initializing RandomAccessFile caused flush performance decreased for JN

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16910: -- Component/s: namanode > Fix incorrectly initializing RandomAccessFile caused flush performance >

[jira] [Updated] (HDFS-16911) Distcp with snapshot diff to support Ozone filesystem.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16911: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Distcp with

[jira] [Updated] (HDFS-16910) Fix incorrectly initializing RandomAccessFile caused flush performance decreased for JN

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16910: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix incorrectly initializing RandomAccessFile

[jira] [Updated] (HDFS-16914) Add some logs for updateBlockForPipeline RPC.

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16914: -- Hadoop Flags: Reviewed Target Version/s: 3.4.0 > Add some logs for updateBlockForPipeline RPC.

[jira] [Updated] (HDFS-16917) Add transfer rate quantile metrics for DataNode reads

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16917: -- Hadoop Flags: Reviewed Target Version/s: 3.3.0, 3.4.0 Affects Version/s: 3.3.0

[jira] [Updated] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16923: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16933) A race in SerialNumberMap will cause wrong owner, group and XATTR

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16933: -- Component/s: namanode > A race in SerialNumberMap will cause wrong owner, group and XATTR >

[jira] [Updated] (HDFS-16925) Namenode audit log to only include IP address of client

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16925: -- Affects Version/s: 3.3.6 3.4.0 > Namenode audit log to only include IP address

[jira] [Updated] (HDFS-16925) Namenode audit log to only include IP address of client

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16925: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 >

[jira] [Updated] (HDFS-16935) TestFsDatasetImpl.testReportBadBlocks brittle

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16935: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 > TestFsDatasetImpl.testReportBadBlocks

[jira] [Updated] (HDFS-16933) A race in SerialNumberMap will cause wrong owner, group and XATTR

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16933: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > A race in SerialNumberMap will cause wrong

[jira] [Updated] (HDFS-16934) org.apache.hadoop.hdfs.tools.TestDFSAdmin#testAllDatanodesReconfig regression

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16934: -- Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 >

[jira] [Updated] (HDFS-16942) Send error to datanode if FBR is rejected due to bad lease

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16942: -- Hadoop Flags: Reviewed Target Version/s: 3.3.6, 3.4.0 Affects Version/s: 3.3.6

[jira] [Updated] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16943: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Implement MySQL based StateStoreDriver >

[jira] [Updated] (HDFS-16939) Fix the thread safety bug in LowRedundancyBlocks

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16939: -- Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5 3.4.0 > Fix the

[jira] [Updated] (HDFS-16948) Update log of BlockManager#chooseExcessRedundancyStriped when EC internal block is moved by balancer

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16948: -- Component/s: erasure-coding Target Version/s: 3.4.0 > Update log of

[jira] [Updated] (HDFS-16946) RBF: top real owners metrics can't been parsed json string

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16946: -- Target Version/s: 3.4.0 > RBF: top real owners metrics can't been parsed json string >

[jira] [Updated] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16947: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16949) Update ReadTransferRate to ReadLatencyPerGB for effective percentile metrics

2024-01-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16949: -- Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Update ReadTransferRate to ReadLatencyPerGB

  1   2   3   4   >