[jira] [Updated] (HDFS-15250) Setting `dfs.client.use.datanode.hostname` to true can crash the system because of unhandled UnresolvedAddressException

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15250: -- Component/s: hdfs-client Target Version/s: 3.3.1, 3.2.2, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15332: -- Component/s: qouta snapshots Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15403: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.2.2, 3.4.0

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15660: -- Component/s: build Target Version/s: 3.3.2, 2.10.2, 2.9.3 (was: 2.9.3, 2.10.2, 3.3.2) >

[jira] [Updated] (HDFS-15779) EC: fix NPE caused by StripedWriter.clearBuffers during reconstruct block

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15779: -- Component/s: erasure-coding Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1,

[jira] [Updated] (HDFS-15632) AbstractContractDeleteTest should set recursive parameter to true for recursive test cases.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15632: -- Component/s: test > AbstractContractDeleteTest should set recursive parameter to true for > recursive

[jira] [Updated] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15661: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15868: -- Component/s: namanode Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15998) Fix NullPointException In listOpenFiles

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15998: -- Component/s: namanode Target Version/s: 3.3.2, 3.4.0 > Fix NullPointException In

[jira] [Updated] (HDFS-16177) Bug fix for Util#receiveFile

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16177: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-15745) Make DataNodePeerMetrics#LOW_THRESHOLD_MS and MIN_OUTLIER_DETECTION_NODES configurable

2024-02-10 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15745: -- Component/s: datanode metrics Target Version/s: 3.3.5, 3.4.0

[jira] [Updated] (HDFS-15882) Fix incorrectly initializing RandomAccessFile based on configuration options

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15882: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix

[jira] [Updated] (HDFS-15384) Document getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15384: -- Component/s: documentation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Document

[jira] [Updated] (HDFS-16163) Avoid locking entire blockPinningFailures map

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16163: -- Component/s: balancer Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16160) Improve the parameter annotation in DatanodeProtocol#sendHeartbeat

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16160: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16246) Print lockWarningThreshold in InstrumentedLock#logWarning and InstrumentedLock#logWaitWarning

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16246: -- Component/s: common Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16247) RBF: Fix the ProcessingAvgTime and ProxyAvgTime code comments and document metrics describe ms unit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16247: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16266) Add remote port information to HDFS audit log

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16266: -- Component/s: ipc namanode Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16296) RBF: RouterRpcFairnessPolicyController add denied permits for each nameservice

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16296: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16352) return the real datanode numBlocks in #getDatanodeStorageReport

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16352: -- Component/s: datanode Target Version/s: 3.3.5, 3.2.4, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16375) The FBR lease ID should be exposed to the log

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16375: -- Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0 (was: 3.4.0, 3.3.2) > The FBR lease ID

[jira] [Updated] (HDFS-16434) Add opname to read/write lock for remaining operations

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16434: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (HDFS-16585) Add @VisibleForTesting in Dispatcher.java after HDFS-16268

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16585: -- Component/s: balancer Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.2.4, 3.4.0

[jira] [Updated] (HDFS-16599) Fix typo in hadoop-hdfs-rbf module

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16599: -- Component/s: rbf Target Version/s: 3.4.0 > Fix typo in hadoop-hdfs-rbf module >

[jira] [Updated] (HDFS-15263) Fix the logic of scope and excluded scope in Network Topology

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15263: -- Component/s: net Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix the logic of

[jira] [Updated] (HDFS-15331) Remove invalid exclusions that minicluster dependency on HDFS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15331: -- Component/s: build Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15378: -- Component/s: test Target Version/s: 3.2.3, 3.3.1, 3.4.0 Affects Version/s: 3.2.3

[jira] [Updated] (HDFS-14546) Document block placement policies

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14546: -- Component/s: documentation Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15875) Check whether file is being truncated before truncate

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15875: -- Component/s: datanode fs namanode Hadoop

[jira] [Updated] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16068: -- Component/s: webhdfs Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.2.3, 2.10.2,

[jira] [Updated] (HDFS-16057) Make sure the order for location in ENTERING_MAINTENANCE state

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16057: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15175: -- Component/s: namnode Target Version/s: 3.2.4, 3.3.2, 3.2.3, 3.4.0 > Multiple CloseOp shared

[jira] [Updated] (HDFS-15877) BlockReconstructionWork should resetTargets() before BlockManager#validateReconstructionWork return false

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15877: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (HDFS-16149) Improve the parameter annotation in FairCallQueue#priorityLevels

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16149: -- Component/s: ipc Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15936) Solve BlockSender#sendPacket() does not record SocketTimeout exception

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15936: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16209) Add description for dfs.namenode.caching.enabled

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16209: -- Component/s: documentation Hadoop Flags: Reviewed Target Version/s: 3.4.0 > Add

[jira] [Updated] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16315: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16348) Mark slownode as badnode to recover pipeline

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16348: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16391) Avoid evaluation of LOG.debug statement in NameNodeHeartbeatService

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16391: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15316: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15300) RBF: updateActiveNamenode() is invalid when RPC address is IP

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15300: -- Component/s: rbf > RBF: updateActiveNamenode() is invalid when RPC address is IP >

[jira] [Updated] (HDFS-15300) RBF: updateActiveNamenode() is invalid when RPC address is IP

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15300: -- Affects Version/s: 3.3.1 3.4.0 > RBF: updateActiveNamenode() is invalid when

[jira] [Updated] (HDFS-15300) RBF: updateActiveNamenode() is invalid when RPC address is IP

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15300: -- Target Version/s: 3.3.1, 3.4.0 > RBF: updateActiveNamenode() is invalid when RPC address is IP >

[jira] [Updated] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15246: -- Component/s: namanode Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15538) Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15538: -- Component/s: documentation Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1,

[jira] [Updated] (HDFS-15988) Stabilise HDFS Pre-Commit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15988: -- Component/s: build test Target Version/s: 3.4.0 > Stabilise HDFS

[jira] [Updated] (HDFS-15988) Stabilise HDFS Pre-Commit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15988: -- Affects Version/s: 3.4.0 > Stabilise HDFS Pre-Commit > - > >

[jira] [Updated] (HDFS-16031) Possible Resource Leak in org.apache.hadoop.hdfs.server.aliasmap#InMemoryAliasMap

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16031: -- Component/s: server Target Version/s: 3.3.2, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets.

2024-02-10 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17359: -- Fix Version/s: 3.4.0 > EC: recheck failed streamers should only after flushing all packets. >

[jira] [Updated] (HDFS-16198) Short circuit read leaks Slot objects when InvalidToken exception is thrown

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16198: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2,

[jira] [Updated] (HDFS-16329) Fix log format for BlockManager

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16329: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2,

[jira] [Updated] (HDFS-16311) Metric metadataOperationRate calculation error in DataNodeVolumeMetrics

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16311: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16503) Should verify whether the path name is valid in the WebHDFS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16503: -- Component/s: webhdfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Should verify

[jira] [Updated] (HDFS-16359) RBF: RouterRpcServer#invokeAtAvailableNs does not take effect when retrying

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16359: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF:

[jira] [Updated] (HDFS-16369) RBF: Fix the retry logic of RouterRpcServer#invokeAtAvailableNs

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16369: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Fix the retry

[jira] [Updated] (HDFS-16370) Fix assert message for BlockInfo

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16370: -- Component/s: block placement Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix

[jira] [Updated] (HDFS-16377) Should CheckNotNull before access FsDatasetSpi

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16377: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16385) Fix Datanode retrieve slownode information bug.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16385: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16271) RBF: NullPointerException when setQuota through routers with quota disabled

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16271: -- Component/s: rbf > RBF: NullPointerException when setQuota through routers with quota disabled >

[jira] [Updated] (HDFS-16272) Int overflow in computing safe length during EC block recovery

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16272: -- Component/s: (was: 3.1.1) > Int overflow in computing safe length during EC block recovery >

[jira] [Updated] (HDFS-16181) [SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16181: -- Component/s: journal-node metrics Target Version/s: 3.2.4, 3.3.2,

[jira] [Updated] (HDFS-16361) Fix log format for QueryCommand

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16361: -- Component/s: command diskbalancer Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16373) Fix MiniDFSCluster restart in case of multiple namenodes

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16373: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16303: -- Component/s: block placement datanode Target Version/s: 3.3.5, 3.2.4,

[jira] [Updated] (HDFS-16410) Insecure Xml parsing in OfflineEditsXmlLoader

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16410: -- Component/s: tools Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.2.3, 2.10.2,

[jira] [Updated] (HDFS-16402) Improve HeartbeatManager logic to avoid incorrect stats

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16402: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve

[jira] [Updated] (HDFS-16393) RBF: Fix TestRouterRPCMultipleDestinationMountTableResolver

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16393: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Fix

[jira] [Updated] (HDFS-16409) Fix typo: testHasExeceptionsReturnsCorrectValue -> testHasExceptionsReturnsCorrectValue

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16409: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16406) DataNode metric ReadsFromLocalClient does not count short-circuit reads

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16406: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16507: -- Component/s: namanode Target Version/s: 3.3.3, 3.4.0 (was: 3.3.3) > [SBN read] Avoid purging

[jira] [Resolved] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-02-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17146. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Use the dfsadmin

[jira] [Updated] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-02-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17146: -- Component/s: dfsadmin Fix Version/s: 3.4.1 Target Version/s: 3.5.0 > Use the dfsadmin

[jira] [Updated] (HDFS-14099) Unknown frame descriptor when decompressing multiple frames in ZStandardDecompressor

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14099: -- Component/s: io compress Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15690: -- Component/s: test Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15576: -- Component/s: erasure-coding test Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-15898) Test case TestOfflineImageViewer fails

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15898: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0 Affects

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15410: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add separated

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15374: -- Component/s: documentation rbf Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15614: -- Component/s: namanode snapshots Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-15598) ViewHDFS#canonicalizeUri should not be restricted to DFS only API.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15598: -- Component/s: viewfs Target Version/s: 3.4.0 > ViewHDFS#canonicalizeUri should not be

[jira] [Updated] (HDFS-15677) TestRouterRpcMultiDestination#testGetCachedDatanodeReport fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15677: -- Component/s: rbf test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-15702) Fix intermittent falilure of TestDecommission#testAllocAndIBRWhileDecommission

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15702: -- Component/s: hdfs test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-15767) RBF: Router federation rename of directory.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15767: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Router

[jira] [Updated] (HDFS-15820) Ensure snapshot root trash provisioning happens only post safe mode exit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15820: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15817) Rename snapshots while marking them deleted

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15817: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15847: -- Component/s: erasure-coding namanode Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15973) RBF: Add permission check before doing router federation rename.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15973: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16192) ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16192: -- Component/s: viewfs Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16222) Fix ViewDFS with mount points for HDFS only API

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16222: -- Component/s: viewfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix ViewDFS with

[jira] [Updated] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15987: -- Component/s: tools Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve oiv tool

[jira] [Updated] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16484: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.2.4, 3.4.0

[jira] [Updated] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16488: -- Component/s: metrics sps Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16526) Add metrics for slow DataNode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16526: -- Component/s: datanode metrics Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16460: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13274: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Extend

[jira] [Updated] (HDFS-15951) Remove unused parameters in NameNodeProxiesClient

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15951: -- Component/s: hdfs-client Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15975) Use LongAdder instead of AtomicLong

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15975: -- Component/s: metrics Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Assigned] (HDFS-16535) SlotReleaser should reuse the domain socket based on socket paths

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16535: - Assignee: Quanlong Huang > SlotReleaser should reuse the domain socket based on socket paths >

[jira] [Updated] (HDFS-16312) Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16312: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16298) Improve error msg for BlockMissingException

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16298: -- Component/s: hdfs-client Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2,

<    1   2   3   4   5   6   7   8   9   10   >