[jira] [Commented] (HDFS-17357) NioInetPeer.close() should close socket connection.

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840974#comment-17840974 ] ASF GitHub Bot commented on HDFS-17357: --- hadoop-yetus commented on PR #6502: URL: https

[jira] [Commented] (HDFS-17364) Use WeakReferencedElasticByteBufferPool in DFSStripedInputStream

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840969#comment-17840969 ] ASF GitHub Bot commented on HDFS-17364: --- hadoop-yetus commented on PR #6514: URL: https

[jira] [Commented] (HDFS-17360) Record the number of times a block is read during a certain time period.

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840960#comment-17840960 ] ASF GitHub Bot commented on HDFS-17360: --- hadoop-yetus commented on PR #6505: URL: https

[jira] [Commented] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840925#comment-17840925 ] ASF GitHub Bot commented on HDFS-17367: --- hadoop-yetus commented on PR #6735: URL: https

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840896#comment-17840896 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL: https

[jira] [Commented] (HDFS-17374) EC: StripedBlockReader#newConnectedPeer should set SO_TIMEOUT and SO_KEEPALIVE

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840839#comment-17840839 ] ASF GitHub Bot commented on HDFS-17374: --- hadoop-yetus commented on PR #6536: URL: https

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840782#comment-17840782 ] ASF GitHub Bot commented on HDFS-17372: --- hfutatzhanghb commented on PR #6530: URL: https

[jira] [Commented] (HDFS-17381) Distcp of EC files should not be limited to DFS.

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840777#comment-17840777 ] ASF GitHub Bot commented on HDFS-17381: --- hadoop-yetus commented on PR #6551: URL: https

[jira] [Commented] (HDFS-17463) Support the switch StringTable Split ID feature

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840762#comment-17840762 ] ASF GitHub Bot commented on HDFS-17463: --- hadoop-yetus commented on PR #6736: URL: https

[jira] [Commented] (HDFS-17382) Add Apache Log4j Extras Library to Hadoop 3.3 for Enhanced Log Rolling Capabilities

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840758#comment-17840758 ] ASF GitHub Bot commented on HDFS-17382: --- hadoop-yetus commented on PR #6584: URL: https

[jira] [Commented] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840755#comment-17840755 ] ASF GitHub Bot commented on HDFS-17372: --- hadoop-yetus commented on PR #6530: URL: https

[jira] [Commented] (HDFS-17446) The DataNode adds a log to report its progress during addToReplicasMap execution.

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840738#comment-17840738 ] ASF GitHub Bot commented on HDFS-17446: --- hadoop-yetus commented on PR #6685: URL: https

[jira] [Commented] (HDFS-17378) Missing operationType for some operations in authorizer

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840689#comment-17840689 ] ASF GitHub Bot commented on HDFS-17378: --- hadoop-yetus commented on PR #6553: URL: https

[jira] [Commented] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840685#comment-17840685 ] ASF GitHub Bot commented on HDFS-17352: --- hadoop-yetus commented on PR #6559: URL: https

[jira] [Commented] (HDFS-17463) Support the switch StringTable Split ID feature

2024-04-25 Thread wangzhihui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840658#comment-17840658 ] wangzhihui commented on HDFS-17463: --- hi , [~ste...@apache.org]  We have added a feature to support

[jira] [Commented] (HDFS-17401) EC: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840653#comment-17840653 ] ASF GitHub Bot commented on HDFS-17401: --- hadoop-yetus commented on PR #6597: URL: https

[jira] [Commented] (HDFS-17397) Choose another DN as soon as possible, when encountering network issues

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840636#comment-17840636 ] ASF GitHub Bot commented on HDFS-17397: --- hadoop-yetus commented on PR #6591: URL: https

[jira] [Commented] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840628#comment-17840628 ] ASF GitHub Bot commented on HDFS-17384: --- hfutatzhanghb commented on code in PR #6762: URL: https

[jira] [Commented] (HDFS-17499) removeQueuedBlock in PendingDataNodeMessages has memory leak

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840617#comment-17840617 ] ASF GitHub Bot commented on HDFS-17499: --- hadoop-yetus commented on PR #6772: URL: https

[jira] [Commented] (HDFS-17402) StartupSafeMode should not exit when resources are from low to available

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840599#comment-17840599 ] ASF GitHub Bot commented on HDFS-17402: --- hadoop-yetus commented on PR #6618: URL: https

[jira] [Commented] (HDFS-17438) RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840558#comment-17840558 ] ASF GitHub Bot commented on HDFS-17438: --- hadoop-yetus commented on PR #6655: URL: https

[jira] [Commented] (HDFS-17477) IncrementalBlockReport race condition additional edge cases

2024-04-24 Thread Danny Becker (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840537#comment-17840537 ] Danny Becker commented on HDFS-17477: - [~ayushtkn] [~zhanghaobo] I have created a JIRA to address

[jira] [Updated] (HDFS-17499) removeQueuedBlock in PendingDataNodeMessages has memory leak

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17499: -- Labels: pull-request-available (was: ) > removeQueuedBlock in PendingDataNodeMessages

[jira] [Commented] (HDFS-17499) removeQueuedBlock in PendingDataNodeMessages has memory leak

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840536#comment-17840536 ] ASF GitHub Bot commented on HDFS-17499: --- dannytbecker opened a new pull request, #6772: URL: https

[jira] [Created] (HDFS-17499) removeQueuedBlock in PendingDataNodeMessages has memory leak

2024-04-24 Thread Danny Becker (Jira)
Danny Becker created HDFS-17499: --- Summary: removeQueuedBlock in PendingDataNodeMessages has memory leak Key: HDFS-17499 URL: https://issues.apache.org/jira/browse/HDFS-17499 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840522#comment-17840522 ] ASF GitHub Bot commented on HDFS-17439: --- hadoop-yetus commented on PR #6677: URL: https

[jira] [Commented] (HDFS-17446) The DataNode adds a log to report its progress during addToReplicasMap execution.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840478#comment-17840478 ] ASF GitHub Bot commented on HDFS-17446: --- hadoop-yetus commented on PR #6685: URL: https

[jira] [Commented] (HDFS-17444) Add getJournalSyncerStatus jmx metrics, to Indicates whether the JournalSyncer thread for the every namespace has enter working state.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840413#comment-17840413 ] ASF GitHub Bot commented on HDFS-17444: --- hadoop-yetus commented on PR #6694: URL: https

[jira] [Commented] (HDFS-17454) Fix namenode fsck swallows the exception stacktrace, this can help us to troubleshooting log.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840399#comment-17840399 ] ASF GitHub Bot commented on HDFS-17454: --- xiaojunxiang2023 commented on PR #6709: URL: https

[jira] [Commented] (HDFS-17454) Fix namenode fsck swallows the exception stacktrace, this can help us to troubleshooting log.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840389#comment-17840389 ] ASF GitHub Bot commented on HDFS-17454: --- hadoop-yetus commented on PR #6709: URL: https

[jira] [Updated] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-17384: --- Target Version/s: 3.5.0 > [FGL] Replace the global lock with global FS Lock and global BM l

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840351#comment-17840351 ] ASF GitHub Bot commented on HDFS-17497: --- hadoop-yetus commented on PR #6765: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840350#comment-17840350 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17498) Distcp the concat files error, because sourceFS's chesksum is not equals to targetFS's chesksum.

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840339#comment-17840339 ] Ayush Saxena commented on HDFS-17498: - I don't catch exactly what you mean, but did you had preserve

[jira] [Created] (HDFS-17498) Distcp the concat files error, because sourceFS's chesksum is not equals to targetFS's chesksum.

2024-04-24 Thread xiaojunxiang (Jira)
xiaojunxiang created HDFS-17498: --- Summary: Distcp the concat files error, because sourceFS's chesksum is not equals to targetFS's chesksum. Key: HDFS-17498 URL: https://issues.apache.org/jira/browse/HDFS-17498

[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2024-04-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840312#comment-17840312 ] Takanobu Asanuma commented on HDFS-1: - [~chuanjie.duan]  ConnectException is an instance

[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2024-04-24 Thread chuanjie.duan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840305#comment-17840305 ] chuanjie.duan commented on HDFS-1: -- [~elgoiri] [~aajisaka] not sure why delete "ioe insta

[jira] [Commented] (HDFS-17477) IncrementalBlockReport race condition additional edge cases

2024-04-24 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840302#comment-17840302 ] farmmamba commented on HDFS-17477: -- Sir, I also met this problem. Failed with OOM. 张浩博 hfutzhan...@163

[jira] [Commented] (HDFS-17458) Remove unnecessary BP lock in ReplicaMap

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840301#comment-17840301 ] ASF GitHub Bot commented on HDFS-17458: --- hadoop-yetus commented on PR #6717: URL: https

[jira] [Commented] (HDFS-17477) IncrementalBlockReport race condition additional edge cases

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840294#comment-17840294 ] Ayush Saxena commented on HDFS-17477: - Hi [~dannytbecker]  Seems like since this got committed

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840293#comment-17840293 ] ASF GitHub Bot commented on HDFS-17464: --- hfutatzhanghb commented on PR #6724: URL: https

[jira] [Commented] (HDFS-17456) Fix the dfsused statistics of datanode are incorrect when appending a file.

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840292#comment-17840292 ] ASF GitHub Bot commented on HDFS-17456: --- hadoop-yetus commented on PR #6713: URL: https

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840290#comment-17840290 ] ASF GitHub Bot commented on HDFS-17464: --- hadoop-yetus commented on PR #6724: URL: https

[jira] [Commented] (HDFS-17462) NPE in Router concat when trg is an empty file.

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840281#comment-17840281 ] ASF GitHub Bot commented on HDFS-17462: --- hadoop-yetus commented on PR #6722: URL: https

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840264#comment-17840264 ] ASF GitHub Bot commented on HDFS-17497: --- ZanderXu commented on PR #6765: URL: https://github.com

[jira] [Commented] (HDFS-17467) IncrementalBlockReportManager#getPerStorageIBR may throw NPE when remove volumes

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840263#comment-17840263 ] ASF GitHub Bot commented on HDFS-17467: --- hfutatzhanghb commented on PR #6730: URL: https

[jira] [Updated] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-17497: Description: One in-writing HDFS file may contains multiple committed blocks, as follows (assume one file

[jira] [Commented] (HDFS-17467) IncrementalBlockReportManager#getPerStorageIBR may throw NPE when remove volumes

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840262#comment-17840262 ] ASF GitHub Bot commented on HDFS-17467: --- ZanderXu commented on PR #6730: URL: https://github.com

[jira] [Commented] (HDFS-17469) Audit log for reportBadBlocks RPC

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840261#comment-17840261 ] ASF GitHub Bot commented on HDFS-17469: --- ZanderXu commented on PR #6731: URL: https://github.com

[jira] [Commented] (HDFS-17469) Audit log for reportBadBlocks RPC

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840260#comment-17840260 ] ASF GitHub Bot commented on HDFS-17469: --- ZanderXu merged PR #6731: URL: https://github.com/apache

[jira] [Commented] (HDFS-17466) Move FsVolumeList#getVolumes() invocation out of DataSetLock

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840252#comment-17840252 ] ASF GitHub Bot commented on HDFS-17466: --- hadoop-yetus commented on PR #6728: URL: https

[jira] [Commented] (HDFS-17467) IncrementalBlockReportManager#getPerStorageIBR may throw NPE when remove volumes

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840240#comment-17840240 ] ASF GitHub Bot commented on HDFS-17467: --- hadoop-yetus commented on PR #6730: URL: https

[jira] [Commented] (HDFS-17469) Audit log for reportBadBlocks RPC

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840238#comment-17840238 ] ASF GitHub Bot commented on HDFS-17469: --- hadoop-yetus commented on PR #6731: URL: https

[jira] [Commented] (HDFS-17470) FsVolumeList#getNextVolume can be moved out of DataSetLock

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840223#comment-17840223 ] ASF GitHub Bot commented on HDFS-17470: --- hadoop-yetus commented on PR #6733: URL: https

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840218#comment-17840218 ] ASF GitHub Bot commented on HDFS-17497: --- hadoop-yetus commented on PR #6765: URL: https

[jira] [Commented] (HDFS-17463) Support the switch StringTable Split ID feature

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840183#comment-17840183 ] ASF GitHub Bot commented on HDFS-17463: --- hadoop-yetus commented on PR #6736: URL: https

[jira] [Commented] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840182#comment-17840182 ] ASF GitHub Bot commented on HDFS-17367: --- hadoop-yetus commented on PR #6735: URL: https

[jira] [Commented] (HDFS-17463) Support the switch StringTable Split ID feature

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840147#comment-17840147 ] ASF GitHub Bot commented on HDFS-17463: --- hadoop-yetus commented on PR #6736: URL: https

[jira] [Commented] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840139#comment-17840139 ] ASF GitHub Bot commented on HDFS-17496: --- hadoop-yetus commented on PR #6764: URL: https

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840134#comment-17840134 ] ASF GitHub Bot commented on HDFS-17484: --- hadoop-yetus commented on PR #6758: URL: https

[jira] [Commented] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840133#comment-17840133 ] ASF GitHub Bot commented on HDFS-17496: --- hadoop-yetus commented on PR #6764: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840102#comment-17840102 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840099#comment-17840099 ] ASF GitHub Bot commented on HDFS-17497: --- ZanderXu opened a new pull request, #6765: URL: https

[jira] [Updated] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17497: -- Labels: pull-request-available (was: ) > Logic for committed blocks is mixed when comput

[jira] [Created] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ZanderXu (Jira)
ZanderXu created HDFS-17497: --- Summary: Logic for committed blocks is mixed when computing file size Key: HDFS-17497 URL: https://issues.apache.org/jira/browse/HDFS-17497 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-23 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu updated HDFS-17497: Description: One in-writing HDFS file may contains multiple committed blocks, as follows (assume one file

[jira] [Commented] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840093#comment-17840093 ] ASF GitHub Bot commented on HDFS-17367: --- zhtttylz commented on code in PR #6735: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840091#comment-17840091 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840083#comment-17840083 ] ASF GitHub Bot commented on HDFS-17367: --- haiyang1987 commented on code in PR #6735: URL: https

[jira] [Commented] (HDFS-17475) Add a command to check if files are readable

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840077#comment-17840077 ] ASF GitHub Bot commented on HDFS-17475: --- hadoop-yetus commented on PR #6745: URL: https

[jira] [Updated] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17451: -- Component/s: rbf > RBF: fix spotbugs for redundant nullcheck of

[jira] [Resolved] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu resolved HDFS-17451. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: fix spotb

[jira] [Commented] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840069#comment-17840069 ] ASF GitHub Bot commented on HDFS-17451: --- haiyang1987 commented on PR #6697: URL: https://github.com

[jira] [Commented] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840068#comment-17840068 ] ASF GitHub Bot commented on HDFS-17451: --- haiyang1987 merged PR #6697: URL: https://github.com

[jira] [Commented] (HDFS-17451) RBF: fix spotbugs for redundant nullcheck of dns.

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840066#comment-17840066 ] ASF GitHub Bot commented on HDFS-17451: --- KeeProMise commented on PR #6697: URL: https://github.com

[jira] [Commented] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840057#comment-17840057 ] ASF GitHub Bot commented on HDFS-17384: --- ZanderXu commented on PR #6762: URL: https://github.com

[jira] [Commented] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840054#comment-17840054 ] ASF GitHub Bot commented on HDFS-17384: --- hadoop-yetus commented on PR #6762: URL: https

[jira] [Commented] (HDFS-17476) fix: False positive "Observer Node is too far behind" due to long overflow.

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840026#comment-17840026 ] ASF GitHub Bot commented on HDFS-17476: --- hadoop-yetus commented on PR #6747: URL: https

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840018#comment-17840018 ] ASF GitHub Bot commented on HDFS-17484: --- hadoop-yetus commented on PR #6758: URL: https

[jira] [Commented] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840014#comment-17840014 ] ASF GitHub Bot commented on HDFS-17496: --- hfutatzhanghb opened a new pull request, #6764: URL: https

[jira] [Updated] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17496: -- Labels: pull-request-available (was: ) > DataNode supports more fine-grained dataset l

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840010#comment-17840010 ] ASF GitHub Bot commented on HDFS-17488: --- kokonguyen191 commented on code in PR #6759: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840008#comment-17840008 ] ASF GitHub Bot commented on HDFS-17488: --- kokonguyen191 commented on code in PR #6759: URL: https

[jira] [Updated] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-23 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba updated HDFS-17496: - Description: Recently, we used NvmeSSD as volumes in datanodes and performed some stress tests. We

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839996#comment-17839996 ] ASF GitHub Bot commented on HDFS-17488: --- ZanderXu commented on code in PR #6759: URL: https

[jira] [Created] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-23 Thread farmmamba (Jira)
farmmamba created HDFS-17496: Summary: DataNode supports more fine-grained dataset lock based on blockid Key: HDFS-17496 URL: https://issues.apache.org/jira/browse/HDFS-17496 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839957#comment-17839957 ] ASF GitHub Bot commented on HDFS-17488: --- kokonguyen191 commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839929#comment-17839929 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839919#comment-17839919 ] ASF GitHub Bot commented on HDFS-17484: --- hfutatzhanghb commented on PR #6758: URL: https

[jira] [Commented] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839915#comment-17839915 ] ASF GitHub Bot commented on HDFS-17384: --- ZanderXu opened a new pull request, #6762: URL: https

[jira] [Updated] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17384: -- Labels: FGL pull-request-available (was: FGL) > [FGL] Replace the global lock with global

[jira] [Resolved] (HDFS-17457) [FGL] UTs support fine-grained locking

2024-04-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17457. Resolution: Fixed > [FGL] UTs support fine-grained lock

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839911#comment-17839911 ] ASF GitHub Bot commented on HDFS-17484: --- hadoop-yetus commented on PR #6758: URL: https

[jira] [Commented] (HDFS-17457) [FGL] UTs support fine-grained locking

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839909#comment-17839909 ] ASF GitHub Bot commented on HDFS-17457: --- ferhui commented on PR #6741: URL: https://github.com

[jira] [Commented] (HDFS-17457) [FGL] UTs support fine-grained locking

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839908#comment-17839908 ] ASF GitHub Bot commented on HDFS-17457: --- ferhui merged PR #6741: URL: https://github.com/apache

[jira] [Commented] (HDFS-17457) [FGL] UTs support fine-grained locking

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839793#comment-17839793 ] ASF GitHub Bot commented on HDFS-17457: --- hadoop-yetus commented on PR #6741: URL: https

[jira] [Created] (HDFS-17495) Change FSNamesystem.digest to use a configurable algorithm.

2024-04-22 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17495: - Summary: Change FSNamesystem.digest to use a configurable algorithm. Key: HDFS-17495 URL: https://issues.apache.org/jira/browse/HDFS-17495 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839734#comment-17839734 ] ASF GitHub Bot commented on HDFS-17484: --- hadoop-yetus commented on PR #6758: URL: https

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839723#comment-17839723 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL: https

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839680#comment-17839680 ] ASF GitHub Bot commented on HDFS-17484: --- hadoop-yetus commented on PR #6758: URL: https

<    4   5   6   7   8   9   10   11   12   13   >