[jira] [Updated] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17283: Target Version/s: 3.5.0 (was: 3.4.0) > Change the name of variable SECOND in HdfsClientConfigKeys

[jira] [Updated] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17291: Target Version/s: 3.5.0 (was: 3.4.0) > DataNode metric bytesWritten is not totally accurate in som

[jira] [Updated] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17291: Fix Version/s: 3.5.0 (was: 3.4.0) > DataNode metric bytesWritten is not tota

[jira] [Updated] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17337: Fix Version/s: 3.5.0 (was: 3.4.0) > RPC RESPONSE time seems not exactly accu

[jira] [Updated] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17283: Fix Version/s: 3.5.0 (was: 3.4.0) > Change the name of variable SECOND in Hd

[jira] [Updated] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17289: Target Version/s: 3.5.0 (was: 3.4.0) > Considering the size of non-lastBlocks equals to complete b

[jira] [Updated] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17289: Fix Version/s: 3.5.0 (was: 3.4.0) > Considering the size of non-lastBlocks e

[jira] [Updated] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17337: Target Version/s: 3.5.0 (was: 3.4.0) > RPC RESPONSE time seems not exactly accurate when using FSE

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808049#comment-17808049 ] ASF GitHub Bot commented on HDFS-17332: --- xinglin commented on PR #6446: URL: https:

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808047#comment-17808047 ] ASF GitHub Bot commented on HDFS-17332: --- xinglin commented on PR #6446: URL: https:

[jira] [Commented] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808034#comment-17808034 ] ASF GitHub Bot commented on HDFS-17343: --- slfan1989 commented on PR #6457: URL: http

[jira] [Updated] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17343: -- Labels: pull-request-available (was: ) > Revert HDFS-16016. BPServiceActor to provide new thre

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808033#comment-17808033 ] ASF GitHub Bot commented on HDFS-17332: --- mccormickt12 commented on PR #6446: URL: h

[jira] [Created] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR

2024-01-17 Thread Shilun Fan (Jira)
Shilun Fan created HDFS-17343: - Summary: Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR Key: HDFS-17343 URL: https://issues.apache.org/jira/browse/HDFS-17343 Project: Hadoop HDFS

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808024#comment-17808024 ] Shilun Fan commented on HDFS-16016: --- Reset HDFS-16016 status to Resolved. I will create

[jira] [Resolved] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-16016. --- Resolution: Fixed > BPServiceActor add a new thread to handle IBR > -

[jira] [Commented] (HDFS-17334) FSEditLogAsync#enqueueEdit does not synchronized this before invoke wait method

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808014#comment-17808014 ] ASF GitHub Bot commented on HDFS-17334: --- hfutatzhanghb commented on PR #6434: URL:

[jira] [Updated] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-17 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17342: -- Description: When users read an append file, occasional exceptions may occur, such as org.apache.hadoo

[jira] [Created] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-17 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17342: - Summary: Fix DataNode may invalidates normal block causing missing block Key: HDFS-17342 URL: https://issues.apache.org/jira/browse/HDFS-17342 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807987#comment-17807987 ] ASF GitHub Bot commented on HDFS-17341: --- hadoop-yetus commented on PR #6461: URL: h

[jira] [Commented] (HDFS-17334) FSEditLogAsync#enqueueEdit does not synchronized this before invoke wait method

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807986#comment-17807986 ] ASF GitHub Bot commented on HDFS-17334: --- zhangshuyan0 commented on PR #6434: URL: h

[jira] [Commented] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807980#comment-17807980 ] ASF GitHub Bot commented on HDFS-17331: --- zhangshuyan0 commented on PR #6429: URL: h

[jira] [Resolved] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17337. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Commented] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807978#comment-17807978 ] ASF GitHub Bot commented on HDFS-17337: --- zhangshuyan0 merged PR #6439: URL: https:/

[jira] [Commented] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807972#comment-17807972 ] Xiaoqiao He commented on HDFS-17341: Thanks [~Lei Yang] for your Great proposal! One

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807954#comment-17807954 ] ASF GitHub Bot commented on HDFS-17332: --- xinglin commented on code in PR #6446: URL

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807953#comment-17807953 ] ASF GitHub Bot commented on HDFS-17332: --- xinglin commented on PR #6446: URL: https:

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807939#comment-17807939 ] ASF GitHub Bot commented on HDFS-17332: --- mccormickt12 commented on code in PR #6446

[jira] [Updated] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17341: -- Labels: pull-request-available (was: ) > Support dedicated user queues in Namenode FairCallQue

[jira] [Commented] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807938#comment-17807938 ] ASF GitHub Bot commented on HDFS-17341: --- li-leyang opened a new pull request, #6461

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807934#comment-17807934 ] ASF GitHub Bot commented on HDFS-17332: --- mccormickt12 commented on code in PR #6446

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807932#comment-17807932 ] ASF GitHub Bot commented on HDFS-17332: --- mccormickt12 commented on code in PR #6446

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807931#comment-17807931 ] ASF GitHub Bot commented on HDFS-17332: --- mccormickt12 commented on code in PR #6446

[jira] [Commented] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807930#comment-17807930 ] ASF GitHub Bot commented on HDFS-17332: --- mccormickt12 commented on PR #6446: URL: h

[jira] [Updated] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17341: Description: Some service users today in namenode like ETL, metrics collection, ad-hoc users that are crit

[jira] [Updated] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17341: Description: Some service users today in namenode like ETL, metrics collection, ad-hoc users that are crit

[jira] [Updated] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17341: Description: Some service users today in namenode like ETL, metrics collection accounts for many traffic a

[jira] [Updated] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17341: Affects Version/s: 2.10.0 3.4.0 > Support dedicated user queues in Namenode FairCall

[jira] [Created] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue

2024-01-17 Thread Lei Yang (Jira)
Lei Yang created HDFS-17341: --- Summary: Support dedicated user queues in Namenode FairCallQueue Key: HDFS-17341 URL: https://issues.apache.org/jira/browse/HDFS-17341 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807873#comment-17807873 ] ASF GitHub Bot commented on HDFS-16016: --- hadoop-yetus commented on PR #6457: URL: h

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807730#comment-17807730 ] ASF GitHub Bot commented on HDFS-16016: --- slfan1989 commented on PR #6457: URL: http

[jira] [Commented] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807695#comment-17807695 ] ASF GitHub Bot commented on HDFS-15869: --- ZanderXu commented on PR #2737: URL: https

[jira] [Commented] (HDFS-15552) Let DeadNode Detector also work for EC cases

2024-01-17 Thread Imba Jin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807693#comment-17807693 ] Imba Jin commented on HDFS-15552: - [~slfan1989] Thanks for the reminder & update, due to

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807656#comment-17807656 ] ASF GitHub Bot commented on HDFS-16016: --- hadoop-yetus commented on PR #6457: URL: h

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807648#comment-17807648 ] ASF GitHub Bot commented on HDFS-16016: --- tasanuma commented on PR #6457: URL: https