[jira] [Created] (HDFS-17564) Erasure Coding: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-06-30 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17564: - Summary: Erasure Coding: Fix the issue of inaccurate metrics when decommission mark busy DN Key: HDFS-17564 URL: https://issues.apache.org/jira/browse/HDFS-17564 Project

[jira] [Created] (HDFS-17563) IPC's epoch is not the current writer epoch

2024-06-28 Thread Yonghao Zou (Jira)
Yonghao Zou created HDFS-17563: -- Summary: IPC's epoch is not the current writer epoch Key: HDFS-17563 URL: https://issues.apache.org/jira/browse/HDFS-17563 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-17562) NPE in ipc/Client.java

2024-06-28 Thread Yonghao Zou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonghao Zou updated HDFS-17562: --- Description: An NPE happened today that crashed datanodes. Running version: 3.2.4   {code:java

[jira] [Updated] (HDFS-17562) NPE in ipc/Client.java

2024-06-28 Thread Yonghao Zou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonghao Zou updated HDFS-17562: --- Description: An NPE happened today that crashed datanodes.   {code:java} 2024-06-28 03:07:58,649

[jira] [Created] (HDFS-17562) NPE in ipc/Client.java

2024-06-28 Thread Yonghao Zou (Jira)
Yonghao Zou created HDFS-17562: -- Summary: NPE in ipc/Client.java Key: HDFS-17562 URL: https://issues.apache.org/jira/browse/HDFS-17562 Project: Hadoop HDFS Issue Type: Bug Components

[jira] [Updated] (HDFS-17562) NPE in ipc/Client.java

2024-06-28 Thread Yonghao Zou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonghao Zou updated HDFS-17562: --- Description: An NPE happened today that crashed datanodes.   {code:java}  {code} was: An NPE

[jira] [Created] (HDFS-17561) Make HeartbeatManager.Monitor use up-to-date heartbeatRecheckInterval

2024-06-28 Thread Felix N (Jira)
Felix N created HDFS-17561: -- Summary: Make HeartbeatManager.Monitor use up-to-date heartbeatRecheckInterval Key: HDFS-17561 URL: https://issues.apache.org/jira/browse/HDFS-17561 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2024-06-27 Thread zeekling (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860585#comment-17860585 ] zeekling commented on HDFS-11096: - Have you ever checked the scenario of encrypting

[jira] [Commented] (HDFS-16690) Automatically format new unformatted JournalNodes using JournalNodeSyncer

2024-06-27 Thread Aswin M Prabhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860512#comment-17860512 ] Aswin M Prabhu commented on HDFS-16690: --- Hey [~svaughan], was any progress mad

[jira] [Comment Edited] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-06-27 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854008#comment-17854008 ] ruiliang edited comment on HDFS-17535 at 6/27/24 1:3

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2024-06-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860410#comment-17860410 ] Stephen O'Donnell commented on HDFS-16147: -- [~suyeon1222] I have no

[jira] [Updated] (HDFS-17560) RBF: When CurrentCall does not include StateId, it can still send requests to the Observer.

2024-06-27 Thread fuchaohong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fuchaohong updated HDFS-17560: -- Summary: RBF: When CurrentCall does not include StateId, it can still send requests to the Observer

[jira] [Updated] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-06-27 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated HDFS-17535: Description: I learned that EC does have a major bug with file corrupt https://issues.apache.org/jira

[jira] [Comment Edited] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-06-27 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854008#comment-17854008 ] ruiliang edited comment on HDFS-17535 at 6/27/24 8:2

[jira] [Created] (HDFS-17560) When CurrentCall does not include StateId, it can still send requests to the Observer.

2024-06-27 Thread fuchaohong (Jira)
fuchaohong created HDFS-17560: - Summary: When CurrentCall does not include StateId, it can still send requests to the Observer. Key: HDFS-17560 URL: https://issues.apache.org/jira/browse/HDFS-17560

[jira] [Updated] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-06-27 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17559: -- Description: If there is datanode info in includes, but the datanode service is not currently started

[jira] [Created] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-06-27 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17559: - Summary: Fix the uuid as null in NameNodeMXBean Key: HDFS-17559 URL: https://issues.apache.org/jira/browse/HDFS-17559 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-16147) load fsimage with parallelization and compression

2024-06-26 Thread SUYEON LEE (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860353#comment-17860353 ] SUYEON LEE commented on HDFS-16147: --- [~mofei], [~sodonnell]  Are you going to wor

[jira] [Created] (HDFS-17558) RBF: Make maxSizeOfFederatedStateToPropagate work on setResponseHeaderState.

2024-06-25 Thread fuchaohong (Jira)
fuchaohong created HDFS-17558: - Summary: RBF: Make maxSizeOfFederatedStateToPropagate work on setResponseHeaderState. Key: HDFS-17558 URL: https://issues.apache.org/jira/browse/HDFS-17558 Project: Hadoop

[jira] [Assigned] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-06-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17555: -- Assignee: wangzhongwei > Fix NumberFormatException of NNThroughputBenchmark when configu

[jira] [Updated] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-06-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17555: --- Summary: Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize. (was

[jira] [Commented] (HDFS-17543) [ARR] AsyncUtil makes asynchronous code more concise and easier.

2024-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859682#comment-17859682 ] ASF GitHub Bot commented on HDFS-17543: --- Hexiaoqiao commented on code in PR #

[jira] [Commented] (HDFS-17541) Support msync requests to a separate RPC Server

2024-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859665#comment-17859665 ] ASF GitHub Bot commented on HDFS-17541: --- hadoop-yetus commented on PR #6899:

[jira] [Commented] (HDFS-17543) [ARR] AsyncUtil makes asynchronous code more concise and easier.

2024-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859607#comment-17859607 ] ASF GitHub Bot commented on HDFS-17543: --- KeeProMise commented on code in PR #

[jira] [Commented] (HDFS-17545) [ARR] router async rpc client.

2024-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859605#comment-17859605 ] ASF GitHub Bot commented on HDFS-17545: --- KeeProMise commented on code in PR #

[jira] [Commented] (HDFS-17545) [ARR] router async rpc client.

2024-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859602#comment-17859602 ] ASF GitHub Bot commented on HDFS-17545: --- hfutatzhanghb commented on code i

[jira] [Commented] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-24 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859586#comment-17859586 ] wangzhongwei commented on HDFS-17555: - [~ayushsaxena] could you please hel

[jira] [Commented] (HDFS-17543) [ARR] AsyncUtil makes asynchronous code more concise and easier.

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859580#comment-17859580 ] ASF GitHub Bot commented on HDFS-17543: --- hfutatzhanghb commented on code i

[jira] [Updated] (HDFS-17541) Support msync requests to a separate RPC Server

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17541: -- Labels: pull-request-available (was: ) > Support msync requests to a separate RPC Ser

[jira] [Commented] (HDFS-17541) Support msync requests to a separate RPC Server

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859564#comment-17859564 ] ASF GitHub Bot commented on HDFS-17541: --- 2005hithlj opened a new pull req

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859529#comment-17859529 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on PR #6861:

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859528#comment-17859528 ] ASF GitHub Bot commented on HDFS-17523: --- slfan1989 commented on code in PR #

[jira] [Updated] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17557: -- Labels: pull-request-available (was: ) > Fix bug for TestRedundancyMoni

[jira] [Commented] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-06-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859482#comment-17859482 ] ASF GitHub Bot commented on HDFS-17557: --- hadoop-yetus commented on PR #6897:

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859457#comment-17859457 ] ASF GitHub Bot commented on HDFS-17523: --- hadoop-yetus commented on PR #6890:

[jira] [Created] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-06-22 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17557: - Summary: Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop Key: HDFS-17557 URL: https://issues.apache.org/jira/browse/HDFS-17557 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-06-22 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17557: -- Description: Due to the modification in HDFS-16456, the current UT has not been able to run

[jira] [Updated] (HDFS-17556) Avoid adding block to neededReconstruction repeatedly in decommission

2024-06-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-17556: --- Status: Patch Available (was: In Progress) > Avoid adding block to neededReconstruction repeate

[jira] [Updated] (HDFS-17556) Avoid adding block to neededReconstruction repeatedly in decommission

2024-06-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-17556: --- Summary: Avoid adding block to neededReconstruction repeatedly in decommission (was: Avoid add to

[jira] [Updated] (HDFS-17556) Avoid add to neededReconstruction repeatedly in decommission

2024-06-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-17556: --- Summary: Avoid add to neededReconstruction repeatedly in decommission (was: timedOutItems should

[jira] [Updated] (HDFS-17556) timedOutItems should also be check to avoid repeat add to neededReconstruction when decommission

2024-06-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-17556: --- Summary: timedOutItems should also be check to avoid repeat add to neededReconstruction when

[jira] [Created] (HDFS-17556) timedOutItems should also be check to avoid repeated add to neededReconstruction when decommission

2024-06-21 Thread caozhiqiang (Jira)
caozhiqiang created HDFS-17556: -- Summary: timedOutItems should also be check to avoid repeated add to neededReconstruction when decommission Key: HDFS-17556 URL: https://issues.apache.org/jira/browse/HDFS-17556

[jira] [Commented] (HDFS-16776) Erasure Coding: The length of targets should be checked when DN gets a reconstruction task

2024-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856789#comment-17856789 ] ASF GitHub Bot commented on HDFS-16776: --- tomscut commented on PR #4901: URL: h

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856780#comment-17856780 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6891:

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856779#comment-17856779 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6891:

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856778#comment-17856778 ] ASF GitHub Bot commented on HDFS-17528: --- hadoop-yetus commented on PR #6828:

[jira] [Updated] (HDFS-17552) [ARR] IPC client uses CompletableFuture to support asynchronous operations.

2024-06-20 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17552: -- Summary: [ARR] IPC client uses CompletableFuture to support asynchronous operations. (was: [ARR] RPC

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Status: Patch Available (was: Open) > fix NumberFormatException using letter suffix with c

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Description:      when using NNThroughputBenchmark, the configuration item dfs.blocksize in hdfs

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Component/s: hdfs > fix NumberFormatException using letter suffix with conf dfs.blocks

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Description:      when using NNThroughputBenchmark, the configuration item dfs.blocksize in hdfs

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Description:      when using NNThroughputBenchmark, the configuration item dfs.blocksize in hdfs

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Description:      when using NNThroughputBenchmark, the configuration item dfs.blocksize in hdfs

[jira] [Updated] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17555: Attachment: image-2024-06-20-19-17-10-099.png > fix NumberFormatException using letter suffix w

[jira] [Created] (HDFS-17555) fix NumberFormatException using letter suffix with conf dfs.blocksize

2024-06-20 Thread wangzhongwei (Jira)
wangzhongwei created HDFS-17555: --- Summary: fix NumberFormatException using letter suffix with conf dfs.blocksize Key: HDFS-17555 URL: https://issues.apache.org/jira/browse/HDFS-17555 Project: Hadoop

[jira] [Resolved] (HDFS-17554) OIV: Print the storage policy name in OIV delimited output

2024-06-18 Thread Hualong Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hualong Zhang resolved HDFS-17554. -- Resolution: Not A Problem > OIV: Print the storage policy name in OIV delimited out

[jira] [Resolved] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-17528. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed Th pull request is now

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856023#comment-17856023 ] ASF GitHub Bot commented on HDFS-17546: --- ctrezzo commented on PR #6891: URL: h

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855989#comment-17855989 ] Tsz-wo Sze commented on HDFS-17528: --- [~smajeti], there were still some build is

[jira] [Created] (HDFS-17554) OIV: Print the storage policy name in OIV delimited output

2024-06-18 Thread Hualong Zhang (Jira)
Hualong Zhang created HDFS-17554: Summary: OIV: Print the storage policy name in OIV delimited output Key: HDFS-17554 URL: https://issues.apache.org/jira/browse/HDFS-17554 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17553) DFSOutputStream.java#closeImpl should have configurable retries upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zinan Zhuang updated HDFS-17553: Summary: DFSOutputStream.java#closeImpl should have configurable retries upon flushInternal

[jira] [Updated] (HDFS-17553) DFSOutputStream.java#closeImpl should configurable retries upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zinan Zhuang updated HDFS-17553: Description: HDFS-15865 introduced an interrupt in DFSStreamer class to interrupt the

[jira] [Updated] (HDFS-17553) DFSOutputStream.java#closeImpl should have a retry upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zinan Zhuang updated HDFS-17553: Description: [HDFS-15865|https://issues.apache.org/jira/browse/HDFS-15865] introduced an

[jira] [Updated] (HDFS-17553) DFSOutputStream.java#closeImpl should have a retry upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zinan Zhuang updated HDFS-17553: Description: HDFS-15865 introduced an interrupt in DFSStreamer class to interrupt the

[jira] [Updated] (HDFS-17553) DFSOutputStream.java#closeImpl should have a retry upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zinan Zhuang updated HDFS-17553: Description: [HDFS-15865|https://issues.apache.org/jira/browse/HDFS-15865] introduced an

[jira] [Updated] (HDFS-17553) DFSOutputStream.java#closeImpl should have a retry upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zinan Zhuang updated HDFS-17553: Description: [HDFS-15865|https://issues.apache.org/jira/browse/HDFS-15865] introduced an

[jira] [Created] (HDFS-17553) DFSOutputStream.java#closeImpl should have a retry upon flushInternal failures

2024-06-18 Thread Zinan Zhuang (Jira)
Zinan Zhuang created HDFS-17553: --- Summary: DFSOutputStream.java#closeImpl should have a retry upon flushInternal failures Key: HDFS-17553 URL: https://issues.apache.org/jira/browse/HDFS-17553 Project

[jira] [Resolved] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-06-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-17439. -- Fix Version/s: 3.5.0 Resolution: Fixed > Improve NNThroughputBenchmark

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855879#comment-17855879 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6891:

[jira] [Commented] (HDFS-17545) [ARR] router async rpc client.

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855822#comment-17855822 ] ASF GitHub Bot commented on HDFS-17545: --- KeeProMise commented on code in PR #

[jira] [Commented] (HDFS-17545) [ARR] router async rpc client.

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855817#comment-17855817 ] ASF GitHub Bot commented on HDFS-17545: --- hfutatzhanghb commented on code i

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855775#comment-17855775 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6891:

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855707#comment-17855707 ] ASF GitHub Bot commented on HDFS-17546: --- NyteKnight opened a new pull req

[jira] [Commented] (HDFS-17254) DataNode httpServer has too many worker threads

2024-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855535#comment-17855535 ] ASF GitHub Bot commented on HDFS-17254: --- hadoop-yetus commented on PR #6307:

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855534#comment-17855534 ] ASF GitHub Bot commented on HDFS-17523: --- hadoop-yetus commented on PR #6890:

[jira] [Commented] (HDFS-16479) EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2024-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855524#comment-17855524 ] ASF GitHub Bot commented on HDFS-16479: --- tasanuma commented on PR #4138:

[jira] [Commented] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855505#comment-17855505 ] ASF GitHub Bot commented on HDFS-17518: --- hadoop-yetus commented on PR #6809:

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855465#comment-17855465 ] ASF GitHub Bot commented on HDFS-17523: --- ThinkerLei opened a new pull req

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855464#comment-17855464 ] ASF GitHub Bot commented on HDFS-17523: --- ThinkerLei closed pull request #

[jira] [Commented] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855435#comment-17855435 ] ASF GitHub Bot commented on HDFS-17518: --- hadoop-yetus commented on PR #6809:

[jira] [Updated] (HDFS-17531) RBF: Asynchronous router RPC

2024-06-16 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17531: -- Attachment: Router asynchronous rpc implementation .pdf > RBF: Asynchronous router

[jira] [Updated] (HDFS-17531) RBF: Asynchronous router RPC

2024-06-16 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17531: -- Attachment: (was: Router asynchronous rpc implementation.pdf) > RBF: Asynchronous router

[jira] [Updated] (HDFS-17531) RBF: Asynchronous router RPC

2024-06-16 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17531: -- Attachment: Router asynchronous rpc implementation.pdf > RBF: Asynchronous router

[jira] [Commented] (HDFS-17540) Namenode retry to warmup EDEK cache forever

2024-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855224#comment-17855224 ] ASF GitHub Bot commented on HDFS-17540: --- hadoop-yetus commented on PR #6774:

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855177#comment-17855177 ] ASF GitHub Bot commented on HDFS-17546: --- simbadzina merged PR #6873: URL: h

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855171#comment-17855171 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873:

[jira] [Commented] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855138#comment-17855138 ] ASF GitHub Bot commented on HDFS-17439: --- hadoop-yetus commented on PR #6677:

[jira] [Assigned] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17546: - Assignee: Heagan (was: Simbarashe Dzinamarira) > Implementing Time

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855130#comment-17855130 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873:

[jira] [Commented] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855077#comment-17855077 ] ASF GitHub Bot commented on HDFS-17439: --- fateh288 commented on PR #6677:

[jira] [Commented] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854973#comment-17854973 ] ASF GitHub Bot commented on HDFS-17439: --- sodonnel commented on PR #6677:

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854959#comment-17854959 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873:

[jira] [Commented] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854908#comment-17854908 ] ASF GitHub Bot commented on HDFS-17439: --- hadoop-yetus commented on PR #6677:

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854904#comment-17854904 ] ASF GitHub Bot commented on HDFS-16757: --- LiuGuH commented on PR #6882: URL: h

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854893#comment-17854893 ] ASF GitHub Bot commented on HDFS-17546: --- simbadzina commented on code in PR #

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854888#comment-17854888 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873:

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854871#comment-17854871 ] ASF GitHub Bot commented on HDFS-17523: --- hadoop-yetus commented on PR #6886:

[jira] [Commented] (HDFS-17552) [ARR] RPC client uses CompletableFuture to support asynchronous operations.

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854838#comment-17854838 ] ASF GitHub Bot commented on HDFS-17552: --- hadoop-yetus commented on PR #6888:

[jira] [Commented] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854853#comment-17854853 ] ASF GitHub Bot commented on HDFS-17518: --- hadoop-yetus commented on PR #6809:

[jira] [Commented] (HDFS-17552) [ARR] RPC client uses CompletableFuture to support asynchronous operations.

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854804#comment-17854804 ] ASF GitHub Bot commented on HDFS-17552: --- KeeProMise opened a new pull req

<    5   6   7   8   9   10   11   12   13   14   >