[jira] [Work logged] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?focusedWorklogId=714260=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714260 ] ASF GitHub Bot logged work on HDFS-16403: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-01-24 Thread yanbin.zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481622#comment-17481622 ] yanbin.zhang commented on HDFS-16437: - There is already a solution for this problem, please wait. >

[jira] [Updated] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-01-24 Thread yanbin.zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanbin.zhang updated HDFS-16437: Description: In a cluster environment without snapshot, if you want to convert back to fsimage

[jira] [Created] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-01-24 Thread yanbin.zhang (Jira)
yanbin.zhang created HDFS-16437: --- Summary: ReverseXML processor doesn't accept XML files without the SnapshotDiffSection. Key: HDFS-16437 URL: https://issues.apache.org/jira/browse/HDFS-16437 Project:

[jira] [Resolved] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

2022-01-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16428. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Work logged] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16428?focusedWorklogId=714244=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714244 ] ASF GitHub Bot logged work on HDFS-16428: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

2022-01-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16428: --- Summary: Source path with storagePolicy cause wrong typeConsumed while rename (was: Source path

[jira] [Work logged] (HDFS-16432) Namenode block report add yield to avoid holding write lock too long

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16432?focusedWorklogId=714231=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714231 ] ASF GitHub Bot logged work on HDFS-16432: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-16432) Namenode block report add yield to avoid holding write lock too long

2022-01-24 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479811#comment-17479811 ] qinyuren edited comment on HDFS-16432 at 1/25/22, 6:29 AM: --- [~hexiaoqiao],

[jira] [Resolved] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16403. Resolution: Fixed Thank you [~cndaimin] for the great work and the excellent performance

[jira] [Updated] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16403: --- Fix Version/s: 3.4.0 3.2.3 3.3.3 > Improve FUSE IO

[jira] [Work logged] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?focusedWorklogId=714204=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714204 ] ASF GitHub Bot logged work on HDFS-16403: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?focusedWorklogId=714197=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714197 ] ASF GitHub Bot logged work on HDFS-16403: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16429) Add DataSetLockManager to maintain locks for FsDataSetImpl

2022-01-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16429: --- Fix Version/s: (was: 3.2.0) Target Version/s: (was: 3.2.0) Affects Version/s:

[jira] [Work logged] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?focusedWorklogId=714174=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714174 ] ASF GitHub Bot logged work on HDFS-16423: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16398) Reconfig block report parameters for datanode

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16398?focusedWorklogId=714172=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714172 ] ASF GitHub Bot logged work on HDFS-16398: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16398) Reconfig block report parameters for datanode

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16398?focusedWorklogId=714171=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714171 ] ASF GitHub Bot logged work on HDFS-16398: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?focusedWorklogId=714168=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714168 ] ASF GitHub Bot logged work on HDFS-16422: - Author: ASF GitHub Bot

[jira] [Reopened] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-16423: Reopen to backport this to lower branches. > balancer should not get blocks on stale storages

[jira] [Updated] (HDFS-16430) Validate maximum blocks in EC group when adding an EC policy

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16430: --- Fix Version/s: 3.2.3 3.3.3 > Validate maximum blocks in EC group when

[jira] [Commented] (HDFS-16430) Validate maximum blocks in EC group when adding an EC policy

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481492#comment-17481492 ] Wei-Chiu Chuang commented on HDFS-16430: Cherrypicked to branch-3.3 and branch-3.2 > Validate

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=714151=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714151 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=714149=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714149 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?focusedWorklogId=714146=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714146 ] ASF GitHub Bot logged work on HDFS-16422: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?focusedWorklogId=714145=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714145 ] ASF GitHub Bot logged work on HDFS-16422: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=714139=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714139 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16427: --- Component/s: erasure-coding > Add debug log for BlockManager#chooseExcessRedundancyStriped >

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=714137=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714137 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16420: --- Component/s: erasure-coding > Avoid deleting unique data blocks when deleting redundancy

[jira] [Updated] (HDFS-16333) fix balancer bug when transfer an EC block

2022-01-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16333: --- Component/s: erasure-coding > fix balancer bug when transfer an EC block >

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=714132=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714132 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16403?focusedWorklogId=714103=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714103 ] ASF GitHub Bot logged work on HDFS-16403: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=714081=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714081 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?focusedWorklogId=714080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-714080 ] ASF GitHub Bot logged work on HDFS-16411: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread Kevin Wikant (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481354#comment-17481354 ] Kevin Wikant commented on HDFS-16303: - My apologies for the delay, something high priority came up at

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=713983=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713983 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=713974=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713974 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?focusedWorklogId=713973=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713973 ] ASF GitHub Bot logged work on HDFS-16427: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16436) RBF: CheckSafeMode before Read Operation

2022-01-24 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-16436: -- Description: In Router's

[jira] [Created] (HDFS-16436) RBF: CheckSafeMode before Read Operation

2022-01-24 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-16436: - Summary: RBF: CheckSafeMode before Read Operation Key: HDFS-16436 URL: https://issues.apache.org/jira/browse/HDFS-16436 Project: Hadoop HDFS Issue Type:

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=713923=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713923 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16429) Add DataSetLockManager to maintain locks for FsDataSetImpl

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16429?focusedWorklogId=713695=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713695 ] ASF GitHub Bot logged work on HDFS-16429: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?focusedWorklogId=713630=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713630 ] ASF GitHub Bot logged work on HDFS-16427: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?focusedWorklogId=713627=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713627 ] ASF GitHub Bot logged work on HDFS-16427: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?focusedWorklogId=713620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-713620 ] ASF GitHub Bot logged work on HDFS-16427: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16430) Validate maximum blocks in EC group when adding an EC policy

2022-01-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-16430: Fix Version/s: 3.4.0 > Validate maximum blocks in EC group when adding an EC policy >

[jira] [Commented] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

2022-01-24 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480951#comment-17480951 ] Akira Ajisaka commented on HDFS-16303: -- Hi [~KevinWikant], how is this issue going? > Losing over