[jira] [Resolved] (HDFS-17383) Datanode current block token should come from active NameNode in HA mode

2024-04-15 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17383. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17408) Reduce the number of quota calculations in FSDirRenameOp

2024-04-01 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17408. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17345) Add a metrics to record block report generating cost time

2024-03-06 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17345. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Add a metrics to

[jira] [Resolved] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-02-06 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17342. - Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resolution: Fixed > Fix

[jira] [Resolved] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

2024-01-25 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17339. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-24 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17346. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17293. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > First packet data +

[jira] [Resolved] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

2024-01-18 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17331. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-17 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17337. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

2024-01-13 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17291. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

2024-01-13 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17289. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

2024-01-04 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17283. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17275) Judge whether the block has been deleted in the block report

2023-12-26 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17275. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: lei w Resolution:

[jira] [Resolved] (HDFS-17152) Fix the documentation of count command in FileSystemShell.md

2023-12-11 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17152. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix the

[jira] [Resolved] (HDFS-17243) Add the parameter storage type for getBlocks method

2023-11-05 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17243. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add the parameter

[jira] [Created] (HDFS-17227) EC: Fix bug in choosing targets when racks is not enough.

2023-10-16 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17227: --- Summary: EC: Fix bug in choosing targets when racks is not enough. Key: HDFS-17227 URL: https://issues.apache.org/jira/browse/HDFS-17227 Project: Hadoop HDFS

[jira] [Created] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

2023-09-21 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17204: --- Summary: EC: Reduce unnecessary log when processing excess redundancy. Key: HDFS-17204 URL: https://issues.apache.org/jira/browse/HDFS-17204 Project: Hadoop HDFS

[jira] [Created] (HDFS-17197) Show file replication when listing corrupt files.

2023-09-17 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17197: --- Summary: Show file replication when listing corrupt files. Key: HDFS-17197 URL: https://issues.apache.org/jira/browse/HDFS-17197 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-17190) EC: Fix bug for OIV processing XAttr.

2023-09-14 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17190: --- Summary: EC: Fix bug for OIV processing XAttr. Key: HDFS-17190 URL: https://issues.apache.org/jira/browse/HDFS-17190 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-17154) EC: Fix bug in updateBlockForPipeline after failover

2023-08-11 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17154: --- Summary: EC: Fix bug in updateBlockForPipeline after failover Key: HDFS-17154 URL: https://issues.apache.org/jira/browse/HDFS-17154 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-17151) EC: Fix wrong metadata in BlockInfoStriped after recovery

2023-08-10 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17151: --- Summary: EC: Fix wrong metadata in BlockInfoStriped after recovery Key: HDFS-17151 URL: https://issues.apache.org/jira/browse/HDFS-17151 Project: Hadoop HDFS

[jira] [Created] (HDFS-17150) EC: Fix the bug of failed lease recovery.

2023-08-09 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17150: --- Summary: EC: Fix the bug of failed lease recovery. Key: HDFS-17150 URL: https://issues.apache.org/jira/browse/HDFS-17150 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

2023-07-28 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17134: --- Summary: RBF: Fix duplicate results of getListing through Router. Key: HDFS-17134 URL: https://issues.apache.org/jira/browse/HDFS-17134 Project: Hadoop HDFS

[jira] [Created] (HDFS-17112) Show decommission duration in JMX and HTML

2023-07-20 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17112: --- Summary: Show decommission duration in JMX and HTML Key: HDFS-17112 URL: https://issues.apache.org/jira/browse/HDFS-17112 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

2023-07-18 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17094: --- Summary: EC: Fix bug in block recovery when there are stale datanodes Key: HDFS-17094 URL: https://issues.apache.org/jira/browse/HDFS-17094 Project: Hadoop HDFS

[jira] [Created] (HDFS-17089) Close child files systems in ViewFileSystem when cache is disabled.

2023-07-16 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17089: --- Summary: Close child files systems in ViewFileSystem when cache is disabled. Key: HDFS-17089 URL: https://issues.apache.org/jira/browse/HDFS-17089 Project: Hadoop HDFS

[jira] [Created] (HDFS-17049) Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator

2023-06-13 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17049: --- Summary: Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator Key: HDFS-17049 URL: https://issues.apache.org/jira/browse/HDFS-17049 Project:

[jira] [Created] (HDFS-17037) Consider nonDfsUsed when running balancer

2023-06-04 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17037: --- Summary: Consider nonDfsUsed when running balancer Key: HDFS-17037 URL: https://issues.apache.org/jira/browse/HDFS-17037 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

2023-05-21 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17021. - Resolution: Not A Bug > GENSTAMP_MISMATCH replica can not be removed by

[jira] [Created] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

2023-05-18 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-17021: --- Summary: GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas() Key: HDFS-17021 URL: https://issues.apache.org/jira/browse/HDFS-17021 Project:

[jira] [Created] (HDFS-16999) Fix wrong use of processFirstBlockReport()

2023-05-04 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16999: --- Summary: Fix wrong use of processFirstBlockReport() Key: HDFS-16999 URL: https://issues.apache.org/jira/browse/HDFS-16999 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16986) EC: Fix locationBudget in getListing()

2023-04-22 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16986: --- Summary: EC: Fix locationBudget in getListing() Key: HDFS-16986 URL: https://issues.apache.org/jira/browse/HDFS-16986 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16974) Consider load of every volume when choosing target

2023-04-09 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16974: --- Summary: Consider load of every volume when choosing target Key: HDFS-16974 URL: https://issues.apache.org/jira/browse/HDFS-16974 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-16964) Improve processing of excess redundancy after failover

2023-03-24 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16964: --- Summary: Improve processing of excess redundancy after failover Key: HDFS-16964 URL: https://issues.apache.org/jira/browse/HDFS-16964 Project: Hadoop HDFS

[jira] [Created] (HDFS-16958) Fix bug in processing EC excess redundancy

2023-03-17 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16958: --- Summary: Fix bug in processing EC excess redundancy Key: HDFS-16958 URL: https://issues.apache.org/jira/browse/HDFS-16958 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-16939) Fix the thread safety bug in LowRedundancyBlocks

2023-03-02 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16939: --- Summary: Fix the thread safety bug in LowRedundancyBlocks Key: HDFS-16939 URL: https://issues.apache.org/jira/browse/HDFS-16939 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-16735) Reduce the number of HeartbeatManager loops

2022-08-21 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16735: --- Summary: Reduce the number of HeartbeatManager loops Key: HDFS-16735 URL: https://issues.apache.org/jira/browse/HDFS-16735 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-16683) All method metrics related to the rpc protocol should be initialized

2022-07-25 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16683: --- Summary: All method metrics related to the rpc protocol should be initialized Key: HDFS-16683 URL: https://issues.apache.org/jira/browse/HDFS-16683 Project: Hadoop

[jira] [Created] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

2021-07-29 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16146: --- Summary: All three replicas are lost due to not adding a new DataNode in time Key: HDFS-16146 URL: https://issues.apache.org/jira/browse/HDFS-16146 Project: Hadoop

[jira] [Created] (HDFS-16099) Make bpServiceToActive to be volatile

2021-06-30 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-16099: --- Summary: Make bpServiceToActive to be volatile Key: HDFS-16099 URL: https://issues.apache.org/jira/browse/HDFS-16099 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-10 Thread Shuyan Zhang (Jira)
Shuyan Zhang created HDFS-15963: --- Summary: Unreleased volume references cause an infinite loop Key: HDFS-15963 URL: https://issues.apache.org/jira/browse/HDFS-15963 Project: Hadoop HDFS Issue