[jira] [Resolved] (HDFS-17383) Datanode current block token should come from active NameNode in HA mode

[ https://issues.apache.org/jira/browse/HDFS-17383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17383. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17408) Reduce the number of quota calculations in FSDirRenameOp

[ https://issues.apache.org/jira/browse/HDFS-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17408. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Updated] (HDFS-17401) EC: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage

[ https://issues.apache.org/jira/browse/HDFS-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17401: Summary: EC: Excess internal block may not be able to be deleted correctly when it's stored in

[jira] [Resolved] (HDFS-17345) Add a metrics to record block report generating cost time

[ https://issues.apache.org/jira/browse/HDFS-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17345. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Add a metrics to

[jira] [Assigned] (HDFS-17354) Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up

[ https://issues.apache.org/jira/browse/HDFS-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17354: --- Assignee: lei w > Delay invoke clearStaleNamespacesInRouterStateIdContext during router

[jira] [Resolved] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17342. - Hadoop Flags: Reviewed Target Version/s: 3.5.0 Resolution: Fixed > Fix

[jira] [Resolved] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17339. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Assigned] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17339: --- Assignee: lei w > BPServiceActor should skip cacheReport when one blockPool does not have

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17346: Issue Type: Bug (was: Improvement) > Fix DirectoryScanner check mark the normal blocks as

[jira] [Resolved] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17346. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Resolved] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17293. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > First packet data +

[jira] [Resolved] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17331. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: 3.5.0

[jira] [Updated] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17283: Target Version/s: 3.5.0 (was: 3.4.0) > Change the name of variable SECOND in HdfsClientConfigKeys

[jira] [Updated] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17291: Target Version/s: 3.5.0 (was: 3.4.0) > DataNode metric bytesWritten is not totally accurate in

[jira] [Updated] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17291: Fix Version/s: 3.5.0 (was: 3.4.0) > DataNode metric bytesWritten is not

[jira] [Updated] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17337: Fix Version/s: 3.5.0 (was: 3.4.0) > RPC RESPONSE time seems not exactly

[jira] [Updated] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17283: Fix Version/s: 3.5.0 (was: 3.4.0) > Change the name of variable SECOND in

[jira] [Updated] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17289: Target Version/s: 3.5.0 (was: 3.4.0) > Considering the size of non-lastBlocks equals to complete

[jira] [Updated] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17289: Fix Version/s: 3.5.0 (was: 3.4.0) > Considering the size of non-lastBlocks

[jira] [Updated] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17337: Target Version/s: 3.5.0 (was: 3.4.0) > RPC RESPONSE time seems not exactly accurate when using

[jira] [Resolved] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17337. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17291. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17289. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-17283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17283. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: 3.4.0 (was: 3.5.0)

[jira] [Resolved] (HDFS-17275) Judge whether the block has been deleted in the block report

[ https://issues.apache.org/jira/browse/HDFS-17275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17275. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: lei w Resolution:

[jira] [Updated] (HDFS-17275) Judge whether the block has been deleted in the block report

[ https://issues.apache.org/jira/browse/HDFS-17275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17275: Summary: Judge whether the block has been deleted in the block report (was: We should determine

[jira] [Resolved] (HDFS-17152) Fix the documentation of count command in FileSystemShell.md

[ https://issues.apache.org/jira/browse/HDFS-17152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17152. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix the

[jira] [Updated] (HDFS-17243) Add the parameter storage type for getBlocks method

[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17243: Component/s: balancer (was: balancer & mover) > Add the parameter storage

[jira] [Updated] (HDFS-17243) Add the parameter storage type for getBlocks method

[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17243: Component/s: balancer & mover (was: balamcer) > Add the parameter storage

[jira] [Resolved] (HDFS-17243) Add the parameter storage type for getBlocks method

[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17243. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add the parameter

[jira] [Updated] (HDFS-17227) EC: Fix bug in choosing targets when racks is not enough.

[ https://issues.apache.org/jira/browse/HDFS-17227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17227: Description: *Bug description* If, 1. There is a striped block blockinfo1, which has an excess

[jira] [Created] (HDFS-17227) EC: Fix bug in choosing targets when racks is not enough.

Shuyan Zhang created HDFS-17227: --- Summary: EC: Fix bug in choosing targets when racks is not enough. Key: HDFS-17227 URL: https://issues.apache.org/jira/browse/HDFS-17227 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-17227) EC: Fix bug in choosing targets when racks is not enough.

[ https://issues.apache.org/jira/browse/HDFS-17227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17227: --- Assignee: Shuyan Zhang > EC: Fix bug in choosing targets when racks is not enough. >

[jira] [Comment Edited] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17774370#comment-17774370 ] Shuyan Zhang edited comment on HDFS-17218 at 10/12/23 8:21 AM: --- Hi,

[jira] [Commented] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17774370#comment-17774370 ] Shuyan Zhang commented on HDFS-17218: - Hi, [~haiyang Hu] , your report is very valuable. I would like

[jira] [Updated] (HDFS-17218) NameNode should remove its excess blocks from the ExcessRedundancyMap When a DN registers

[ https://issues.apache.org/jira/browse/HDFS-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17218: Attachment: image-2023-10-12-15-52-52-336.png > NameNode should remove its excess blocks from the

[jira] [Created] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

Shuyan Zhang created HDFS-17204: --- Summary: EC: Reduce unnecessary log when processing excess redundancy. Key: HDFS-17204 URL: https://issues.apache.org/jira/browse/HDFS-17204 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-17204) EC: Reduce unnecessary log when processing excess redundancy.

[ https://issues.apache.org/jira/browse/HDFS-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17204: --- Assignee: Shuyan Zhang > EC: Reduce unnecessary log when processing excess redundancy. >

[jira] [Created] (HDFS-17197) Show file replication when listing corrupt files.

Shuyan Zhang created HDFS-17197: --- Summary: Show file replication when listing corrupt files. Key: HDFS-17197 URL: https://issues.apache.org/jira/browse/HDFS-17197 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-17190) EC: Fix bug of OIV processing XAttr.

[ https://issues.apache.org/jira/browse/HDFS-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17190: Summary: EC: Fix bug of OIV processing XAttr. (was: EC: Fix bug for OIV processing XAttr.) > EC:

[jira] [Updated] (HDFS-17190) EC: Fix bug for OIV processing XAttr.

[ https://issues.apache.org/jira/browse/HDFS-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17190: Description: When we need to use OIV to print EC information for a directory,

[jira] [Updated] (HDFS-17190) EC: Fix bug for OIV processing XAttr.

[ https://issues.apache.org/jira/browse/HDFS-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17190: Environment: (was: When we need to use OIV to print EC information for a directory,

[jira] [Created] (HDFS-17190) EC: Fix bug for OIV processing XAttr.

Shuyan Zhang created HDFS-17190: --- Summary: EC: Fix bug for OIV processing XAttr. Key: HDFS-17190 URL: https://issues.apache.org/jira/browse/HDFS-17190 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-17154) EC: Fix bug in updateBlockForPipeline after failover

[ https://issues.apache.org/jira/browse/HDFS-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17154: --- Assignee: Shuyan Zhang > EC: Fix bug in updateBlockForPipeline after failover >

[jira] [Created] (HDFS-17154) EC: Fix bug in updateBlockForPipeline after failover

Shuyan Zhang created HDFS-17154: --- Summary: EC: Fix bug in updateBlockForPipeline after failover Key: HDFS-17154 URL: https://issues.apache.org/jira/browse/HDFS-17154 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-17151) EC: Fix wrong metadata in BlockInfoStriped after recovery

Shuyan Zhang created HDFS-17151: --- Summary: EC: Fix wrong metadata in BlockInfoStriped after recovery Key: HDFS-17151 URL: https://issues.apache.org/jira/browse/HDFS-17151 Project: Hadoop HDFS

[jira] [Created] (HDFS-17150) EC: Fix the bug of failed lease recovery.

Shuyan Zhang created HDFS-17150: --- Summary: EC: Fix the bug of failed lease recovery. Key: HDFS-17150 URL: https://issues.apache.org/jira/browse/HDFS-17150 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

[ https://issues.apache.org/jira/browse/HDFS-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17134: Description: The result of `getListing` in NameNode are sorted based on `byte[]`, while the

[jira] [Assigned] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

[ https://issues.apache.org/jira/browse/HDFS-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17134: --- Assignee: Shuyan Zhang > RBF: Fix duplicate results of getListing through Router. >

[jira] [Created] (HDFS-17134) RBF: Fix duplicate results of getListing through Router.

Shuyan Zhang created HDFS-17134: --- Summary: RBF: Fix duplicate results of getListing through Router. Key: HDFS-17134 URL: https://issues.apache.org/jira/browse/HDFS-17134 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-17112) Show decommission duration in JMX and HTML

[ https://issues.apache.org/jira/browse/HDFS-17112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17112: --- Assignee: Shuyan Zhang > Show decommission duration in JMX and HTML >

[jira] [Created] (HDFS-17112) Show decommission duration in JMX and HTML

Shuyan Zhang created HDFS-17112: --- Summary: Show decommission duration in JMX and HTML Key: HDFS-17112 URL: https://issues.apache.org/jira/browse/HDFS-17112 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17094: Description: When a block recovery occurs, `RecoveryTaskStriped` in datanode expects

[jira] [Assigned] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17094: --- Assignee: Shuyan Zhang > EC: Fix bug in block recovery when there are stale datanodes >

[jira] [Created] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

Shuyan Zhang created HDFS-17094: --- Summary: EC: Fix bug in block recovery when there are stale datanodes Key: HDFS-17094 URL: https://issues.apache.org/jira/browse/HDFS-17094 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17089) Close child file systems in ViewFileSystem when cache is disabled.

[ https://issues.apache.org/jira/browse/HDFS-17089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17089: Summary: Close child file systems in ViewFileSystem when cache is disabled. (was: Close child

[jira] [Created] (HDFS-17089) Close child files systems in ViewFileSystem when cache is disabled.

Shuyan Zhang created HDFS-17089: --- Summary: Close child files systems in ViewFileSystem when cache is disabled. Key: HDFS-17089 URL: https://issues.apache.org/jira/browse/HDFS-17089 Project: Hadoop HDFS

[jira] [Updated] (HDFS-17049) EC: Fix duplicate block group IDs generated by SequentialBlockGroupIdGenerator

[ https://issues.apache.org/jira/browse/HDFS-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17049: Description: When I used multiple clients to write EC files concurrently, I found that NameNode

[jira] [Updated] (HDFS-17049) EC: Fix duplicate block group IDs generated by SequentialBlockGroupIdGenerator

[ https://issues.apache.org/jira/browse/HDFS-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17049: Summary: EC: Fix duplicate block group IDs generated by SequentialBlockGroupIdGenerator (was: Fix

[jira] [Updated] (HDFS-17049) Fix duplicate block group IDs generated by SequentialBlockGroupIdGenerator

[ https://issues.apache.org/jira/browse/HDFS-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17049: Summary: Fix duplicate block group IDs generated by SequentialBlockGroupIdGenerator (was: Fix

[jira] [Assigned] (HDFS-17049) Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator

[ https://issues.apache.org/jira/browse/HDFS-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-17049: --- Assignee: Shuyan Zhang > Fix duplicate block group ids generated by

[jira] [Created] (HDFS-17049) Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator

Shuyan Zhang created HDFS-17049: --- Summary: Fix duplicate block group ids generated by SequentialBlockGroupIdGenerator Key: HDFS-17049 URL: https://issues.apache.org/jira/browse/HDFS-17049 Project:

[jira] [Created] (HDFS-17037) Consider nonDfsUsed when running balancer

Shuyan Zhang created HDFS-17037: --- Summary: Consider nonDfsUsed when running balancer Key: HDFS-17037 URL: https://issues.apache.org/jira/browse/HDFS-17037 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17021. - Resolution: Not A Bug > GENSTAMP_MISMATCH replica can not be removed by

[jira] [Updated] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17021: Environment: (was: If a replica is corrupted due to generation stamp mismatch, the

[jira] [Updated] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-17021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-17021: Description: If a replica is corrupted due to generation stamp mismatch, the corresponding

[jira] [Created] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()

Shuyan Zhang created HDFS-17021: --- Summary: GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas() Key: HDFS-17021 URL: https://issues.apache.org/jira/browse/HDFS-17021 Project:

[jira] [Assigned] (HDFS-16999) Fix wrong use of processFirstBlockReport()

[ https://issues.apache.org/jira/browse/HDFS-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-16999: --- Assignee: Shuyan Zhang > Fix wrong use of processFirstBlockReport() >

[jira] [Created] (HDFS-16999) Fix wrong use of processFirstBlockReport()

Shuyan Zhang created HDFS-16999: --- Summary: Fix wrong use of processFirstBlockReport() Key: HDFS-16999 URL: https://issues.apache.org/jira/browse/HDFS-16999 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16986) EC: Fix locationBudget in getListing()

Shuyan Zhang created HDFS-16986: --- Summary: EC: Fix locationBudget in getListing() Key: HDFS-16986 URL: https://issues.apache.org/jira/browse/HDFS-16986 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-16974) Consider load of every volume when choosing target

[ https://issues.apache.org/jira/browse/HDFS-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-16974: --- Assignee: Shuyan Zhang > Consider load of every volume when choosing target >

[jira] [Created] (HDFS-16974) Consider load of every volume when choosing target

Shuyan Zhang created HDFS-16974: --- Summary: Consider load of every volume when choosing target Key: HDFS-16974 URL: https://issues.apache.org/jira/browse/HDFS-16974 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-16964) Improve processing of excess redundancy after failover

[ https://issues.apache.org/jira/browse/HDFS-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-16964: --- Assignee: Shuyan Zhang > Improve processing of excess redundancy after failover >

[jira] [Created] (HDFS-16964) Improve processing of excess redundancy after failover

Shuyan Zhang created HDFS-16964: --- Summary: Improve processing of excess redundancy after failover Key: HDFS-16964 URL: https://issues.apache.org/jira/browse/HDFS-16964 Project: Hadoop HDFS

[jira] [Created] (HDFS-16958) Fix bug in processing EC excess redundancy

Shuyan Zhang created HDFS-16958: --- Summary: Fix bug in processing EC excess redundancy Key: HDFS-16958 URL: https://issues.apache.org/jira/browse/HDFS-16958 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-16939) Fix the thread safety bug in LowRedundancyBlocks

Shuyan Zhang created HDFS-16939: --- Summary: Fix the thread safety bug in LowRedundancyBlocks Key: HDFS-16939 URL: https://issues.apache.org/jira/browse/HDFS-16939 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-16735) Reduce the number of HeartbeatManager loops

[ https://issues.apache.org/jira/browse/HDFS-16735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-16735: Description: HeartbeatManager only processes one dead datanode (and failed storage) per round in

[jira] [Assigned] (HDFS-16735) Reduce the number of HeartbeatManager loops

[ https://issues.apache.org/jira/browse/HDFS-16735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-16735: --- Assignee: Shuyan Zhang > Reduce the number of HeartbeatManager loops >

[jira] [Created] (HDFS-16735) Reduce the number of HeartbeatManager loops

Shuyan Zhang created HDFS-16735: --- Summary: Reduce the number of HeartbeatManager loops Key: HDFS-16735 URL: https://issues.apache.org/jira/browse/HDFS-16735 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-16683) All method metrics related to the rpc protocol should be initialized

[ https://issues.apache.org/jira/browse/HDFS-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang reassigned HDFS-16683: --- Assignee: Shuyan Zhang > All method metrics related to the rpc protocol should be

[jira] [Updated] (HDFS-16683) All method metrics related to the rpc protocol should be initialized

[ https://issues.apache.org/jira/browse/HDFS-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-16683: Environment: (was: When an RPC protocol is used, the metric of protocol-related methods should

[jira] [Updated] (HDFS-16683) All method metrics related to the rpc protocol should be initialized

[ https://issues.apache.org/jira/browse/HDFS-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-16683: Description: When an RPC protocol is used, the metric of protocol-related methods should be

[jira] [Created] (HDFS-16683) All method metrics related to the rpc protocol should be initialized

Shuyan Zhang created HDFS-16683: --- Summary: All method metrics related to the rpc protocol should be initialized Key: HDFS-16683 URL: https://issues.apache.org/jira/browse/HDFS-16683 Project: Hadoop

[jira] [Created] (HDFS-16146) All three replicas are lost due to not adding a new DataNode in time

Shuyan Zhang created HDFS-16146: --- Summary: All three replicas are lost due to not adding a new DataNode in time Key: HDFS-16146 URL: https://issues.apache.org/jira/browse/HDFS-16146 Project: Hadoop

[jira] [Updated] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-16099: Description: BPOfferService#bpServiceToActive is not volatile, which may cause

[jira] [Work started] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16099 started by Shuyan Zhang. --- > Make bpServiceToActive to be volatile > - >

[jira] [Created] (HDFS-16099) Make bpServiceToActive to be volatile

Shuyan Zhang created HDFS-16099: --- Summary: Make bpServiceToActive to be volatile Key: HDFS-16099 URL: https://issues.apache.org/jira/browse/HDFS-16099 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14263) Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream()

[ https://issues.apache.org/jira/browse/HDFS-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-14263: Description: As discussed in HDFS-10636, {{FsDatasetImpl#getBlockInputStream()}} doing unnecessary

[jira] [Updated] (HDFS-14263) Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream()

[ https://issues.apache.org/jira/browse/HDFS-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-14263: Description: * As discussed in HDFS-10636, {{FsDatasetImpl#getBlockInputStream()}} doing

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-15963: Attachment: HDFS-15963.003.patch > Unreleased volume references cause an infinite loop >

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-15963: Attachment: HDFS-15963.002.patch > Unreleased volume references cause an infinite loop >

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-15963: Attachment: HDFS-15963.001.patch > Unreleased volume references cause an infinite loop >

[jira] [Created] (HDFS-15963) Unreleased volume references cause an infinite loop

Shuyan Zhang created HDFS-15963: --- Summary: Unreleased volume references cause an infinite loop Key: HDFS-15963 URL: https://issues.apache.org/jira/browse/HDFS-15963 Project: Hadoop HDFS Issue