[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809273#comment-17809273 ] ASF GitHub Bot commented on HDFS-17342: --- haiyang1987 commented on code in PR #6464:

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809270#comment-17809270 ] ASF GitHub Bot commented on HDFS-17342: --- haiyang1987 commented on PR #6464: URL: ht

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809267#comment-17809267 ] ASF GitHub Bot commented on HDFS-17346: --- hadoop-yetus commented on PR #6476: URL: h

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809261#comment-17809261 ] ASF GitHub Bot commented on HDFS-17293: --- hadoop-yetus commented on PR #6368: URL: h

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809236#comment-17809236 ] ASF GitHub Bot commented on HDFS-17293: --- hfutatzhanghb commented on PR #6368: URL:

[jira] [Resolved] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread Shuyan Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17293. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > First packet data + c

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809235#comment-17809235 ] ASF GitHub Bot commented on HDFS-17293: --- zhangshuyan0 commented on PR #6368: URL: h

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809234#comment-17809234 ] ASF GitHub Bot commented on HDFS-17293: --- zhangshuyan0 merged PR #6368: URL: https:/

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809229#comment-17809229 ] ASF GitHub Bot commented on HDFS-17293: --- hfutatzhanghb commented on PR #6368: URL:

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809227#comment-17809227 ] Haiyang Hu commented on HDFS-17346: --- Get it, thanks [~hexiaoqiao] for your comment. >

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809224#comment-17809224 ] Xiaoqiao He commented on HDFS-17346: [~haiyang Hu] Thanks for your contributions. The

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17346: --- Fix Version/s: (was: 3.5.0) > Fix DirectoryScanner check mark the normal blocks as corrupt. > ---

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Fix Version/s: 3.5.0 > Fix DirectoryScanner check mark the normal blocks as corrupt. >

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Component/s: datanode > Fix DirectoryScanner check mark the normal blocks as corrupt. > ---

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809222#comment-17809222 ] ASF GitHub Bot commented on HDFS-17346: --- haiyang1987 commented on PR #6476: URL: ht

[jira] [Commented] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809221#comment-17809221 ] ASF GitHub Bot commented on HDFS-17293: --- zhangshuyan0 commented on PR #6368: URL: h

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809215#comment-17809215 ] ASF GitHub Bot commented on HDFS-17342: --- ZanderXu commented on PR #6464: URL: https

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809212#comment-17809212 ] ASF GitHub Bot commented on HDFS-17342: --- smarthanwang commented on code in PR #6464

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809149#comment-17809149 ] ASF GitHub Bot commented on HDFS-17346: --- hadoop-yetus commented on PR #6476: URL: h

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17346: -- Labels: pull-request-available (was: ) > Fix DirectoryScanner check mark the normal blocks as

[jira] [Commented] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809114#comment-17809114 ] ASF GitHub Bot commented on HDFS-17346: --- haiyang1987 opened a new pull request, #64

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it maybe

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it maybe

[jira] [Updated] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17346: -- Description: DirectoryScanner check mark the normal blocks as corrupt and report to namenode, it maybe

[jira] [Created] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt.

2024-01-21 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17346: - Summary: Fix DirectoryScanner check mark the normal blocks as corrupt. Key: HDFS-17346 URL: https://issues.apache.org/jira/browse/HDFS-17346 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16511) Improve lock type for ReplicaMap under fine-grain lock mode.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16511: -- Affects Version/s: 3.4.0 > Improve lock type for ReplicaMap under fine-grain lock mode. > -

[jira] [Updated] (HDFS-16534) Split datanode block pool locks to volume grain.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16534: -- Affects Version/s: 3.4.0 > Split datanode block pool locks to volume grain. > -

[jira] [Updated] (HDFS-16534) Split datanode block pool locks to volume grain.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16534: -- Component/s: datanode > Split datanode block pool locks to volume grain. >

[jira] [Commented] (HDFS-17345) Add a metrics to record block report generating cost time

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809093#comment-17809093 ] ASF GitHub Bot commented on HDFS-17345: --- hadoop-yetus commented on PR #6475: URL: h