[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744882#comment-17744882 ] ASF GitHub Bot commented on HDFS-17093: --- Tre2878 commented on PR #5856: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744861#comment-17744861 ] Yanlei Yu commented on HDFS-17093: -- {quote}Please push update to your same original branch (for this

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744854#comment-17744854 ] ASF GitHub Bot commented on HDFS-17094: --- tomscut commented on PR #5854: URL:

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744850#comment-17744850 ] ASF GitHub Bot commented on HDFS-17111: --- hadoop-yetus commented on PR #5860: URL:

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744845#comment-17744845 ] ASF GitHub Bot commented on HDFS-17111: --- hadoop-yetus commented on PR #5860: URL:

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744839#comment-17744839 ] ASF GitHub Bot commented on HDFS-17094: --- Hexiaoqiao commented on PR #5854: URL:

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744838#comment-17744838 ] ASF GitHub Bot commented on HDFS-17094: --- zhangshuyan0 commented on PR #5854: URL:

[jira] [Commented] (HDFS-17092) Datanode Full Block Report failed can lead to missing and under replicated blocks

[ https://issues.apache.org/jira/browse/HDFS-17092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744836#comment-17744836 ] Tao Li commented on HDFS-17092: --- Seems duplicated with HDFS-17093. > Datanode Full Block Report failed can

[jira] [Updated] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanlei Yu updated HDFS-17093: - Attachment: (was: HDFS-17093.patch) > In the case of all datanodes sending FBR when the namenode

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744835#comment-17744835 ] ASF GitHub Bot commented on HDFS-17094: --- tomscut commented on PR #5854: URL:

[jira] [Resolved] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17094. --- Fix Version/s: 3.4.0 Resolution: Fixed > EC: Fix bug in block recovery when there are stale datanodes

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744834#comment-17744834 ] ASF GitHub Bot commented on HDFS-17094: --- tomscut commented on PR #5854: URL:

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744833#comment-17744833 ] ASF GitHub Bot commented on HDFS-17094: --- tomscut merged PR #5854: URL:

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744820#comment-17744820 ] ASF GitHub Bot commented on HDFS-17111: --- hadoop-yetus commented on PR #5860: URL:

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744815#comment-17744815 ] ASF GitHub Bot commented on HDFS-17111: --- hadoop-yetus commented on PR #5860: URL:

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744814#comment-17744814 ] ASF GitHub Bot commented on HDFS-17094: --- hadoop-yetus commented on PR #5854: URL:

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744813#comment-17744813 ] ASF GitHub Bot commented on HDFS-17111: --- hadoop-yetus commented on PR #5860: URL:

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744796#comment-17744796 ] ASF GitHub Bot commented on HDFS-17111: --- hadoop-yetus commented on PR #5860: URL:

[jira] [Updated] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17111: -- Summary: RBF: Optimize msync to only call nameservices that have observer

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744762#comment-17744762 ] ASF GitHub Bot commented on HDFS-17093: --- hadoop-yetus commented on PR #5856: URL:

[jira] [Commented] (HDFS-17042) Add rpcCallSuccesses and OverallRpcProcessingTime to RpcMetrics for Namenode

[ https://issues.apache.org/jira/browse/HDFS-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744753#comment-17744753 ] ASF GitHub Bot commented on HDFS-17042: --- goiri merged PR #5804: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744751#comment-17744751 ] Xing Lin commented on HDFS-17093: - FYI, we set dfs.namenode.max.full.block.report.leases = 6, even though

[jira] [Updated] (HDFS-17111) RBF: Optimize msync to only call nameservices with observer namenodes.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17111: -- Labels: pull-request-available (was: ) > RBF: Optimize msync to only call nameservices with

[jira] [Commented] (HDFS-17111) RBF: Optimize msync to only call nameservices with observer namenodes.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744750#comment-17744750 ] ASF GitHub Bot commented on HDFS-17111: --- simbadzina opened a new pull request, #5860: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744749#comment-17744749 ] Xing Lin commented on HDFS-17093: - {quote}[~xinglin] ，I think you modify some more reasonable, datanode

[jira] [Assigned] (HDFS-17111) RBF: Optimize msync to only call nameservices with observer namenodes.

[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17111: - Assignee: Simbarashe Dzinamarira > RBF: Optimize msync to only call

[jira] [Created] (HDFS-17111) RBF: Optimize msync to only call nameservices with observer namenodes.

Simbarashe Dzinamarira created HDFS-17111: - Summary: RBF: Optimize msync to only call nameservices with observer namenodes. Key: HDFS-17111 URL: https://issues.apache.org/jira/browse/HDFS-17111

[jira] [Commented] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744741#comment-17744741 ] ASF GitHub Bot commented on HDFS-15042: --- mukund-thakur commented on code in PR #1747: URL:

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744715#comment-17744715 ] ASF GitHub Bot commented on HDFS-17094: --- hadoop-yetus commented on PR #5854: URL:

[jira] [Commented] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744709#comment-17744709 ] ASF GitHub Bot commented on HDFS-15042: --- steveloughran commented on code in PR #1747: URL:

[jira] [Commented] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744708#comment-17744708 ] ASF GitHub Bot commented on HDFS-15042: --- steveloughran commented on code in PR #1747: URL:

[jira] [Updated] (HDFS-17110) Null Pointer Exception when running TestHarFileSystemWithHA#testHarUriWithHaUriWithNoPort

[ https://issues.apache.org/jira/browse/HDFS-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ConfX updated HDFS-17110: - Attachment: (was: reproduce.sh) > Null Pointer Exception when running >

[jira] [Updated] (HDFS-17110) Null Pointer Exception when running TestHarFileSystemWithHA#testHarUriWithHaUriWithNoPort

[ https://issues.apache.org/jira/browse/HDFS-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ConfX updated HDFS-17110: - Attachment: reproduce.sh > Null Pointer Exception when running >

[jira] [Created] (HDFS-17110) Null Pointer Exception when running TestHarFileSystemWithHA#testHarUriWithHaUriWithNoPort

ConfX created HDFS-17110: Summary: Null Pointer Exception when running TestHarFileSystemWithHA#testHarUriWithHaUriWithNoPort Key: HDFS-17110 URL: https://issues.apache.org/jira/browse/HDFS-17110 Project:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744696#comment-17744696 ] ASF GitHub Bot commented on HDFS-17093: --- hadoop-yetus commented on PR #5855: URL:

[jira] [Updated] (HDFS-17109) Null Pointer Exception when running TestBlockManager

[ https://issues.apache.org/jira/browse/HDFS-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ConfX updated HDFS-17109: - Description: h2. What happened After setting {{{}dfs.namenode.redundancy.considerLoadByStorageType=true{}}},

[jira] [Created] (HDFS-17109) Null Pointer Exception when running TestBlockManager

ConfX created HDFS-17109: Summary: Null Pointer Exception when running TestBlockManager Key: HDFS-17109 URL: https://issues.apache.org/jira/browse/HDFS-17109 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-17108) Null Pointer Exception when running TestDecommissionWithBackoffMonitor

ConfX created HDFS-17108: Summary: Null Pointer Exception when running TestDecommissionWithBackoffMonitor Key: HDFS-17108 URL: https://issues.apache.org/jira/browse/HDFS-17108 Project: Hadoop HDFS

[jira] [Created] (HDFS-17107) Null Pointer Exception after turned on detail metric for namenode lock

ConfX created HDFS-17107: Summary: Null Pointer Exception after turned on detail metric for namenode lock Key: HDFS-17107 URL: https://issues.apache.org/jira/browse/HDFS-17107 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744617#comment-17744617 ] ASF GitHub Bot commented on HDFS-17093: --- Hexiaoqiao closed pull request #5856: HDFS-17093. In the

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744616#comment-17744616 ] ASF GitHub Bot commented on HDFS-17093: --- Hexiaoqiao commented on PR #5856: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744602#comment-17744602 ] Yanlei Yu commented on HDFS-17093: -- [~hexiaoqiao] I have modified and resubmitted PB[：GitHub Pull

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744600#comment-17744600 ] ASF GitHub Bot commented on HDFS-17093: --- Tre2878 commented on code in PR #5855: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744599#comment-17744599 ] ASF GitHub Bot commented on HDFS-17093: --- Tre2878 opened a new pull request, #5856: URL:

[jira] [Updated] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17093: -- Labels: pull-request-available (was: ) > In the case of all datanodes sending FBR when the

[jira] [Commented] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744537#comment-17744537 ] ASF GitHub Bot commented on HDFS-17094: --- zhangshuyan0 commented on PR #5854: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744538#comment-17744538 ] ASF GitHub Bot commented on HDFS-17093: --- Hexiaoqiao commented on code in PR #5855: URL:

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744526#comment-17744526 ] Xiaoqiao He commented on HDFS-17093: {quote}# DN wants to send 12 reports but only sent 1 report. #

[jira] [Comment Edited] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744524#comment-17744524 ] Yanlei Yu edited comment on HDFS-17093 at 7/19/23 10:24 AM: [~hexiaoqiao] ，

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744524#comment-17744524 ] Yanlei Yu commented on HDFS-17093: -- [~hexiaoqiao] ， {quote}would you mind to submit PR via Github if

[jira] [Comment Edited] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1778#comment-1778 ] Yanlei Yu edited comment on HDFS-17093 at 7/19/23 6:08 AM: --- Just to add to

[jira] [Commented] (HDFS-17093) In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete block reporting

[ https://issues.apache.org/jira/browse/HDFS-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1778#comment-1778 ] Yanlei Yu commented on HDFS-17093: -- Just to add to that,Our cluster configuration is