[
https://issues.apache.org/jira/browse/HDFS-15981?focusedWorklogId=584052&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-584052
]
ASF GitHub Bot logged work on HDFS-15981:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Apr/21 04:54
Start Date: 16/Apr/21 04:54
Worklog Time Spent: 10m
Work Description: langlaile1221 opened a new pull request #2916:
URL: https://github.com/apache/hadoop/pull/2916
When the block report satisfies the block distribution strategy, the block
is removed from the lowredundancyBlocks. But removing the block from the
lowredundancyBlocks is a redundant operation.
First, in the patch queue, the block removal operation will be performed in
the method chooseSourceDatanodes and validateReconstructionWork.
second, the removal of the block report will only be at the
QUEUE_REPLICAS_BADLY_DISTRIBUTED level, which is not an accurate operation.
Finally, when there is a large amount of data in the
QUEUE_REPLICAS_BADLY_DISTRIBUTED queue, the processing efficiency of the block
report will be reduced
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 584052)
Remaining Estimate: 0h
Time Spent: 10m
> Removing redundant block queues will slow down block reporting
> --------------------------------------------------------------
>
> Key: HDFS-15981
> URL: https://issues.apache.org/jira/browse/HDFS-15981
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs
> Reporter: zhanghuazong
> Assignee: zhanghuazong
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> When the block report satisfies the block distribution strategy, the block is
> removed from the lowredundancyBlocks. But removing the block from the
> lowredundancyBlocks is a redundant operation.
> First, in the patch queue, the block removal operation will be performed in
> the method chooseSourceDatanodes and validateReconstructionWork.
> second, the removal of the block report will only be at the
> QUEUE_REPLICAS_BADLY_DISTRIBUTED level, which is not an accurate operation.
> Finally, when there is a large amount of data in the
> QUEUE_REPLICAS_BADLY_DISTRIBUTED queue, the processing efficiency of the
> block report will be reduced
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
