[
https://issues.apache.org/jira/browse/HDFS-16432?focusedWorklogId=722539&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-722539
]
ASF GitHub Bot logged work on HDFS-16432:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 08/Feb/22 02:26
Start Date: 08/Feb/22 02:26
Worklog Time Spent: 10m
Work Description: liubingxing commented on pull request #3907:
URL: https://github.com/apache/hadoop/pull/3907#issuecomment-1032147081
Thanks @jojochuang for your comment. The block report taking time we
reported in this PR was obtained after merging HDFS-13671. I think that the
block report time will become longer after merging HDFS-13671 because
FoldedTreeSet have a better performance in dealing FBR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 722539)
Time Spent: 1.5h (was: 1h 20m)
> Namenode block report add yield to avoid holding write lock too long
> --------------------------------------------------------------------
>
> Key: HDFS-16432
> URL: https://issues.apache.org/jira/browse/HDFS-16432
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: qinyuren
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2022-01-20-15-19-28-384.png
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> !image-2022-01-20-15-19-28-384.png|width=683,height=132!
> In our cluster, namenode block report will held write lock for a long time if
> the storage block number more than 100000. So we want to add a yield
> mechanism in block reporting process to avoid holding write lock too long.
> # Ensure that the processing of the same block is in the same write lock.
> # Because StorageInfo.addBlock will moves the block to the head of
> blockList, so we can collect blocks that have not been reported by delimiter
> block.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
