[
https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449864#comment-17449864
]
tomscut commented on HDFS-15180:
--------------------------------
This is a great idea to introduce fine-grained locking for datanode. We
introduced [HDFS-15380|https://issues.apache.org/jira/browse/HDFS-15180] and
[HDFS-15382|https://issues.apache.org/jira/browse/HDFS-15382] based on
branch-3.1. Ran on our cold data cluster for a few months and it worked well.
[~Aiphag0] [~hexiaoqiao] [~sodonnell] Are we still promoting this work?
> DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.
> -----------------------------------------------------------
>
> Key: HDFS-15180
> URL: https://issues.apache.org/jira/browse/HDFS-15180
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Affects Versions: 3.2.0
> Reporter: Qi Zhu
> Assignee: Aiphago
> Priority: Major
> Attachments: HDFS-15180.001.patch, HDFS-15180.002.patch,
> HDFS-15180.003.patch, HDFS-15180.004.patch,
> image-2020-03-10-17-22-57-391.png, image-2020-03-10-17-31-58-830.png,
> image-2020-03-10-17-34-26-368.png, image-2020-04-09-11-20-36-459.png
>
>
> Now the FsDatasetImpl datasetLock is heavy, when their are many namespaces in
> big cluster. If we can split the FsDatasetImpl datasetLock via blockpool.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
