[
https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060700#comment-17060700
]
zhuqi commented on HDFS-15180:
------------------------------
Thanks [~Aiphag0] for your works and the POC patch.
CC [~hexiaoqiao] [~Aiphag0] LGTM the POC patch.
There are some suggestions that :
First , we'd better to use Lock to implement AutoCloseableLock, so that
consistent with the new read write lock in DataNode and can use try() without
finally{} consisely.
Second, the get replica information in
DataNode#transferReplicaForPipelineRecovery should change to read lock.
And i am looking forward to the volume level lock, and remove remain IO lock.
> DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.
> -----------------------------------------------------------
>
> Key: HDFS-15180
> URL: https://issues.apache.org/jira/browse/HDFS-15180
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Affects Versions: 3.2.0
> Reporter: zhuqi
> Assignee: Aiphago
> Priority: Major
> Attachments: HDFS-15180.001.patch, image-2020-03-10-17-22-57-391.png,
> image-2020-03-10-17-31-58-830.png, image-2020-03-10-17-34-26-368.png
>
>
> Now the FsDatasetImpl datasetLock is heavy, when their are many namespaces in
> big cluster. If we can split the FsDatasetImpl datasetLock via blockpool.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
