[
https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059199#comment-17059199
]
Aiphago commented on HDFS-15180:
--------------------------------
Hi [~zhuqi] ,Thanks for your proposal.And we have split dataset lock in our
early version about 2.7 ,and gray deploy in our produce cluster for weeks.It
looks like a good improvement in our version.But the trunck version looks big
different from our version and have many works to do.And our idea is to split
lock to blockpool at first, second we try to split each blockpool lock to
volume lock, third we try to remove remain IO in lock as HDFS-15000 say.If you
are interesting with this we can do this together.And here is the demo
patch,and may have some problem.
> DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.
> -----------------------------------------------------------
>
> Key: HDFS-15180
> URL: https://issues.apache.org/jira/browse/HDFS-15180
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Affects Versions: 3.2.0
> Reporter: zhuqi
> Assignee: zhuqi
> Priority: Major
> Attachments: image-2020-03-10-17-22-57-391.png,
> image-2020-03-10-17-31-58-830.png, image-2020-03-10-17-34-26-368.png
>
>
> Now the FsDatasetImpl datasetLock is heavy, when their are many namespaces in
> big cluster. If we can split the FsDatasetImpl datasetLock via blockpool.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
