[ 
https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17078878#comment-17078878
 ] 

zhuqi commented on HDFS-15180:
------------------------------

cc [~Aiphag0]

The Block in org.apache.hadoop.hdfs.protocol GenerationStamp and bytes action 
should change to synchronized.

There may some  cases that when holding the read lock, but we update the Block 
GenerationStamp at the same time.

!image-2020-04-09-11-20-36-459.png!

>  DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.
> -----------------------------------------------------------
>
>                 Key: HDFS-15180
>                 URL: https://issues.apache.org/jira/browse/HDFS-15180
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 3.2.0
>            Reporter: zhuqi
>            Assignee: Aiphago
>            Priority: Major
>         Attachments: HDFS-15180.001.patch, HDFS-15180.002.patch, 
> HDFS-15180.003.patch, HDFS-15180.004.patch, 
> image-2020-03-10-17-22-57-391.png, image-2020-03-10-17-31-58-830.png, 
> image-2020-03-10-17-34-26-368.png, image-2020-04-09-11-20-36-459.png
>
>
> Now the FsDatasetImpl datasetLock is heavy, when their are many namespaces in 
> big cluster. If we can split the FsDatasetImpl datasetLock via blockpool. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to