[
https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-12140:
------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.3
3.0.0-beta1
2.9.0
Status: Resolved (was: Patch Available)
Thansk for the patch, Daryn. And thanks for reviewing it, Rushabh. I've
committed this to trunk, branch-2 and branch-2.8.
> Remove BPOfferService lock contention to get block pool id
> ----------------------------------------------------------
>
> Key: HDFS-12140
> URL: https://issues.apache.org/jira/browse/HDFS-12140
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Affects Versions: 2.8.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 2.9.0, 3.0.0-beta1, 2.8.3
>
> Attachments: HDFS-12140.branch-2.8.patch, HDFS-12140.trunk.patch
>
>
> The block pool id is protected by a lock in {{BPOfferService}}. This creates
> excessive contention especially for xceivers threads attempting to queue IBRs
> and heartbeat processing. When the latter is delayed due to excessive
> FSDataset lock contention, it causes pipelines to collapse.
> Accessing the block pool id should be lockless after registration.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
