[
https://issues.apache.org/jira/browse/HDFS-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shilun Fan updated HDFS-16642:
------------------------------
Component/s: ha
namanode
Hadoop Flags: Reviewed
Target Version/s: 3.4.0
Affects Version/s: 3.4.0
> [SBN read] Moving selecting inputstream from JN in EditlogTailer out of
> FSNLock
> -------------------------------------------------------------------------------
>
> Key: HDFS-16642
> URL: https://issues.apache.org/jira/browse/HDFS-16642
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: ha, namanode
> Affects Versions: 3.4.0
> Reporter: ZanderXu
> Assignee: ZanderXu
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> EditlogTailer cost a long time for selecting InputStreams from Journalnode
> while holding the write lock of FSNLock.
> During this period, 8020 handlers of Observer NameNode will be blocked by the
> FSN Lock.
> In theory, selecting inputstreams from JournalNode does not involve changing
> memory information in NameNode, so we can move the selecting out of the FSN
> Lock, and it can improve the throughput of Observer NameNode.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
