JiangHua Zhu created HDFS-16414:
-----------------------------------
Summary: Improve asynchronous edit: reduce the time that edit
waits to enter editPendingQ
Key: HDFS-16414
URL: https://issues.apache.org/jira/browse/HDFS-16414
Project: Hadoop HDFS
Issue Type: Improvement
Components: fs async, namenode
Affects Versions: 2.9.2
Reporter: JiangHua Zhu
When dfs.namenode.edits.asynclogging=true, FSEditLogAsync starts to work, which
is very helpful for improving the speed of NameNode processing Call.
But there is a strange phenomenon here. When a lot of calls enter the NameNode
through RPC within a period of time, the handler will be forced to wait, in
seconds:
FSEditLogAsync#enqueueEdit():
if (Thread.holdsLock(this)) {
int permits = overflowMutex.drainPermits();
try {
do {
this.wait(1000); // will be notified by next logSync.
} while (!editPendingQ.offer(edit));
} finally {
overflowMutex.release(permits);
}
}
We should reduce this.wait(1000) here so that edit can be processed quickly.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
