Daryn Sharp created HDFS-12647:
----------------------------------
Summary: DN commands processing should be async
Key: HDFS-12647
URL: https://issues.apache.org/jira/browse/HDFS-12647
Project: Hadoop HDFS
Issue Type: Sub-task
Components: datanode
Affects Versions: 2.8.0
Reporter: Daryn Sharp
Due to dataset lock contention, service actors may encounter significant
latency while processing DN commands. Even the queuing of async deletions
require multiple lock acquisitions. A slow disk will cause a backlog of
xceivers instantiating block sender/receivers which starves the actor and leads
to the NN falsely declaring the node dead.
Async processing of all commands will free the actor to perform its primary
purpose of heartbeating and block reporting. Note that FBRs will be dependent
on queued block invalidations not being included in the report.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
