haiyang1987 opened a new pull request, #4903: URL: https://github.com/apache/hadoop/pull/4903
### Description of PR HDFS-16774.Improve async delete replica on datanode In our online cluster, a large number of ReplicaNotFoundExceptions occur when client reads the data. After tracing the root cause, it is caused by the asynchronous deletion of the replica operation has many stacked pending deletion caused ReplicationNotFoundException. Current the asynchronous delete of the replica operation process is as follows： 1.remove the replica from the ReplicaMap 2.delete the replica file on the disk [blocked in threadpool] 3.notifying namenode through IBR [blocked in threadpool] In order to avoid similar problems as much as possible, consider optimizing the execution flow： The deleting replica from ReplicaMap, deleting replica from disk and notifying namenode through IBR are processed in the same asynchronous thread. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
