zhangshuyan0 opened a new pull request, #5541:
URL: https://github.com/apache/hadoop/pull/5541
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines:
https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g.,
'HADOOP-17799. Your PR title ...'.
-->
### Description of PR
The current target choosing policy only considers the load of the entire
datanode. If both DN1 and DN2 have an `xceiverCount` of 100, but DN1 has 10
volumes to write to and DN2 only has 1, then the pressure on DN2 is actually
much greater than that on DN1. This patch has added a configuration that allows
us to avoid nodes with too much pressure on a single volume when choosing
targets, so as to avoid overloading datanodes with few volumes or slowing down
writes.
### How was this patch tested?
Add a new UT for this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
