[ https://issues.apache.org/jira/browse/HADOOP-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436238#comment-13436238 ]
Daryn Sharp commented on HADOOP-7421: ------------------------------------- Regarding concern to harming performance, I recently noticed that MR/Yarn job submission is hardcoded to disable nagle in the conf. > Performance Patch: Disable Client-Side Nagle By Default > ------------------------------------------------------- > > Key: HADOOP-7421 > URL: https://issues.apache.org/jira/browse/HADOOP-7421 > Project: Hadoop Common > Issue Type: Improvement > Reporter: Ron Bodkin > > HADOOP-2232 was a valuable contribution, but I would suggest that Hadoop IPC > should disable Nagle's algorithm by default, to improve performance > system-wide. Nagle just adds delay to network connections, which is > unnecessary in the high bandwidth networks that Hadoop uses. As it stands, > this becomes an obscure, little known but important performance optimization > (especially for HBase), which took us days to track down during a performance > tuning exercise. Obviously integrating this optimization into the Hadoop > release will require performance testing to validate that it doesn't harm > performance, but it should only help. > I will submit a patch for how to address this in trunk. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira