Jason Lowe created MAPREDUCE-4801:
-------------------------------------
Summary: ShuffleHandler can generate large logs due to prematurely
closed channels
Key: MAPREDUCE-4801
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4801
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.0.1-alpha, 0.23.3
Reporter: Jason Lowe
Priority: Critical
We ran into an instance where many nodes on a cluster ran out of disk space
because the nodemanager logs were huge. Examining the logs showed many, many
shuffle errors due to either ClosedChannelException or IOException from
"Connection reset by peer" or "Broken pipe".
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
