[
https://issues.apache.org/jira/browse/MAPREDUCE-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16171910#comment-16171910
]
Eric Payne commented on MAPREDUCE-6960:
---------------------------------------
Thanks [~kshukla]. Patch LGTM. Will commit to 3.1.0, 3.0.0, 2.9, and 2.8.
+1
> Shuffle Handler prints disk error stack traces for every read failure.
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-6960
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6960
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Kuhu Shukla
> Assignee: Kuhu Shukla
> Attachments: MAPREDUCE-6960.001.patch
>
>
> {code}
> } catch (IOException e) {
> LOG.error("Shuffle error :", e);
> {code}
> In cases where the read from a disk fails and throws a DiskErrorException,
> the shuffle handler prints the entire stack trace for each and every one of
> the failures causing the nodemanager logs to quickly fill up the disk.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
