[
https://issues.apache.org/jira/browse/MAPREDUCE-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla updated MAPREDUCE-3993:
----------------------------------------
Attachment: MR-3993_branch1.patch
Uploading a preliminary patch for MR1. Need to add tests to ensure correct
behavior.
Any pointers on what might be the best way to force reading corrupt data in
tests?
> reduce fetch catch clause should catch RTEs as well
> ---------------------------------------------------
>
> Key: MAPREDUCE-3993
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3993
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv1, mrv2
> Affects Versions: 0.23.1, 1.0.2
> Reporter: Todd Lipcon
> Assignee: Karthik Kambatla
> Attachments: MR-3993_branch1.patch
>
>
> When using a compression codec for intermediate compression, some cases of
> corrupt data can cause the codec to throw exceptions other than IOException
> (eg java.lang.InternalError). This will currently cause the whole reduce task
> to fail, instead of simply treating it like another case of a failed fetch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
