[
https://issues.apache.org/jira/browse/TEZ-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Lowe updated TEZ-3196:
----------------------------
Attachment: TEZ-3196.001.patch
Patch that treats InternalError during shuffle decompress as an IOException
similar to MAPREDUCE-5053.
> java.lang.InternalError from decompression codec is fatal to a task during
> shuffle
> ----------------------------------------------------------------------------------
>
> Key: TEZ-3196
> URL: https://issues.apache.org/jira/browse/TEZ-3196
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Jason Lowe
> Attachments: TEZ-3196.001.patch
>
>
> Many codecs throw java.lang.InternalError when their native implementations
> encounter an error in the codec. This is not treated like a fetch failure
> and instead is fatal to the task. The task should treat codec errors during
> fetch like other fetch failures and retry, hopefully triggering a re-run of
> the upstream task if necessary.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)