Jobs with empty map-outputs and intermediate compression fail
-------------------------------------------------------------
Key: HADOOP-3827
URL: https://issues.apache.org/jira/browse/HADOOP-3827
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.18.0
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Priority: Blocker
Fix For: 0.18.0
The corner case where there are zero map-outputs doesn't pass the codec to the
IFile.Writer leading to un-compressed data and subsequently failure on the
reduce when it tries to decompress that data.
The straight-forward fix is to pass the codec:
{noformat}
Writer<K, V> writer = new Writer<K, V>(job, finalOut,
- keyClass, valClass, null);
+ keyClass, valClass, codec);
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
