Reducers throw oom exceptions during fetching map outputs
---------------------------------------------------------
Key: HADOOP-2887
URL: https://issues.apache.org/jira/browse/HADOOP-2887
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Runping Qi
I have a job that ran fine if the flag for compressing the map output data to
false.
However, if the flag is set to true and the compression type set to block, then
the reducers all died due to out of memory exceptions.
The heap size was set to 512M.
The problem persists even when the heapsize set to 1000M.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
