[
https://issues.apache.org/jira/browse/HADOOP-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1350:
--------------------------------
Attachment: bigmapoutput.patch
Tested this patch for the case where a map generates more than 2 GB of output
for a single reduce. Worked perfectly. I am also attaching the source code for
simulating the big map output problem. It might prove useful for future
tests/benchmarks.
> Shuffle started taking a very long time after the HADOOP-1176 fix
> -----------------------------------------------------------------
>
> Key: HADOOP-1350
> URL: https://issues.apache.org/jira/browse/HADOOP-1350
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Devaraj Das
> Assigned To: Devaraj Das
> Priority: Blocker
> Fix For: 0.13.0
>
> Attachments: 1350.patch, bigmapoutput.patch
>
>
> Shuffle phase started taking a very long time after the fix for HADOOP-1176.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
