[
https://issues.apache.org/jira/browse/MAPREDUCE-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730223#action_12730223
]
Jothi Padmanabhan commented on MAPREDUCE-18:
--------------------------------------------
Some comments:
# On header verification failures, we should return null instead of continuing
# The validation for from_map_id of the header against the expected map id can
be added in addition to validating if the map id is in the correct format
> Under load the shuffle sometimes gets incorrect data
> ----------------------------------------------------
>
> Key: MAPREDUCE-18
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-18
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Owen O'Malley
> Assignee: Ravi Gummadi
> Priority: Blocker
> Attachments: MR-18.patch
>
>
> While testing HADOOP-5223 under load, we found reduces receiving completely
> incorrect data. It was often random, but sometimes was the output of the
> wrong map for the wrong map. It appears to either be a Jetty or JVM bug, but
> it is clearly happening on the server side. In the HADOOP-5223 code, I added
> information about the map and reduce that were included and we should add
> similar protection to 0.20 and trunk.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
