[
https://issues.apache.org/jira/browse/HADOOP-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654830#action_12654830
]
Hudson commented on HADOOP-4688:
--------------------------------
Integrated in Hadoop-trunk #683 (See
[http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/683/])
. Modify the MiniMRDFSSort unit test to spill multiple times,
exercising the map-side merge code.
> multiple spills/reducers test case for mergeParts() needed
> ----------------------------------------------------------
>
> Key: HADOOP-4688
> URL: https://issues.apache.org/jira/browse/HADOOP-4688
> Project: Hadoop Core
> Issue Type: Test
> Components: mapred
> Affects Versions: 0.19.1
> Reporter: Yuri Pradkin
> Assignee: Chris Douglas
> Fix For: 0.20.0
>
> Attachments: 4688-0.patch
>
>
> The first patch version (incorrect) for
> http://issues.apache.org/jira/browse/HADOOP-4614 exposed a problem that
> existing tests do not exercise some code paths of
> MapOutputBuffer::mergeParts(). In particular, we need a test that would
> validate output when numSpills >1 and partitions >1.
> This might be a test that has more than 1 reducer and forces multiple first
> level (map) spills by setting *io.sort.mb* (and possibly
> *io.sort.spill.percent*) to small values.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
