[
https://issues.apache.org/jira/browse/HADOOP-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-3446:
----------------------------------
Attachment: 3446-1.patch
This passes mapred/hdfs tests and patch validation on my machine and doesn't
break LocalJobRunner (unlike 3446-0).
{noformat}
[exec] -1 overall.
[exec] +1 @author. The patch does not contain any @author tags.
[exec] -1 tests included. The patch doesn't appear to include any new
or modified tests.
[exec] Please justify why no tests are needed for
this patch.
[exec] -1 javadoc. The javadoc tool appears to have generated 1
warning messages.
[exec] +1 javac. The applied patch does not increase the total number
of javac compiler warnings.
[exec] +1 findbugs. The patch does not introduce any new Findbugs
warnings.
{noformat}
The "javadoc warning" is from:
{noformat}
[javadoc] javadoc: warning - Multiple sources of package comments found for
package "org.apache.commons.logging"
[javadoc] javadoc: warning - Multiple sources of package comments found for
package "org.apache.commons.logging.impl"
{noformat}
> The reduce task should not flush the in memory file system before starting
> the reducer
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3446
> URL: https://issues.apache.org/jira/browse/HADOOP-3446
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Critical
> Fix For: 0.19.0
>
> Attachments: 3446-0.patch, 3446-1.patch
>
>
> In the case where the entire reduce inputs fit in ram, we currently force the
> input to disk and re-read it before giving it to the reducer. It would be
> much better if we merged from the ramfs and any spills to feed the reducer
> its input.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
