[
https://issues.apache.org/jira/browse/HADOOP-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-2233:
----------------------------------
Attachment: 2233-4.patch
Moved GenericMRLoadGenerator from o.a.h.examples in examples to o.a.h.mapred in
test (removing the dependency on RandomWriter). Also changed generating map
output from BytesWritable to Text using the same strategy RandomTextWriter
employs for more realistic compression from maps.
> General example for modeling m/r load in Java
> ---------------------------------------------
>
> Key: HADOOP-2233
> URL: https://issues.apache.org/jira/browse/HADOOP-2233
> Project: Hadoop
> Issue Type: Improvement
> Components: test
> Reporter: Chris Douglas
> Assignee: Chris Douglas
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: 2233-0.patch, 2233-1.patch, 2233-2.patch, 2233-3.patch,
> 2233-4.patch
>
>
> This matches the hadoop.sort.(map|reduce).keep.percent interface in
> HADOOP-2127 and includes an "indirect" sort matching some user apps (when
> locality information is unavailable). It mostly, merely merges parts of the
> RandomWriter and Sort examples to effect sample loads in map/reduce.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
