[
https://issues.apache.org/jira/browse/MAPREDUCE-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amar Kamat updated MAPREDUCE-2408:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.23.0
Release Note: Emulates the MapReduce compression feature in Gridmix. By
default, compression emulation is turned on. Compression emulation can be
disabled by setting 'gridmix.compression-emulation.enable' to 'false'. Use
'gridmix.compression-emulation.map-input.decompression-ratio',
'gridmix.compression-emulation.map-output.compression-ratio' and
'gridmix.compression-emulation.reduce-output.compression-ratio' to configure
the compression ratios at map input, map output and reduce output side
respectively. Currently, compression ratios in the range [0.07, 0.68] are
supported. Gridmix auto detects whether map-input, map output and reduce output
should emulate compression based on original job's compression related
configuration parameters.
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this to trunk. Thanks Ravi for the review!
> Make Gridmix emulate usage of data compression
> ----------------------------------------------
>
> Key: MAPREDUCE-2408
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2408
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/gridmix
> Reporter: Ravi Gummadi
> Assignee: Amar Kamat
> Fix For: 0.23.0
>
> Attachments: MR-2408-gridmix-compression-emulation-v1.1.patch
>
>
> Currently Gridmix emulates disk IO load only. This JIRA is to make Gridmix
> emulate load due to data compression as defined by the job-trace.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
