[
https://issues.apache.org/jira/browse/MAPREDUCE-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13117043#comment-13117043
]
Ravi Gummadi commented on MAPREDUCE-3118:
-----------------------------------------
System tests patches are not part of this for now. They will be added by Vinay
(may be later).
Backporting patches (features and bugfixes) are from the following JIRAs:
MAPREDUCE-2596: [Gridmix] Summarize Gridmix runs.
MAPREDUCE-2107: [Gridmix] Total heap usage emulation in Gridmix.
MAPREDUCE-2106: [Gridmix] Cumulative CPU usage emulation in Gridmix.
MAPREDUCE-2543: [Gridmix] High-Ram feature emulation testcase.
MAPREDUCE-2408: [Gridmix] Compression emulation in Gridmix.
MAPREDUCE-2137: Provide mapping between jobs of trace file and the
corresponding simulated cluster's jobs in Gridmix.
MAPREDUCE-2407: Make GridMix emulate usage of distributed cache files in
simulated jobs.
MAPREDUCE-2416: Remove the restriction of specifying group names in users-list
file for Gridmix in RoundRobinUserResolver mode.
MAPREDUCE-1931: Gridmix documentation.
MAPREDUCE-2417: Fix Gridmix in RoundRobinUserResolver mode to map testing/proxy
users to unique users in a trace.
MAPREDUCE-2095: Fix Gridmix to run from compressed traces.
MAPREDUCE-1989: Fix error message in gridmix when user resolver is set and no
user list is given.
MAPREDUCE-1979: Fix 'Output directory already exists' error in gridmix when
gridmix.output.directory is not defined.
MAPREDUCE-1975: Fix unnecessary InterruptedException log in gridmix.
\\
\\
\\
MAPREDUCE-2078: Fix TraceBuilder to generate traces when a globbed job history
path is given.
MAPREDUCE-2153: Rumen should bring in job configuration properties into the
trace file.
MAPREDUCE-2104: [Rumen] Add Cpu, Memory and Heap usages to TraceBuilder's
output.
MAPREDUCE-1978: Rumen TraceBuilder should provide recursive input folder
scanning.
MAPREDUCE-1918: Add documentation to Rumen.
MAPREDUCE-2000: Rumen is not able to extract counters for Job history logs from
Hadoop 0.20.
MAPREDUCE-1982: Fix Rumen's TraceBuilder to extract job name from either of
configuration properties mapreduce.job.name and mapred.job.name.
MAPREDUCE-1925: Fix failing TestRumenJobTraces.
\\
\\
This backporting also needs minor changes to mapreduce task progress reporting
because some of these gridmix features rely on the task progress values.
> Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-3118
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3118
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/gridmix, tools/rumen
> Affects Versions: 0.20.206.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.20.206.0
>
>
> Backporting all the features and bugfixes that went into gridmix and rumen of
> trunk to hadoop 0.20 security branch. This will enable using all these
> gridmix features and run gridmix/rumen on the history logs of 0.20 security
> branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
