[ 
https://issues.apache.org/jira/browse/MAPREDUCE-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791057#action_12791057
 ] 

Dick King commented on MAPREDUCE-1295:
--------------------------------------

I misnamed the patch.  

I will need to fix it anyway; I noticed that it doesn't print out the needed 
skew buffer size.  I will upload the new patch, with the correct name [and the 
then-correct date] after I see the hudson report and act on it if necessary.

> We need a job trace manipulator to build gridmix runs.
> ------------------------------------------------------
>
>                 Key: MAPREDUCE-1295
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1295
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Dick King
>            Assignee: Dick King
>         Attachments: mapreduce-1297--2009-12-14.patch
>
>
> Rumen produces "job traces", which are JSON format files describing important 
> aspects of all jobs that are run [successfully or not] on a hadoop map/reduce 
> cluster.  There are two packages under development that will consume these 
> trace files and produce actions in that cluster or another cluster: gridmix3 
> [see jira MAPREDUCE-1124 ] and Mumak [a simulator -- see MAPREDUCE-728 ].
> It would be useful to be able to do two things with job traces, so we can run 
> experiments using these two tools: change the duration, and change the 
> density.  I would like to provide a "folder", a tool that can wrap a 
> long-duration execution trace to redistribute its jobs over a shorter 
> interval, and also change the density by duplicating or culling away jobs 
> from the folded combined job trace.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to