[
https://issues.apache.org/jira/browse/MAPREDUCE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hemanth Yamijala updated MAPREDUCE-964:
---------------------------------------
Attachment: MAPREDUCE-964-4.patch
The attached file fixes the Mumak test failures. All failures occurred because
the change introduced in the patch enforces the condition that finish time is
not set without start time. In the Mumak tests in TestSimulatorTaskTracker,
CheckedEventQueue.expectReduceTask and CheckedEventQueue.expectMapTask are not
setting startTime but setting the finished time. The fix was to set the
startTime in both cases as follows:
In expectMapTask:
status.setStartTime(mapStart);
In expectReduceTask:
status.setStartTime(mapDone);
With this change, I verified all Mumak tests pass.
> Inaccurate values in jobSummary logs
> ------------------------------------
>
> Key: MAPREDUCE-964
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-964
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Rajiv Chittajallu
> Assignee: Sreekanth Ramakrishnan
> Priority: Critical
> Attachments: mapreduce-964-1.patch, mapreduce-964-2.patch,
> mapreduce-964-3.patch, MAPREDUCE-964-4.patch, mapreduce-964-ydist.patch,
> mapreduce-964-ydist.patch
>
>
> For some jobs the mapSlotSeconds is incorrect.
> negative value
> 09/09/01 18:31:44 INFOmapred.JobInProgress$JobSummary:
> jobId=job_200908270718_4568,submitTime=1251823543976,launchTime=1251823554310,finishTime=1251829904565,
>
> numMaps=7965,numSlotsPerMap=1,numReduces=40,numSlotsPerReduce=1,user=wile,queue=runner,status=SUCCEEDED,
>
> mapSlotSeconds=-2503133523,reduceSlotsSeconds=186536,clusterMapCapacity=11262,clusterReduceCapacity=3754
> or too high
> 09/09/02 23:59:57 INFO mapred.JobInProgress$JobSummary:
> jobId=job_200908270718_5861,submitTime=1251935672924,launchTime=1251935687698,finishTime=1251935997949,
>
> numMaps=1026,numSlotsPerMap=1,numReduces=10,numSlotsPerReduce=1,user=dfsload,queue=gridops,status=SUCCEEDED,
>
> mapSlotSeconds=1251949742,reduceSlotsSeconds=537,clusterMapCapacity=11262,clusterReduceCapacity=3754
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
