MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs
-----------------------------------------------------------------------------
Key: HADOOP-5936
URL: https://issues.apache.org/jira/browse/HADOOP-5936
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.20.0
Reporter: Suhas Gogate
Here is an example Map task entry in job history log, it has MAP_OUTPUT_RECORDS
but no MAP_OUTPUT_BYTES
Task TASKID="task_200905250540_0578_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1243294056346"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(56630)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28327)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(MAP_INPUT_RECORDS)(Map input
records)(2681)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map
input bytes)(28327)][(MAP_OUTPUT_RECORDS)(Map output records)(2681)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001"
TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" START
_TIME="1243294026959"
TRACKER_NAME="tracker_xxx1031\.xxxx\.com:localhost/127\.0\.0\.1:56939"
HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001"
TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" TASK_STATUS="SUCCESS"
FINISH_TIME="1243294041638" HOSTNAME="/xx\.xx\.xx\.xxx/xxx1031\.xxxx\.com"
STATE_STRING="Records R/W\=2634/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28316)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28303)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(MAP_INPUT_RECORDS)(Map input
records)(2634)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map
input bytes)(28303)][(MAP_OUTPUT_RECORDS)(Map output records)(2634)]}" .
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
