[
https://issues.apache.org/jira/browse/MAPREDUCE-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13117045#comment-13117045
]
Devaraj K commented on MAPREDUCE-2791:
--------------------------------------
Latest Output:
{code:title=Completed Job |borderStyle=solid}
Job: job_1317173942118_0001
Job File:
hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done_intermediate/root/job_1317173942118_0001_conf.xml
Job Tracking URL :
http://10.18.52.124:19888/jobhistory/job/job_1317173942118_1_1
map() completion: 1.0
reduce() completion: 1.0
Job state: SUCCEEDED
retired: false
reason for failure:
Counters: 43
File System Counters
FILE: BYTES_READ=16470
FILE: BYTES_WRITTEN=110802
FILE: READ_OPS=0
FILE: LARGE_READ_OPS=0
FILE: WRITE_OPS=0
HDFS: BYTES_READ=8782
HDFS: BYTES_WRITTEN=6503
HDFS: READ_OPS=9
HDFS: LARGE_READ_OPS=0
HDFS: WRITE_OPS=4
org.apache.hadoop.mapreduce.JobCounter
TOTAL_LAUNCHED_MAPS=1
TOTAL_LAUNCHED_REDUCES=1
DATA_LOCAL_MAPS=1
SLOTS_MILLIS_MAPS=5248
SLOTS_MILLIS_REDUCES=6856
org.apache.hadoop.mapreduce.TaskCounter
MAP_INPUT_RECORDS=243
MAP_OUTPUT_RECORDS=874
MAP_OUTPUT_BYTES=11541
MAP_OUTPUT_MATERIALIZED_BYTES=8115
SPLIT_RAW_BYTES=94
COMBINE_INPUT_RECORDS=874
COMBINE_OUTPUT_RECORDS=405
REDUCE_INPUT_GROUPS=405
REDUCE_SHUFFLE_BYTES=8115
REDUCE_INPUT_RECORDS=405
REDUCE_OUTPUT_RECORDS=405
SPILLED_RECORDS=810
SHUFFLED_MAPS=1
FAILED_SHUFFLE=0
MERGED_MAP_OUTPUTS=1
GC_TIME_MILLIS=47
CPU_MILLISECONDS=3680
PHYSICAL_MEMORY_BYTES=290209792
VIRTUAL_MEMORY_BYTES=1027088384
COMMITTED_HEAP_BYTES=168689664
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
BYTES_READ=8688
org.apache.hadoop.mapreduce.lib.output.FileOutputFormatCounter
BYTES_WRITTEN=6503
{code}
{code:title=Running Job |borderStyle=solid}
Job: job_1317173942118_0002
Job File:
hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/jo
b_1317173942118_0002/job.xml
Job Tracking URL : http://10.18.52.124:13740
map() completion: 1.0
reduce() completion: 0.0
Job state: RUNNING
retired: false
reason for failure:
Counters: 30
File System Counters
FILE: BYTES_READ=8235
FILE: BYTES_WRITTEN=59474
FILE: READ_OPS=0
FILE: LARGE_READ_OPS=0
FILE: WRITE_OPS=0
HDFS: BYTES_READ=8782
HDFS: BYTES_WRITTEN=0
HDFS: READ_OPS=3
HDFS: LARGE_READ_OPS=0
HDFS: WRITE_OPS=0
org.apache.hadoop.mapreduce.JobCounter
TOTAL_LAUNCHED_MAPS=1
TOTAL_LAUNCHED_REDUCES=1
DATA_LOCAL_MAPS=1
SLOTS_MILLIS_MAPS=5289
org.apache.hadoop.mapreduce.TaskCounter
MAP_INPUT_RECORDS=243
MAP_OUTPUT_RECORDS=874
MAP_OUTPUT_BYTES=11541
MAP_OUTPUT_MATERIALIZED_BYTES=8115
SPLIT_RAW_BYTES=94
COMBINE_INPUT_RECORDS=874
COMBINE_OUTPUT_RECORDS=405
SPILLED_RECORDS=405
FAILED_SHUFFLE=0
MERGED_MAP_OUTPUTS=0
GC_TIME_MILLIS=20
CPU_MILLISECONDS=1040
PHYSICAL_MEMORY_BYTES=194613248
VIRTUAL_MEMORY_BYTES=501895168
COMMITTED_HEAP_BYTES=136970240
org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
BYTES_READ=8688
{code}
> [MR-279] Missing/incorrect info on job -status CLI
> ---------------------------------------------------
>
> Key: MAPREDUCE-2791
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2791
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-2791-1.patch, MAPREDUCE-2791-1.patch,
> MAPREDUCE-2791-2.patch, MAPREDUCE-2791-3.patch, MAPREDUCE-2791-4.patch,
> MAPREDUCE-2791.patch
>
>
> There are a couple of details missing/incorrect on the job -status command
> line output for completed jobs:
> 1. Incorrect job file
> 2. map() completion is always 0
> 3. reduce() completion is always set to 0
> 4. history URL is empty
> 5. Missing launched map tasks
> 6. Missing launched reduce tasks
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
