[
https://issues.apache.org/jira/browse/TEZ-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251413#comment-14251413
]
Prakash Ramachandran edited comment on TEZ-1851 at 12/18/14 9:19 AM:
---------------------------------------------------------------------
+1 lgtm. checked the counters names and counter display names are same for all
counters.
one quick question though - for the counter group name they seem to be
different for ex
name: org.apache.tez.common.counters.FileSystemCounter and
counterGroupDisplayName: "File System Counters". should this be the same?
was (Author: pramachandran):
+1 lgtm. checked the counters and counter names are same for all counters.
one quick question though - for the counter group name they seem to be
different for ex
name: org.apache.tez.common.counters.FileSystemCounter and
counterGroupDisplayName: "File System Counters". should this be the same?
> BYTES_READ counter does not differentiate between local vs HDFS
> ---------------------------------------------------------------
>
> Key: TEZ-1851
> URL: https://issues.apache.org/jira/browse/TEZ-1851
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Prasanth Jayachandran
> Priority: Critical
> Attachments: TEZ-1851.1.txt
>
>
> I checked hadoop counters after running a hive query on tez. The logs show
> two counters for BYTES_READ but does not differentiate between them. Here is
> the log line for counters
> {code}
> 2014-12-12 15:17:10,102 INFO [AsyncDispatcher event handler]
> history.HistoryEventHandler:
> [HISTORY][DAG:dag_1418425019273_0003_1][Event:DAG_FINISHED]:
> dagId=dag_1418425019273_0003_1, startTime=1418426223988,
> finishTime=1418426230084, timeTaken=6096, status=SUCCEEDED, diagnostics=,
> counters=Counters: 49, org.apache.tez.common.counters.DAGCounter,
> NUM_SUCCEEDED_TASKS=7, TOTAL_LAUNCHED_TASKS=7, DATA_LOCAL_TASKS=6, File
> System Counters, BYTES_READ=250, BYTES_WRITTEN=358, READ_OPS=0,
> LARGE_READ_OPS=0, WRITE_OPS=0, BYTES_READ=7918626, BYTES_WRITTEN=8,
> READ_OPS=38, LARGE_READ_OPS=0, WRITE_OPS=2,
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
