[
https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hitesh Shah updated TEZ-3331:
-----------------------------
Attachment: TEZ-3331.wip.2.patch
Some minor whitespace cleanup.
A couple of points to note:
Using "TezCounter counter = counters.findCounter(stats.getScheme(),
fsCounter.name()" results in counters:
{code}
file
BYTES_READ=12075
BYTES_WRITTEN=10401
hdfs
BYTES_READ=23513
BYTES_WRITTEN=14163
OP_CREATE=1
OP_GET_FILE_STATUS=4
OP_OPEN=8
OP_RENAME=1
READ_OPS=12
WRITE_OPS=2
{code}
compared to the current patch:
{code}
File System Counters
FILE_BYTES_READ=12075
FILE_BYTES_WRITTEN=10401
HDFS_BYTES_READ=23513
HDFS_BYTES_WRITTEN=14163
HDFS_READ_OPS=12
HDFS_WRITE_OPS=2
HDFS_OP_CREATE=1
HDFS_OP_GET_FILE_STATUS=4
HDFS_OP_OPEN=8
HDFS_OP_RENAME=1
{code}
> Add operation specific HDFS counters for Tez UI
> -----------------------------------------------
>
> Key: TEZ-3331
> URL: https://issues.apache.org/jira/browse/TEZ-3331
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jitendra Nath Pandey
> Attachments: TEZ-3331.wip.2.patch, TEZ-3331.wip.patch
>
>
> Hadoop has added several operation specific counters in the FileSystem
> statistics (HADOOP-13065). These counters are useful to track file system
> operations more granularly. It would be great to track these counters for Tez
> and expose them via UI as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
