Daniel Dai created TEZ-1173:
-------------------------------
Summary: Need per output counters
Key: TEZ-1173
URL: https://issues.apache.org/jira/browse/TEZ-1173
Project: Apache Tez
Issue Type: Bug
Reporter: Daniel Dai
Assignee: Siddharth Seth
Tez currently collect per output counter by setting
"tez.task.generate.counters.per.io" and expose through a special counter group.
This is mostly for debugging purpose for now as [~sseth] told me. Pig need per
output counters so we don't need to go to hdfs to collect those information.
That will take from several hundred milliseconds to several seconds, which is
completely unnecessary and add overhead especially for iterative queries. We
want to make it a public API.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
