Daniel Dai created PIG-3981:
-------------------------------
Summary: Use Tez counter to collect per output stats
Key: PIG-3981
URL: https://issues.apache.org/jira/browse/PIG-3981
Project: Pig
Issue Type: Improvement
Components: tez
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.14.0
Pig currently goes to hdfs to collect those information. That will take from
several hundred milliseconds to several seconds, which adds overhead for
namenode and hurt performance especially for iterative queries.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
