Bikas Saha created TEZ-2265:
-------------------------------

             Summary: All inputs/outputs in a task share the same counter object
                 Key: TEZ-2265
                 URL: https://issues.apache.org/jira/browse/TEZ-2265
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Bikas Saha
            Assignee: Bikas Saha


This makes one input which reads the value of a counter to see updates that 
were made by some other input/output. Any decisions based on those counter 
values could be wrong and as of today, the output data size reported  in vertex 
manager event or by shuffle pipelining is potentially wrong.
Simple fix would be to have each IO have their own counters and merge them 
before reporting back up in the heartbeat.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to