Eric Wohlstadter commented on TEZ-2161:

{quote}Adding a MAX_GC_MILLIS counter with new semantics explicitly is better 
than messing with the existing GC_MILLIS counter.{quote}
Just to make sure I understand, you're suggesting to use something like 
polymorphism to "parameterize" the behavior of Counters. That way the 
particular aggregation logic is encapsulated in specific counter classes, 
instead of scattered throughout all the counter related classes. 

Is that right?


> Support CRDT aggregation models for counters 
> ---------------------------------------------
>                 Key: TEZ-2161
>                 URL: https://issues.apache.org/jira/browse/TEZ-2161
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Eric Wohlstadter
>            Priority: Major
> Some counters such as last event received time need to be handled different 
> to say bytes read counters. Bytes reads requires a summation across all tasks 
> within a vertex. The received time requires doing a max() across all the 
> tasks. First event received time would likely need a min().

This message was sent by Atlassian JIRA

Reply via email to