[ 
https://issues.apache.org/jira/browse/TEZ-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397915#comment-16397915
 ] 

Eric Wohlstadter edited comment on TEZ-2161 at 3/14/18 12:46 AM:
-----------------------------------------------------------------

[~gopalv]

What do you think about using java.util.concurrent.atomic.LongAccumulator?

-Wouldn't that mean we can get rid of those final Counter aggregation locks?-

Scratch that, the aggregation is across tasks/vertices, so those loops still 
need to be lock protected. 


was (Author: ewohlstadter):
[~gopalv]

What do you think about using java.util.concurrent.atomic.LongAccumulator?

Wouldn't that mean we can get rid of those final Counter aggregation locks?

Although ... we'd need to package this in some kind of -Phadoop3 profile, 
because Tez still advertises support for Java 1.7.

> Support CRDT aggregation models for counters 
> ---------------------------------------------
>
>                 Key: TEZ-2161
>                 URL: https://issues.apache.org/jira/browse/TEZ-2161
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Eric Wohlstadter
>            Priority: Major
>
> Some counters such as last event received time need to be handled different 
> to say bytes read counters. Bytes reads requires a summation across all tasks 
> within a vertex. The received time requires doing a max() across all the 
> tasks. First event received time would likely need a min().



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to