[
https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706229#comment-14706229
]
Gopal V commented on TEZ-2731:
------------------------------
[~rajesh.balamohan]: I thought UseBiasedLocking had some issues with
IdentityHashMap (so is not on by default)?
> Fix Tez GenericCounter performance bottleneck
> ---------------------------------------------
>
> Key: TEZ-2731
> URL: https://issues.apache.org/jira/browse/TEZ-2731
> Project: Apache Tez
> Issue Type: Sub-task
> Affects Versions: 0.6.0, 0.7.0, 0.8.0
> Reporter: Gopal V
> Assignee: Gopal V
> Attachments: TEZ-2731.1.patch, atomic-long-cntr.png, lock-inc.png,
> mr-reader-next.png
>
>
> GenericCounter::increment(1) shows up as a ~16% performance penalty inside
> the unvectorized codepath of Hive queries.
> The vectorized codepath amortizes this entirely by running through that
> exactly once every 1024 rows & the performance improvement is dramatic.
> !lock-inc.png!
> !mr-reader-next.png!
> Optimize the GenericCounter impl for mostly uncontested atomic operations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
