[
https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated TEZ-2731:
-------------------------
Description:
GenericCounter::increment(1) shows up as a ~16% performance penalty inside the
unvectorized codepath of Hive queries.
The vectorized codepath amortizes this entirely by running through that exactly
once every 1024 rows & the performance improvement is dramatic.
!lock-inc.png!
!mr-reader-next.png!
Optimize the GenericCounter impl for mostly uncontested atomic operations.
was:
GenericCounter::increment(1) shows up as a ~16% performance penalty inside the
unvectorized codepath of Hive queries.
The vectorized codepath amortizes this entirely by running through that exactly
once every 1024 rows & the performance improvement is dramatic.
Optimize the GenericCounter impl for mostly uncontested atomic operations.
> Fix Tez GenericCounter performance bottleneck
> ---------------------------------------------
>
> Key: TEZ-2731
> URL: https://issues.apache.org/jira/browse/TEZ-2731
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Gopal V
> Attachments: lock-inc.png, mr-reader-next.png
>
>
> GenericCounter::increment(1) shows up as a ~16% performance penalty inside
> the unvectorized codepath of Hive queries.
> The vectorized codepath amortizes this entirely by running through that
> exactly once every 1024 rows & the performance improvement is dramatic.
> !lock-inc.png!
> !mr-reader-next.png!
> Optimize the GenericCounter impl for mostly uncontested atomic operations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
