Slim Bouguerra created HIVE-22492:
-------------------------------------
Summary: Amortize lock contention due to LRFU accounting
Key: HIVE-22492
URL: https://issues.apache.org/jira/browse/HIVE-22492
Project: Hive
Issue Type: Improvement
Reporter: Slim Bouguerra
Assignee: Slim Bouguerra
LRFU eviction policy can be a major source of contention under high load.
This can be see on the following profiles.
To fix this the idea is to use a batching wrapper to amortize the locking
contention.
The trick i a common way to amortize locking as explained here
http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf
--
This message was sent by Atlassian Jira
(v8.3.4#803005)