[
https://issues.apache.org/jira/browse/HIVE-26428?focusedWorklogId=796333&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-796333
]
ASF GitHub Bot logged work on HIVE-26428:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Jul/22 09:54
Start Date: 29/Jul/22 09:54
Worklog Time Spent: 10m
Work Description: szlta merged PR #3481:
URL: https://github.com/apache/hive/pull/3481
Issue Time Tracking
-------------------
Worklog Id: (was: 796333)
Time Spent: 20m (was: 10m)
> Limit usage of LLAP BPWrapper to threads of IO threadpools
> ----------------------------------------------------------
>
> Key: HIVE-26428
> URL: https://issues.apache.org/jira/browse/HIVE-26428
> Project: Hive
> Issue Type: Improvement
> Reporter: Ádám Szita
> Assignee: Ádám Szita
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> BPWrapper is used in LRFU cache eviction policy to decrease the time spent
> waiting for lock on the heap. This is done by adding a buffer as threadlocal
> and accumulating CacheableBuffer instances there before trying to acquire a
> lock. This works well when we have threads from pools such as IO-Elevator
> threads or OrcEncode threads.
> For ephemeral threads there's no advantage of doing this as the buffers in
> threadlocals may never reach the heap or list structures of LRFU, thereby
> also making evictions less efficient. This can happen e.g. LLAPCacheAwareFS
> is used with Parquet, where we're using the Tez threads for both execution
> and IO.
> We should disable BPWrappers for such cases.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
