[
https://issues.apache.org/jira/browse/HIVE-26825?focusedWorklogId=838781&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-838781
]
ASF GitHub Bot logged work on HIVE-26825:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Jan/23 08:02
Start Date: 12/Jan/23 08:02
Worklog Time Spent: 10m
Work Description: rkirtir commented on code in PR #3864:
URL: https://github.com/apache/hive/pull/3864#discussion_r1067808122
##########
ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/Cleaner.java:
##########
@@ -96,6 +100,7 @@ public class Cleaner extends MetaStoreCompactorThread {
static final private String CLASS_NAME = Cleaner.class.getName();
static final private Logger LOG = LoggerFactory.getLogger(CLASS_NAME);
private boolean metricsEnabled = false;
+ private Optional<Cache<String, TBase>> metaCache = Optional.empty();
Review Comment:
I have added
abstract Optional<Cache<String, TBase>> initializeCache(boolean
tableCacheOn); in MetastoreCompactorThread(Had to made
MetastoreCompactorThread abstract class now)
Initiator and Cleaner now implements initializeCache based on tableCacheOn
property
Issue Time Tracking
-------------------
Worklog Id: (was: 838781)
Time Spent: 1.5h (was: 1h 20m)
> Compactor: Cleaner shouldn't fetch table details again and again for
> partitioned tables
> ---------------------------------------------------------------------------------------
>
> Key: HIVE-26825
> URL: https://issues.apache.org/jira/browse/HIVE-26825
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
> Reporter: KIRTI RUGE
> Assignee: KIRTI RUGE
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Cleaner shouldn't be fetch table/partition details for all its partitions.
> When there are large number of databases/tables, it takes lot of time for
> Initiator to complete its initial iteration and load on DB also goes higher.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
