Taraka Rama Rao Lethavadla created HIVE-27598:
-------------------------------------------------
Summary: Enhance alter table compact to work for partitioned
tables without specifying any partition
Key: HIVE-27598
URL: https://issues.apache.org/jira/browse/HIVE-27598
Project: Hive
Issue Type: Improvement
Components: Hive
Reporter: Taraka Rama Rao Lethavadla
Assignee: Taraka Rama Rao Lethavadla
*current implementation:* the below command will throw error
{noformat}
alter table PARTITIONED_T compact 'minor';{noformat}
for a partitioned
{code:java}
You must specify a partition to compact for partitioned tables{code}
{*}Problem{*}: One of the problem could be ,let's say a table contains 1000s of
partitions and for some issue like files permission automatic compaction will
mark all or few partitions as failed and never pick for compaction.
After we see performance getting degraded, we find out that there is a problem
in compaction due to some issue.
Now to solve it, we have two approaches, adjust failure thresholds and restart
HMS to pick the changes which is not going to work for someone who cannot
restart HMS
And the second approach is to execute alter table mentioning each partition
{*}Solution{*}:
In this Jira we are planning to allow alter table command for a partitioned
table without specifying any partition name.
Proposed solution is to list all the partitions and find partitions that are
eligible to get compacted and put an entry for it in compaction queue
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
