[
https://issues.apache.org/jira/browse/HIVE-27598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-27598:
----------------------------------
Labels: pull-request-available (was: )
> Enhance alter table compact to work for partitioned tables without specifying
> any partition
> -------------------------------------------------------------------------------------------
>
> Key: HIVE-27598
> URL: https://issues.apache.org/jira/browse/HIVE-27598
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Reporter: Taraka Rama Rao Lethavadla
> Assignee: Taraka Rama Rao Lethavadla
> Priority: Major
> Labels: pull-request-available
>
> *current implementation:* the below command will throw error
>
> {noformat}
> alter table PARTITIONED_T compact 'minor';{noformat}
> for a partitioned
> {code:java}
> You must specify a partition to compact for partitioned tables{code}
> {*}Problem{*}: One of the problem could be ,let's say a table contains 1000s
> of partitions and for some issue like files permission automatic compaction
> will mark all or few partitions as failed and never pick for compaction.
> After we see performance getting degraded, we find out that there is a
> problem in compaction due to some issue.
> Now to solve it, we have two approaches, adjust failure thresholds and
> restart HMS to pick the changes which is not going to work for someone who
> cannot restart HMS
> And the second approach is to execute alter table mentioning each partition
> {*}Solution{*}:
> In this Jira we are planning to allow alter table command for a partitioned
> table without specifying any partition name.
> Proposed solution is to list all the partitions and find partitions that are
> eligible to get compacted and put an entry for it in compaction queue
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
