[
https://issues.apache.org/jira/browse/HIVE-25600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan resolved HIVE-25600.
-------------------------------------
Target Version/s: 3.1.3
Resolution: Fixed
> Compaction job creates redundant base/delta folder within base/delta folder
> ---------------------------------------------------------------------------
>
> Key: HIVE-25600
> URL: https://issues.apache.org/jira/browse/HIVE-25600
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 3.1.0, 3.1.2
> Reporter: Nikhil Gupta
> Assignee: Nikhil Gupta
> Priority: Minor
> Labels: ACID, Compaction, pull-request-available
> Fix For: 3.1.3
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> {noformat}
> Hive table 'aa.bb_item' is corrupt. Found sub-directory
> 'abfs://[email protected]/prod-data/aa.db/bb_item/part_created_on=202105/base_0004042/base_0004042'
> in bucket directory for partition: part_created_on=202105
> at
> io.prestosql.plugin.hive.BackgroundHiveSplitLoader.loadPartition(BackgroundHiveSplitLoader.java:543)
> at
> io.prestosql.plugin.hive.BackgroundHiveSplitLoader.loadSplits(BackgroundHiveSplitLoader.java:325)
> at
> io.prestosql.plugin.hive.BackgroundHiveSplitLoader$HiveSplitLoaderTask.process(BackgroundHiveSplitLoader.java:254)
> at io.prestosql.plugin.hive.util.ResumableTasks$1.run(ResumableTasks.java:38)
> at io.prestosql.$gen.Presto_347____20210615_143054_2.run(Unknown Source)
> at io.airlift.concurrent.BoundedExecutor.drainQueue(BoundedExecutor.java:80)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829);{noformat}
> Why it happens:
> Multiple compaction jobs for the same transactions can be triggered if the
> HMS gets restarted and the MR job is still in progress.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
