[
https://issues.apache.org/jira/browse/HIVE-25600?focusedWorklogId=670541&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670541
]
ASF GitHub Bot logged work on HIVE-25600:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Oct/21 08:06
Start Date: 27/Oct/21 08:06
Worklog Time Spent: 10m
Work Description: sankarh merged pull request #2705:
URL: https://github.com/apache/hive/pull/2705
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 670541)
Time Spent: 1h (was: 50m)
> Compaction job creates redundant base/delta folder within base/delta folder
> ---------------------------------------------------------------------------
>
> Key: HIVE-25600
> URL: https://issues.apache.org/jira/browse/HIVE-25600
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 3.1.0, 3.1.2
> Reporter: Nikhil Gupta
> Assignee: Nikhil Gupta
> Priority: Minor
> Labels: ACID, Compaction, pull-request-available
> Fix For: 3.1.3
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> {noformat}
> Hive table 'aa.bb_item' is corrupt. Found sub-directory
> 'abfs://[email protected]/prod-data/aa.db/bb_item/part_created_on=202105/base_0004042/base_0004042'
> in bucket directory for partition: part_created_on=202105
> at
> io.prestosql.plugin.hive.BackgroundHiveSplitLoader.loadPartition(BackgroundHiveSplitLoader.java:543)
> at
> io.prestosql.plugin.hive.BackgroundHiveSplitLoader.loadSplits(BackgroundHiveSplitLoader.java:325)
> at
> io.prestosql.plugin.hive.BackgroundHiveSplitLoader$HiveSplitLoaderTask.process(BackgroundHiveSplitLoader.java:254)
> at io.prestosql.plugin.hive.util.ResumableTasks$1.run(ResumableTasks.java:38)
> at io.prestosql.$gen.Presto_347____20210615_143054_2.run(Unknown Source)
> at io.airlift.concurrent.BoundedExecutor.drainQueue(BoundedExecutor.java:80)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829);{noformat}
> Why it happens:
> Multiple compaction jobs for the same transactions can be triggered if the
> HMS gets restarted and the MR job is still in progress.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
