[
https://issues.apache.org/jira/browse/HIVE-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064866#comment-17064866
]
László Pintér edited comment on HIVE-23058 at 3/23/20, 3:14 PM:
----------------------------------------------------------------
[~rtrivedi12] Could you please add some unit tests? You could put an empty
file in the scratch dir of the compaction, trigger a compaction and make sure
the execution succeeds. Thanks
was (Author: lpinter):
[~rtrivedi12] Could you please add some unit tests? Thanks
> Compaction task reattempt fails with FileAlreadyExistsException
> ---------------------------------------------------------------
>
> Key: HIVE-23058
> URL: https://issues.apache.org/jira/browse/HIVE-23058
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 3.1.0
> Reporter: Riju Trivedi
> Assignee: Riju Trivedi
> Priority: Major
> Attachments: HIVE_23058.patch
>
>
> Issue occurs when compaction attempt is relaunched after first task attempt
> failure due to preemption by Scheduler or any other reason.
> Since _tmp directory was created by first attempt and was left uncleaned
> after task attempt failure. Second attempt of the the task fails with
> "FileAlreadyExistsException" exception.
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.FileAlreadyExistsException):
>
> /warehouse/tablespace/managed/hive/default.db/compaction_test/_tmp_3670bbef-ba7a-4c10-918d-9a2ee17cbd22/base_0000186/bucket_00005
> for client 10.xx.xx.xxx already exists
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
