[
https://issues.apache.org/jira/browse/HIVE-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mahesh kumar behera updated HIVE-21717:
---------------------------------------
Description:
Rename fails with destination directory not empty in case a directory is move
directly to the table location from staging directory as rename cannot
overwrite non empty destination directory.
In replication scenarios, if user does some concurrent write during bootstrap
dump, it may happen that some data which are already replicated through
bootstrap, will be tried during next incremental load also. This is handled by
making the operations reentrant during repl load. But here move task is not
able to delete the directory created by bootstrap load even though replace flag
is set to true. This is causing the incremental load to fail.
was:Rename fails with destination directory not empty in case a directory is
move directly to the table location from staging directory as rename cannot
overwrite non empty destination directory.
> Rename is failing for directory in move task
> ---------------------------------------------
>
> Key: HIVE-21717
> URL: https://issues.apache.org/jira/browse/HIVE-21717
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 4.0.0
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21717.01.patch
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> Rename fails with destination directory not empty in case a directory is move
> directly to the table location from staging directory as rename cannot
> overwrite non empty destination directory.
>
> In replication scenarios, if user does some concurrent write during bootstrap
> dump, it may happen that some data which are already replicated through
> bootstrap, will be tried during next incremental load also. This is handled
> by making the operations reentrant during repl load. But here move task is
> not able to delete the directory created by bootstrap load even though
> replace flag is set to true. This is causing the incremental load to fail.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
