[
https://issues.apache.org/jira/browse/HIVE-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669690#comment-15669690
]
Rui Li commented on HIVE-15202:
-------------------------------
[~ekoifman], is there any plan to implement this on Hive side? Or do you mean
users have to avoid such concurrent compactions themselves?
> Concurrent compactions for the same partition may generate malformed folder
> structure
> -------------------------------------------------------------------------------------
>
> Key: HIVE-15202
> URL: https://issues.apache.org/jira/browse/HIVE-15202
> Project: Hive
> Issue Type: Bug
> Reporter: Rui Li
>
> If two compactions run concurrently on a single partition, it may generate
> folder structure like this: (nested base dir)
> {noformat}
> drwxr-xr-x - root supergroup 0 2016-11-14 22:23
> /user/hive/warehouse/test/z=1/base_0000007/base_0000007
> -rw-r--r-- 3 root supergroup 201 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00000
> -rw-r--r-- 3 root supergroup 611 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00001
> -rw-r--r-- 3 root supergroup 614 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00002
> -rw-r--r-- 3 root supergroup 621 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00003
> -rw-r--r-- 3 root supergroup 621 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00004
> -rw-r--r-- 3 root supergroup 201 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00005
> -rw-r--r-- 3 root supergroup 201 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00006
> -rw-r--r-- 3 root supergroup 201 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00007
> -rw-r--r-- 3 root supergroup 201 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00008
> -rw-r--r-- 3 root supergroup 201 2016-11-14 21:46
> /user/hive/warehouse/test/z=1/base_0000007/bucket_00009
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
