[
https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237062#comment-14237062
]
Jihong Liu commented on HIVE-8966:
----------------------------------
Hi Alan,I have created a new patch. It works fine. The patch is pasted in that
jira, also added comment about the logic. Please have a look. Thanks and have a
good dayJihong
From: Alan Gates (JIRA) <j...@apache.org>
To: jhli...@yahoo.com
Sent: Friday, December 5, 2014 7:41 AM
Subject: [jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog
streaming cannot be compacted
[
https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14235645#comment-14235645
]
Alan Gates commented on HIVE-8966:
----------------------------------
Jihong, thanks for doing the testing on this.
We could change this to not compact the current delta file, or we could change
the cleaner to not remove the delta file that was still open during compaction.
I'll try to look at this in the next couple of days. We need to get this
fixed for 0.14.1.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
> Delta files created by hive hcatalog streaming cannot be compacted
> ------------------------------------------------------------------
>
> Key: HIVE-8966
> URL: https://issues.apache.org/jira/browse/HIVE-8966
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
> Affects Versions: 0.14.0
> Environment: hive
> Reporter: Jihong Liu
> Assignee: Alan Gates
> Priority: Critical
> Fix For: 0.14.1
>
> Attachments: HIVE-8966.patch
>
>
> hive hcatalog streaming will also create a file like bucket_n_flush_length in
> each delta directory. Where "n" is the bucket number. But the
> compactor.CompactorMR think this file also needs to compact. However this
> file of course cannot be compacted, so compactor.CompactorMR will not
> continue to do the compaction.
> Did a test, after removed the bucket_n_flush_length file, then the "alter
> table partition compact" finished successfully. If don't delete that file,
> nothing will be compacted.
> This is probably a very severity bug. Both 0.13 and 0.14 have this issue
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
