[
https://issues.apache.org/jira/browse/PIG-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802181#comment-15802181
]
Sushanth Sowmyan edited comment on PIG-5079 at 1/5/17 6:56 PM:
---------------------------------------------------------------
I'm afraid I haven't looked into the behaviour reported in HIVE-6897, and
haven't touched that section of code in ages, so I'm not certain if things have
changed. -However, overwrite is supported and was working with HCatalog except
for a couple of caveats (see HIVE-6476). The case is as follows:
a) By default, hcatalog will attempt to append instead of overwrite.
b) If the table has "immutable"="true" is set, then both hcatalog will attempt
to overwrite instead of append.
c) If the user is attempting a dynamic partitioning write, then any attempt to
append will fail - overwrite is the only supported mode in conjunction with
dynamic partitioning.-
Edit : Correction, looking at code, I was clearly wrong. Will update in a
couple of minutes.
was (Author: sushanth):
I'm afraid I haven't looked into the behaviour reported in HIVE-6897, and
haven't touched that section of code in ages, so I'm not certain if things have
changed. However, overwrite is supported and was working with HCatalog except
for a couple of caveats (see HIVE-6476). The case is as follows:
a) By default, hcatalog will attempt to append instead of overwrite.
b) If the table has "immutable"="true" is set, then both hcatalog will attempt
to overwrite instead of append.
c) If the user is attempting a dynamic partitioning write, then any attempt to
append will fail - overwrite is the only supported mode in conjunction with
dynamic partitioning.
> HCatalog - overwrite
> --------------------
>
> Key: PIG-5079
> URL: https://issues.apache.org/jira/browse/PIG-5079
> Project: Pig
> Issue Type: Improvement
> Components: build, data
> Affects Versions: 0.15.0
> Reporter: Praveen PentaReddy
> Priority: Minor
>
> In HCatalog, i am using hive table and doing transformation and after
> completing the transformation i want to overwrite the data back to the same
> hive table.however, while writing back the data to the same table, the
> transformed data is getting appended rather not getting overwrite.
> It would be good if we have option like overwrite so that if need we can use
> overwrite or append as we have this kind of feature in hive while importing
> the data into a hive table.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
