[
https://issues.apache.org/jira/browse/FLINK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated FLINK-16803:
---------------------------
Description:
When inserting to a partition, Hive will update the partition's SD according to
table SD. For example, consider the following use case:
{code}
create table foo (x int,y int) partitioned by (p string);
insert overwrite table foo partition (p='1') select * from ...;
alter table foo set fileformat rcfile;
insert overwrite table foo partition (p='1') select * from ...;
{code}
The second INSERT will write RC files to the partition and therefore the
partition SD needs to be updated to use RC file input format. Otherwise we hit
exception when reading from this partition.
> Need to make sure partition inherit table spec when writing to Hive tables
> --------------------------------------------------------------------------
>
> Key: FLINK-16803
> URL: https://issues.apache.org/jira/browse/FLINK-16803
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Reporter: Rui Li
> Priority: Major
>
> When inserting to a partition, Hive will update the partition's SD according
> to table SD. For example, consider the following use case:
> {code}
> create table foo (x int,y int) partitioned by (p string);
> insert overwrite table foo partition (p='1') select * from ...;
> alter table foo set fileformat rcfile;
> insert overwrite table foo partition (p='1') select * from ...;
> {code}
> The second INSERT will write RC files to the partition and therefore the
> partition SD needs to be updated to use RC file input format. Otherwise we
> hit exception when reading from this partition.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
