[jira] [Commented] (HIVE-18750) Exchange partition should not be supported with per table write ID.
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370355#comment-16370355 ] Sankar Hariappan commented on HIVE-18750: - Thanks [~ekoifman]! That's another point in favour of not supporting exchange partition on ACID tables. > Exchange partition should not be supported with per table write ID. > --- > > Key: HIVE-18750 > URL: https://issues.apache.org/jira/browse/HIVE-18750 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: Sankar Hariappan >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DDL > Fix For: 3.0.0 > > > Per table write id implementation (HIVE-18192) have introduced write ID per > table and used write ID to name the delta/base files and also as primary key > for each row. > Now, exchange partition have to move delta/base files across tables without > changing the write ID which causes incorrect results. > Also, this exchange partition feature is there to support the use-case of > atomic updates. But with ACID updates, we shall support atomic-updates and > hence it makes sense to not support exchange partition for ACID and MM tables. > The qtest file mm_exchangepartition.q test results to be updated after this > change. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18750) Exchange partition should not be supported with per table write ID.
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370272#comment-16370272 ] Eugene Koifman commented on HIVE-18750: --- Also, Load Data is supported for Acid tables - this can be used as an instant batch upload. > Exchange partition should not be supported with per table write ID. > --- > > Key: HIVE-18750 > URL: https://issues.apache.org/jira/browse/HIVE-18750 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: Sankar Hariappan >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DDL > Fix For: 3.0.0 > > > Per table write id implementation (HIVE-18192) have introduced write ID per > table and used write ID to name the delta/base files and also as primary key > for each row. > Now, exchange partition have to move delta/base files across tables without > changing the write ID which causes incorrect results. > Also, this exchange partition feature is there to support the use-case of > atomic updates. But with ACID updates, we shall support atomic-updates and > hence it makes sense to not support exchange partition for ACID and MM tables. > The qtest file mm_exchangepartition.q test results to be updated after this > change. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
