[
https://issues.apache.org/jira/browse/HIVE-24625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Magyar updated HIVE-24625:
---------------------------------
Description:
MetastoreDefaultTransformer in HMS converts a managed non transactional table
to external table. MoveTask still uses the managed path when loading the data,
resulting an always empty table.
{code:java}
create table tbl1 TBLPROPERTIES ('transactional'='false') as select * from
other;{code}
After the conversion the table location points to an external directory:
Location: |
hdfs://c670-node2.coelab.cloudera.com:8020/warehouse/tablespace/external/hive/tbl1
Move task uses the managed location"
{code:java}
INFO : Moving data to directory
hdfs://...:8020/warehouse/tablespace/managed/hive/tbl1 from
hdfs://...:8020/warehouse/tablespace/managed/hive/.hive-staging_hive_2021-01-05_16-10-39_973_41005081081760609-4/-ext-1000
{code}
> CTAS with TBLPROPERTIES ('transactional'='false') loads data into incorrect
> directory
> -------------------------------------------------------------------------------------
>
> Key: HIVE-24625
> URL: https://issues.apache.org/jira/browse/HIVE-24625
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Metastore
> Reporter: Attila Magyar
> Assignee: Attila Magyar
> Priority: Major
>
> MetastoreDefaultTransformer in HMS converts a managed non transactional table
> to external table. MoveTask still uses the managed path when loading the
> data, resulting an always empty table.
> {code:java}
> create table tbl1 TBLPROPERTIES ('transactional'='false') as select * from
> other;{code}
> After the conversion the table location points to an external directory:
> Location: |
> hdfs://c670-node2.coelab.cloudera.com:8020/warehouse/tablespace/external/hive/tbl1
> Move task uses the managed location"
> {code:java}
> INFO : Moving data to directory
> hdfs://...:8020/warehouse/tablespace/managed/hive/tbl1 from
> hdfs://...:8020/warehouse/tablespace/managed/hive/.hive-staging_hive_2021-01-05_16-10-39_973_41005081081760609-4/-ext-1000
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
