[
https://issues.apache.org/jira/browse/HUDI-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jin Xing updated HUDI-4087:
---------------------------
Description:
For a MOR table 'mor_simple' and its RO table 'mor_simple_ro' and RT table
'mor_simple_rt', if user drops 'mor_simple_ro' without purging. There might be
issue. Reproduce like below:
{code:java}
1. Create table as below:
CREATE TABLE mor_simple (
`id` INT,
`name` STRING,
`price` DOUBLE)
USING hudi
location '/user/hive/warehous/mor_simple'
OPTIONS(
'type' = 'mor',
'primaryKey' = 'id',
'hoodie.table.precombine.field' = 'id'
);
2. Trigger hive-sync by inserting values
insert into mor_simple values (1, 'z3', 1)
3. 'show tables' -- we will find mor_simple_rt and mor_simple_ro show up;
4. 'drop table mor_simple_ro' and 'show tables' -- we will find mor_simple is
dropped but mor_simple_ro can never be dropped.{code}
The issue happens because
was:
For a MOR table 'mor_simple' and its RO table 'mor_simple_ro' and RT table
'mor_simple_rt', if user drops 'mor_simple_ro' without purging. There might be
issue. Reproduce like below:
{code:java}
1. Create table as below:
CREATE TABLE mor_simple (
`id` INT,
`name` STRING,
`price` DOUBLE)
USING hudi
location '/user/hive/warehous/mor_simple'
OPTIONS(
'type' = 'mor',
'primaryKey' = 'id',
'hoodie.table.precombine.field' = 'id'
);
2. Trigger hive-sync by inserting values
insert into mor_simple values (1, 'z3', 1)
3. 'show tables' -- we will find mor_simple_rt and mor_simple_ro show up;
4. 'drop table mor_simple_ro' and 'show tables' -- we will find mor_simple is
dropped but mor_simple_ro can never be dropped.{code}
> Support dropping RO and RT table in DropHoodieTableCommand
> ----------------------------------------------------------
>
> Key: HUDI-4087
> URL: https://issues.apache.org/jira/browse/HUDI-4087
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Jin Xing
> Priority: Major
>
> For a MOR table 'mor_simple' and its RO table 'mor_simple_ro' and RT table
> 'mor_simple_rt', if user drops 'mor_simple_ro' without purging. There might
> be issue. Reproduce like below:
> {code:java}
> 1. Create table as below:
> CREATE TABLE mor_simple (
> `id` INT,
> `name` STRING,
> `price` DOUBLE)
> USING hudi
> location '/user/hive/warehous/mor_simple'
> OPTIONS(
> 'type' = 'mor',
> 'primaryKey' = 'id',
> 'hoodie.table.precombine.field' = 'id'
> );
> 2. Trigger hive-sync by inserting values
> insert into mor_simple values (1, 'z3', 1)
> 3. 'show tables' -- we will find mor_simple_rt and mor_simple_ro show up;
> 4. 'drop table mor_simple_ro' and 'show tables' -- we will find mor_simple is
> dropped but mor_simple_ro can never be dropped.{code}
>
> The issue happens because
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
