[
https://issues.apache.org/jira/browse/KYLIN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840306#comment-16840306
]
Na Zhai commented on KYLIN-4002:
--------------------------------
Hi, [~inigoml]
I can not reproduce your situation. I use the following sql to create the
view. Then build cubes using these two views as the fact table.
{code:sql}
CREATE VIEW IF NOT EXISTS kylin_sales_view (trans_num, cal_dt, lf_name) as
select trans_id, part_dt, lstg_format_name from kylin_sales limit 800;{code}
{code:sql}
CREATE VIEW IF NOT EXISTS ks_view_view (t_id, l_format_name) as select
trans_num, lf_name from kylin_sales_view limit 500;{code}
And StorageCleanupJob can delete hive intermediate tables that based on these
two views.
> Cleanup job does not delete Hive intermediate VIEW tables
> ----------------------------------------------------------
>
> Key: KYLIN-4002
> URL: https://issues.apache.org/jira/browse/KYLIN-4002
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v2.6.1
> Reporter: Iñigo Martinez
> Priority: Major
>
> Kylin org.apache.kylin.tool.StorageCleanupJob does not delete hive
> intermediate tables if they are view based.
> After several weeks running Kylin 2.6.1 after a successful upgrade from
> 2.4.1, we have a lot of temporary tables that have not been deleted. All of
> them come from a VIEW.
> However, those tables built directly from a table and not from a view, are
> properly deleted.
> Tables from view not deleted: 263079
> Tables not form view not deleted: 0
>
> At log level, we can see:
> {code:java}
> 2019-05-14 08:10:00,293 DEBUG [main] job.StorageCleanupJob:326 : Checking if
> table is garbage --
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> 2019-05-14 10:17:53,235 INFO [main] job.StorageCleanupJob:407 : Deleting Hive
> table
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> drop table if exists
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986;{code}
> So, it's properly detected and drop sentence properly created. But it's not
> executed and table is still there.
> We have launched the 263079 drop sentences via script and all are being
> removed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
