[
https://issues.apache.org/jira/browse/KYLIN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nichunen closed KYLIN-4002.
---------------------------
Resolution: Fixed
> Cleanup job does not delete Hive intermediate VIEW tables
> ----------------------------------------------------------
>
> Key: KYLIN-4002
> URL: https://issues.apache.org/jira/browse/KYLIN-4002
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Affects Versions: v2.6.1
> Reporter: Iñigo Martinez
> Priority: Minor
>
> Kylin org.apache.kylin.tool.StorageCleanupJob does not delete hive
> intermediate tables if they are view based.
> After several weeks running Kylin 2.6.1 after a successful upgrade from
> 2.4.1, we have a lot of temporary tables that have not been deleted. All of
> them come from a VIEW.
> However, those tables built directly from a table and not from a view, are
> properly deleted.
> Tables from view not deleted: 263079
> Tables not form view not deleted: 0
>
> At log level, we can see:
> {code:java}
> 2019-05-14 08:10:00,293 DEBUG [main] job.StorageCleanupJob:326 : Checking if
> table is garbage --
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> 2019-05-14 10:17:53,235 INFO [main] job.StorageCleanupJob:407 : Deleting Hive
> table
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> drop table if exists
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986;{code}
> So, it's properly detected and drop sentence properly created. But it's not
> executed and table is still there.
> We have launched the 263079 drop sentences via script and all are being
> removed.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
