[
https://issues.apache.org/jira/browse/KYLIN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841250#comment-16841250
]
Na Zhai commented on KYLIN-4002:
--------------------------------
Hi, [~inigoml].
The script will check the hive dependency. If you use the beeline.
Have you set the {code:xml}kylin.source.hive.client=cli
kylin.source.hive.beeline-params=-n root --hiveconf \
hive.security.authorization.sqlstd.confwhitelist.append='mapreduce.job.*|dfs.*'
-u 'jdbc:hive2://localhost:10000'{code} in kylin.properties? If so, Kylin will
find the beeline to execute the drop command.
> Cleanup job does not delete Hive intermediate VIEW tables
> ----------------------------------------------------------
>
> Key: KYLIN-4002
> URL: https://issues.apache.org/jira/browse/KYLIN-4002
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Affects Versions: v2.6.1
> Reporter: Iñigo Martinez
> Priority: Minor
>
> Kylin org.apache.kylin.tool.StorageCleanupJob does not delete hive
> intermediate tables if they are view based.
> After several weeks running Kylin 2.6.1 after a successful upgrade from
> 2.4.1, we have a lot of temporary tables that have not been deleted. All of
> them come from a VIEW.
> However, those tables built directly from a table and not from a view, are
> properly deleted.
> Tables from view not deleted: 263079
> Tables not form view not deleted: 0
>
> At log level, we can see:
> {code:java}
> 2019-05-14 08:10:00,293 DEBUG [main] job.StorageCleanupJob:326 : Checking if
> table is garbage --
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> 2019-05-14 10:17:53,235 INFO [main] job.StorageCleanupJob:407 : Deleting Hive
> table
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> drop table if exists
> kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986;{code}
> So, it's properly detected and drop sentence properly created. But it's not
> executed and table is still there.
> We have launched the 263079 drop sentences via script and all are being
> removed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
