[
https://issues.apache.org/jira/browse/KYLIN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205405#comment-16205405
]
zhengzfand commented on KYLIN-2937:
-----------------------------------
Clean up job only drop unuserd htable and hdfsFiles , method is
cleanUnusedHBaseTables , cleanUnusedHdfsFiles ,
cleanUnusedIntermediateHiveTable.
The dict row is record in metatable that will not clean up by cleanup job. For
partition cube,
cube segments will merge by 7/30 days and dict file will also merge into one
file . But nonpartition cube
does not have the merge step , and dict record will remain until user delete it
.
> 非分区cube的中间数据会累积
> ---------------
>
> Key: KYLIN-2937
> URL: https://issues.apache.org/jira/browse/KYLIN-2937
> Project: Kylin
> Issue Type: Bug
> Reporter: zhengzfand
>
> 非分区的cube构建之后,中间数据不会被清理.
> 存放在hdfs上的字典文件,会一直累积.cube构建时会加载所有这些累积字典文件,
> 有可能导致内存溢出(如果字典文件够大够多的话).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
