[
https://issues.apache.org/jira/browse/KYLIN-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Calaba updated KYLIN-1847:
----------------------------------
Description:
I have realized that Hive tables kylin_intermediate_<cubename>_<snapshotdates>
after cancelling all pending build jobs and dropping the cube are not cleaned
properly.
It could be that I didn't execute Purge before Dropping the cube ... just a
theory, not 100% sure.
I also suspect that on hdfs in the /kylin/kylin_metadata/ directory I have too
many uncleaned data ... considering that I have just now only 1 cube having a
pending build job I see too many subdirectories there ...
There might be some relation to he JIRA I already reported as well ...
https://issues.apache.org/jira/browse/KYLIN-1828 - but again not 100% sure this
is the sole reason.
My impression is that the cleanup logic after the Drop cube needs to be
re-checked.
was:
I have realized that Hive tables kylin_intermediate_<cubename>_<snapshotdates>
after cancelling all pending build jobs and dropping the cube are no cleaned
properly.
It could be that I didn't execute Purge befor Dropping the cube ... just a
theory, not 100% sure.
I also suspect that on hdfs in the /kylin/kylin_metadata/ directory I have too
many uncleaned data ... considering that I have just now only 1 cube wih
pending build job I see too many subdirectories there ...
There might be some relation to he JIRA I already reported as well ...
https://issues.apache.org/jira/browse/KYLIN-1828 - but again not 100% sure this
is the sole reason.
My impression is that the cleanup logic after the Drop cube needs to be
re-checked.
> Cleanup of Intermediate tables not working well
> -----------------------------------------------
>
> Key: KYLIN-1847
> URL: https://issues.apache.org/jira/browse/KYLIN-1847
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v1.5.2, v1.5.2.1
> Reporter: Richard Calaba
>
> I have realized that Hive tables
> kylin_intermediate_<cubename>_<snapshotdates> after cancelling all pending
> build jobs and dropping the cube are not cleaned properly.
> It could be that I didn't execute Purge before Dropping the cube ... just a
> theory, not 100% sure.
> I also suspect that on hdfs in the /kylin/kylin_metadata/ directory I have
> too many uncleaned data ... considering that I have just now only 1 cube
> having a pending build job I see too many subdirectories there ...
> There might be some relation to he JIRA I already reported as well ...
> https://issues.apache.org/jira/browse/KYLIN-1828 - but again not 100% sure
> this is the sole reason.
> My impression is that the cleanup logic after the Drop cube needs to be
> re-checked.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
