apache-kylin.74782.x6.
> nabble.com/Can-kylin-intermediate-tables-in-hive-be-deleted-tp6617.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
<http://apache-kylin.74782.x6.nabble.com/file/n6617/intermediate.png>
Hi all, just as the pic shows, can these intermediate hive tables can be
deleted manually?
--
View this message in context:
http://apache-kylin.74782.x6.nabble.com/Can-kylin-intermediate-tables-in-hive-be-deleted-tp661
it might have something to do with the bug described in
https://issues.apache.org/jira/browse/KYLIN-1828, I'll cross check
On Tue, Jun 21, 2016 at 10:36 PM, ShaoFeng Shi
wrote:
> Hi Jie, would you mind to report a JIRA with this problem you found? If you
> can attache
Hi Jie, would you mind to report a JIRA with this problem you found? If you
can attache the json of this job and a couple of screen shot, that would be
great for analysis. Thank you!
2016-06-21 16:49 GMT+08:00 Jie Tao :
> actually the jobs have been disgarded. Maybe it is
actually the jobs have been disgarded. Maybe it is a bug that the status
of the job is still "ERROR". I have a look of the jobs at the Kylin Web
UI and found that the job was not marked with black colors like other
discarded jobs althouth the "action" button only has one choice
"diagonose".
by default the web UI only shows the jobs in LAST ONE WEEK, pls have a
check.
2016-06-17 16:58 GMT+08:00 Jie Tao :
> actually I discarded all jobs and I do not see any ERROR job in the
> Monitor view of Kylin UI.
>
> Where can I see these error jobs?
>
> Jie
>
>
> Am
actually I discarded all jobs and I do not see any ERROR job in the
Monitor view of Kylin UI.
Where can I see these error jobs?
Jie
Am 17.06.2016 um 10:31 schrieb ShaoFeng Shi:
Hi Jie,
If a job is "ERROR", the intermediate hive table of it will not be dropped,
as "ERROR" is not a final
Hi Jie,
If a job is "ERROR", the intermediate hive table of it will not be dropped,
as "ERROR" is not a final state; User can resume an "Error" job at any
time, so Kylin skipped to cleanup for that.
If you discard these error jobs, and re-run the cleanup, the intermediate
hive table will be
You are correct, the intermediate tables are left by fail-building. I do
clean up storage based on the linked guide. Intermediate data in HDFS
and Hbase are deleted, but the intermediate tables in Hive not. The
command shows the tables but do not drop them. I donot have a lookup
table but my
BTW, are you using a view as lookup table?
2016-06-17 15:15 GMT+08:00 ShaoFeng Shi :
> This is common; If you have a job failed in between, and you discard that
> job, the "Garbage collection" step will not be executed, so the garbages
> will be left there.
>
> This is
This is common; If you have a job failed in between, and you discard that
job, the "Garbage collection" step will not be executed, so the garbages
will be left there.
This is why we still recommend user to run offline cleanup every some
period; It is not perfert, but be good for most scenarios:
Woo... something new to me. Anybody knows?
On Tue, Jun 14, 2016 at 6:57 PM, Jie Tao wrote:
> Kylin actually drops useless intermediate tables after cube building, but
> I still see one "kylin_intermediate_cubename_searchdata" table for each
> cube building in Hive. Are
12 matches
Mail list logo