Re: Kylin metadata and storage cleanup.

[Joel Victor]

Thanks ShaoFeng!

On Tue, Oct 18, 2016 at 2:13 PM, ShaoFeng Shi 
wrote:

> Hi Joel,
>
> StorageCleanupJob can be run at anytime. It will delete the htables/hdfs
> folders that have no reference, so it is safe. The "offline" means by
> manual (not by kylin)
>
> MetadataCleanup, would be better to run when there is no running job; and
> take a backup before clean is always recommended.
>
> 2016-10-17 22:29 GMT+08:00 Joel Victor :
>
>> In order to cleanup kylin metadata, HBase tables and HDFS. Can I do this
>> while kylin cube jobs are running in the background.
>> Is there a chance that the metadata might get messed up?
>> In this document http://kylin.apache.org/docs15/howto/howto_cleanup_
>> storage.html it says you can do offline cleanup. What is offline in this
>> context does it mean I have to stop the build jobs ?
>> Similarly with this http://kylin.apache.org/d
>> ocs15/howto/howto_backup_metadata.html. Is it safe to run this while
>> build jobs are running ?
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>

Re: Kylin metadata and storage cleanup.

[ShaoFeng Shi]

Hi Joel,

StorageCleanupJob can be run at anytime. It will delete the htables/hdfs
folders that have no reference, so it is safe. The "offline" means by
manual (not by kylin)

MetadataCleanup, would be better to run when there is no running job; and
take a backup before clean is always recommended.

2016-10-17 22:29 GMT+08:00 Joel Victor :

> In order to cleanup kylin metadata, HBase tables and HDFS. Can I do this
> while kylin cube jobs are running in the background.
> Is there a chance that the metadata might get messed up?
> In this document http://kylin.apache.org/docs15/howto/howto_
> cleanup_storage.html it says you can do offline cleanup. What is offline
> in this context does it mean I have to stop the build jobs ?
> Similarly with this http://kylin.apache.org/docs15/howto/howto_backup_
> metadata.html. Is it safe to run this while build jobs are running ?
>



-- 
Best regards,

Shaofeng Shi 史少锋

Kylin metadata and storage cleanup.

[Joel Victor]

In order to cleanup kylin metadata, HBase tables and HDFS. Can I do this
while kylin cube jobs are running in the background.
Is there a chance that the metadata might get messed up?
In this document
http://kylin.apache.org/docs15/howto/howto_cleanup_storage.html it says you
can do offline cleanup. What is offline in this context does it mean I have
to stop the build jobs ?
Similarly with this
http://kylin.apache.org/docs15/howto/howto_backup_metadata.html. Is it safe
to run this while build jobs are running ?