Re: Hdfs Working directory usage

Thanks , a lot Xiaoxiang,Really appreciate, your support, to impart clarity to us on this.Thanks,KetanSent from my Samsung Galaxy smartphone. Original message From: Xiaoxiang Yu Date: 11/02/2019 9:16 am (GMT+05:30) To: dev@kylin.apache.org Cc: Xiaoxiang Yu Subject: Re: Hdfs

Cleaning up hdfs working directory

Hi Kylin,We are having a a lot of data in our hdfs working directory, around 10tb , for last one year or so, this is acutally more than the hbase usage of kylin(around 9TB) on one of our kylin cluster. We are using kylin 2.3.1 on this cluster.1. Are all these files required for Kylin functionali

Re: Understanding about region cut size for base

Thanks ShaoFeng,I will check the code base to understand how these parameters are effecting the cube estimations, that will help us gauge most appropriate values for the same. (Till we plan to upgrade 2.5.1)I have a question though, If we chabge these parameters for the already existing cubes an

Re: Merge Job in inconsistent state

document is updated now, please refresh your web browser:https://kylin.apache.org/docs/howto/howto_backup_metadata.htmlShaoFeng Shi 于2018年10月30日周二 上午11:35写道：> Hi Ketan,>> You're welcome. JIRA is created for this issue:> https://issues.apache.org/jira/browse/KYLIN-3652>> kdc

Re: Merge Job in inconsistent state

Thanks, ShaoFeng,That's just what we need.I will use 'to-add' as reference, along with the online 'howto', that explains it all.Thanks,ke...@exponential.com Sent from my Samsung Galaxy smartphone. Original message From: ShaoFeng Shi Date: 30/10/2018 7:49 am (GMT+05:30) To: de

Re: Merge Job in inconsistent state

Thanks guys,, really appreciate the prompt response.@ShaoFeng,Yes we have the data in hive(or we can load that if needed). And we will be rebuilding those segments. Do we have any mail thread or document or blog to refer to for manully editing and restoring metadata. That would actually be great

Refreshing dimesnion data every 30 mins

Hi team,We have a requirement where we need to build a cube on hourly partitions incrementally. The 5 dimension tables that we have in hive are updated every 30 mins(append only). Each hour segment in Kylin is around 300GB. What i would like to understand is that will my latest dimensions will al

Re: Facing Issues with Kylin 2.3.1

Thanks ShaoFeng,That explains the process to me like when can an hbase table be dropped. One more thing that I will like to understand. In one of our Kylin Test setups of 2.1 we have faced one issue.Can you possibly point me out to what and how it could have been done. I am pointing to kylin met

Re: Kylin new metrics

Ok,  Thanks,Ketan Sent from my Samsung Galaxy smartphone. Original message From: ShaoFeng Shi Date: 31/10/17 13:22 (GMT+05:30) To: dev Subject: Re: Kylin new metrics Hi Ketan, The new metrics function hasn't been finished, so it will not be  in 2.2; You can expect it in a

Re: Kylie Cube Building,Merging and Refreshing getting stucked at Create HFile Step

Hi Guys, > We have a cube which is getting stucked for all type of jobs: > Build,Refresh and Merge on the “Create Hfile” step. > > Any idea, how can I get back to normalcy. > We are using Kylin 1.5.4.1 and the cube is being built incrementally on an > hourly basis. > > > Thanks, > kdcool6932 -- Best regards, Shaofeng Shi 史少锋