RE: Segment overlap issues when refreshing a cube segment

Many thanks for the advice. Do you plan to release version 2.4.1 in September? From: ShaoFeng Shi [mailto:shaofeng...@apache.org] Sent: viernes, 24 de agosto de 2018 5:01 To: user Subject: Re: Segment overlap issues when refreshing a cube segment Kylin 2.4.1 will be kicked off soon,

RE: Segment overlap issues when refreshing a cube segment

Shaofeng, thank you very much for the help. I will share if version 2.4 solves our segment overlap issues. Roberto Tardío Olmos Head of Big Data Analytics Avenida de Brasil, 17, Planta 16.28020 Madrid Fijo: 91.788.34.10 http://bigdata.stratebi.com/

RE: Segment overlap issues when refreshing a cube segment

Many thanks ShaoFeng! Yes, I could see the new button because we also have a test installation of Kylin 2.4 and we are thinking about to update kylin of the production environment from 2.2 to 2.4. As for the API, I was aware of its existence. However, in the case I'm telling you we

Segment overlap issues when refreshing a cube segment

Hi, I am using Kylin 2.2, where I have several OLAP cubes in which I am constantly adding and refreshing segments. I am faced with a problem that has generated two segments for the same period of time and therefore an error of the "segments overlap" type. Kylin is also cluster mounted, with

RE: Kylin with S3, cubes tables get in transition when new cluster booted

Hi Moisés, If I have understood right you have been able to deploy Kylin on EMR successfully . However you lose metadata when you terminate the cluster. is it right? Have you tried to restore Kylin metadata backup after cluster re-creation? Moreover, do you enable all HBase tables

Cube moved from one project to another after editing it

Hi, Something very strange happened to us today. We were editing Configuration Overwrites (changing YARN queue) of a Cube. After saving its updated definition kylin moved the cube from current project to another existing project. Then we cannot use or build this cube. We have performed a

RE: Doubts about the hdfs working dir

Hi ShaoFeng, A very clear explanation, now I understand the use of Kylin working dir. Thanks! From: ShaoFeng Shi [mailto:shaofeng...@apache.org] Sent: miércoles, 9 de mayo de 2018 3:39 To: user Subject: Re: Doubts about the hdfs working dir Hi Roberto, The

Doubts about the hdfs working dir

Hi, I have some doubts about the use of kylin.env.hdfs-working-dir. I understand working dir is needed to store data about RUNNING or STOPPED JOBS. However, is it necessary to store data from finished jobs?. Although, we often execute kylin cleanup storage command, now our working dir folder

RE: Disable automatic cube enabling after building

Hi, There is a new patch to configure cube auto enabling. We have tried to compile and use with Kylin 2.3.1 with successful. https://issues.apache.org/jira/browse/KYLIN-3366 Many thanks to kylin team! From: roberto.tar...@stratebi.com [mailto:roberto.tar...@stratebi.com] Sent:

RE: Increase of time between steps after Kylin 2.3.1 update

Checking the log I verify that more time is spent between one step and another in our installation of Kylin 2.3.1 than when we used Kylin 2.2. In addition, JOBS are in PENDING status longer in the job monitor. Kylin 2.2 2018-05-04 14:25:40,797 INFO [Scheduler 542798956 Job

RE: Disable automatic cube enabling after building

Thanks Li Yang. I have created a JIRA for this new feature / improvement. https://issues.apache.org/jira/browse/KYLIN-3366 Regards, From: Li Yang [mailto:liy...@apache.org] Sent: martes, 1 de mayo de 2018 0:44 To: user@kylin.apache.org Subject: Re: Disable automatic cube enabling

RE: Hybrid Cubes Document

You're welcome ShaoFeng, Thanks for sharing your experiences, the application case of the hybrid model that you indicate is also very useful. Regards, From: ShaoFeng Shi [mailto:shaofeng...@apache.org] Sent: miércoles, 25 de abril de 2018 2:34 To: user Subject: Re:

Disable automatic cube enabling after building

Hi, Is it possible to disable automatic cube enabling after a building process? For example, this could be useful if we need to create a new version of a cube but we do not want it to be consulted until new cube has been properly tested. Regards, Roberto Tardío Olmos Senior Big Data &

RE: Hybrid Cubes Document

Hi Kumar, “Then Cube2 will be sufficient to get all query. Why do we need to combine?” If you combine Cube 1 and Cube 2 using a Hybrid Model, queries that contains common columns (dimensions or measures) will be routed to hybrid cube, thus joining data from Cube 1 and Cube 2. I.e. This can

RE: Hybrid Cubes Document

Hello Kumar, I try to answer your questions: 1. It can be useful in scenarios where i) we need to change cube definition optimizations (e.g. agg groups, mandatory dimensiones, rowkeys,…) or i) when we need to add columns or measures to a cube (the case I analyzed on document). Due

RE: Hybrid Cubes Document

Hi Billy, Yes, of course. You can publish or edit it if you consider appropriate. Kind Regards, Roberto Tardío From: Billy Liu [mailto:billy...@apache.org] Sent: lunes, 23 de abril de 2018 5:18 To: user Subject: Re: Hybrid Cubes Document Hello Roberto,

Cube migration between clusters

Hi, There is a tool for migrating kylin cubes between two Hadoop / Kylin clusters? It could be interesting to rebuild cubes in a development environment and be able to migrate them into a production environment, in order to avoid spending resources from the production cluster. Regards,

RE: Dict value is too long

Hi, Looks like there is a dimension with high cardinality (HC) that does not fit in dictionary. Please check if you have a HC dimension and try to change its Rowkey Encoding from dictionary (dic) to other encoding, such as fixed length. Have you tried this already? Regards, From:

Hybrid Cubes Document

Hi, Last days I was doing some researching about the use of hybrid cubes (model). However, I just found this document http://kylin.apache.org/blog/2015/09/25/hybrid-model/ published on Sep 25, 2015. Due to this fact, I wrote a little guide that aim to explain its use , possible use cases and

Modify an existing cube

Hi, Is it possible to modify a cube already built, such as adding new metrics or dimensions? Is it possible to rename cube columns? I have not seen anything about this type of common needs in the current Kylin documentation. I have tried to add a new metric but Kylin do not allow to save new

Dimension update issue

Hi, I have some questions about how Kylin refresh dimensions tables. In case you delete some instances of the dimension on hive table that are not used by any fact in fact table, These values will be deleted from dimension table on next cube segment built? We have to refresh old segments?

Job list API REST

Hi, I am using Kylin 2.2. In Kylin online docs I seen a RESTful API to get job list from a Kylin cube in one project. The syntax of this API is unclear in the documentation, but I can deduce the following: curl -L

YARN Queues and Kylin

Hi, There is any way to configure one cube to be built using a chosen YARN queue? The only way I see is to add the following property on kylin_job_conf_inmem.xml and kylin_job_conf.xml, but this affects all cube and not just one, as I need. mapreduce.job.queuename Kylin